-- Logs begin at Tue 2022-09-13 13:32:04 UTC, end at Tue 2022-09-13 14:35:56 UTC. -- Sep 13 13:57:42.887377 dv-cinder-857434-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 13 13:57:42.898005 dv-cinder-857434-1-smb devstack@keystone.service[81614]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 13 13:57:42.900036 dv-cinder-857434-1-smb devstack@keystone.service[81614]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 13:57:42 2022] *** Sep 13 13:57:42.900036 dv-cinder-857434-1-smb devstack@keystone.service[81614]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 13:57:42.900036 dv-cinder-857434-1-smb devstack@keystone.service[81614]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 13:57:42.900036 dv-cinder-857434-1-smb devstack@keystone.service[81614]: nodename: dv-cinder-857434-1-smb Sep 13 13:57:42.900036 dv-cinder-857434-1-smb devstack@keystone.service[81614]: machine: x86_64 Sep 13 13:57:42.900036 dv-cinder-857434-1-smb devstack@keystone.service[81614]: clock source: unix Sep 13 13:57:42.900036 dv-cinder-857434-1-smb devstack@keystone.service[81614]: pcre jit disabled Sep 13 13:57:42.900036 dv-cinder-857434-1-smb devstack@keystone.service[81614]: detected number of CPU cores: 4 Sep 13 13:57:42.900036 dv-cinder-857434-1-smb devstack@keystone.service[81614]: current working directory: / Sep 13 13:57:42.900036 dv-cinder-857434-1-smb devstack@keystone.service[81614]: detected binary path: /usr/bin/uwsgi-core Sep 13 13:57:42.900659 dv-cinder-857434-1-smb devstack@keystone.service[81614]: your processes number limit is 47680 Sep 13 13:57:42.900659 dv-cinder-857434-1-smb devstack@keystone.service[81614]: your memory page size is 4096 bytes Sep 13 13:57:42.900659 dv-cinder-857434-1-smb devstack@keystone.service[81614]: detected max file descriptor number: 2048 Sep 13 13:57:42.900659 dv-cinder-857434-1-smb devstack@keystone.service[81614]: lock engine: pthread robust mutexes Sep 13 13:57:42.900659 dv-cinder-857434-1-smb devstack@keystone.service[81614]: thunder lock: enabled Sep 13 13:57:42.900659 dv-cinder-857434-1-smb devstack@keystone.service[81614]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 13 13:57:42.900659 dv-cinder-857434-1-smb devstack@keystone.service[81614]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 13:57:42.939344 dv-cinder-857434-1-smb devstack@keystone.service[81614]: Python main interpreter initialized at 0x5576453919c0 Sep 13 13:57:42.939344 dv-cinder-857434-1-smb devstack@keystone.service[81614]: python threads support enabled Sep 13 13:57:42.939344 dv-cinder-857434-1-smb devstack@keystone.service[81614]: your server socket listen backlog is limited to 100 connections Sep 13 13:57:42.939344 dv-cinder-857434-1-smb devstack@keystone.service[81614]: your mercy for graceful operations on workers is 90 seconds Sep 13 13:57:42.939683 dv-cinder-857434-1-smb devstack@keystone.service[81614]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 13:57:42.939760 dv-cinder-857434-1-smb devstack@keystone.service[81614]: *** Operational MODE: preforking *** Sep 13 13:57:42.940041 dv-cinder-857434-1-smb devstack@keystone.service[81614]: *** uWSGI is running in multiple interpreter mode *** Sep 13 13:57:42.940041 dv-cinder-857434-1-smb devstack@keystone.service[81614]: spawned uWSGI master process (pid: 81614) Sep 13 13:57:42.940230 dv-cinder-857434-1-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 13 13:57:42.941358 dv-cinder-857434-1-smb devstack@keystone.service[81614]: spawned uWSGI worker 1 (pid: 81625, cores: 1) Sep 13 13:57:42.941358 dv-cinder-857434-1-smb devstack@keystone.service[81614]: spawned uWSGI worker 2 (pid: 81626, cores: 1) Sep 13 13:57:42.941358 dv-cinder-857434-1-smb devstack@keystone.service[81614]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 13:57:47.357830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 13:57:47.357830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: from cryptography.utils import int_from_bytes Sep 13 13:57:47.358621 dv-cinder-857434-1-smb devstack@keystone.service[81626]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 13:57:47.358621 dv-cinder-857434-1-smb devstack@keystone.service[81626]: from cryptography.utils import int_from_bytes Sep 13 13:57:47.359036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 13:57:47.359036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: from cryptography.utils import int_from_bytes Sep 13 13:57:47.359143 dv-cinder-857434-1-smb devstack@keystone.service[81626]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 13:57:47.359143 dv-cinder-857434-1-smb devstack@keystone.service[81626]: from cryptography.utils import int_from_bytes Sep 13 13:57:47.441858 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 13:57:47.442021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 13:57:47.442148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 13:57:47.442240 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 13:57:47.442447 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] command line args: [] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 13:57:47.442529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] command line args: [] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 13:57:47.442873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 13:57:47.442958 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 13:57:47.443152 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ================================================================================ {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 13:57:47.443234 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ================================================================================ {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 13:57:47.443550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] admin_token = **** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.443629 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] admin_token = **** {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.443943 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] config_dir = [] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.444024 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] config_dir = [] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.444241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.444324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.444530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] config_source = [] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.444611 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] config_source = [] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.444820 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] debug = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.444907 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] debug = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.445160 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.445441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.445699 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.445814 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.445989 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.446099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.446950 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.447097 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.447337 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.447485 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.447717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] list_limit = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.447869 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] list_limit = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.448005 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] log_config_append = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.448115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] log_config_append = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.448293 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.448411 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.448585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] log_dir = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.448704 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] log_dir = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.448877 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] log_file = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.448952 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] log_file = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.449286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.449365 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.449695 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.449778 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.450098 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.450179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.450498 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.450577 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.450790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.450868 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.451082 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.451171 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.451478 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.451559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.451881 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.451964 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.452266 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.452350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.452647 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.452728 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.453026 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.453115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.453438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.453530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.453840 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.453919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.454242 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.454316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.454692 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.454774 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.455459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.455543 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.455762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] publish_errors = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.455837 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] publish_errors = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.456145 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.456225 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.456520 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.456606 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.456810 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.456891 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.457244 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.457343 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.457632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.457708 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.458016 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] standard_threads = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.458097 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] standard_threads = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.458396 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.458478 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.458794 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.458870 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.459084 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.459165 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.459373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] use_journal = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.459499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] use_journal = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.459660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] use_json = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.459736 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] use_json = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.459944 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] use_stderr = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.460025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] use_stderr = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.460231 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] use_syslog = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.460315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] use_syslog = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.460611 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.460685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:57:47.461034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.461137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.461457 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.461547 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.461917 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.462003 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.462315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.462397 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.462728 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.462812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.463125 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.463201 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.463535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.463615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.463927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.464011 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.464333 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.464412 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.464743 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.464818 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.465176 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.465270 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.465568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.465643 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.465977 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.466053 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.466367 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.466451 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.466774 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.466849 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.467179 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.467256 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.467572 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.467655 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.467989 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.468071 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.468407 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.468482 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.468813 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.468963 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.469229 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.469310 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.469648 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.469722 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.470078 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.470155 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.470496 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.470576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.470908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.470996 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.471293 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.471370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.471674 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.471748 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.472054 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.472135 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.472441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.472518 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.472846 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.472922 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.473295 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.473423 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.473663 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.473748 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.474041 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.474121 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.474757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.474849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.474849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.475043 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.475233 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.475314 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.475640 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.475723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.476022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.476099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.476409 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.476484 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.476797 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.476871 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.477202 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.477280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.477615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.477707 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.477996 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.478072 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.478379 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.478457 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.478770 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.478844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.479176 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.479251 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.479559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.479636 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.479952 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.480029 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.480335 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.480416 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.480724 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.480801 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.481130 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.481209 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.481543 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.481617 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.481929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.482007 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.482322 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.482396 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.482713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.482793 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.483104 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.483180 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.483497 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.483663 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.483887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.484006 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.484265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.484403 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.484677 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.484813 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.485080 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.485226 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.485488 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.485568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.485872 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.485961 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.486299 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.486384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.486691 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.486779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.487069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.487188 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.487462 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.487544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.487848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.487932 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.488283 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.488360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.488677 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.488754 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.489082 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.489209 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.489514 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.489590 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.489906 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.489990 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.490300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.490387 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.490690 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.490766 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.491091 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.491166 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.491485 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.491569 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.491879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.491954 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.492281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.492356 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.492675 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.492757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.493629 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.493728 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.494027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.494104 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.494418 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.494506 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.494811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.494894 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.495202 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.495277 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.495594 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.495678 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.496019 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.496097 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.496416 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.496494 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.496824 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.496908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.497250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.497328 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.497646 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.497721 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.498044 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.498199 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.498434 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.498512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.498822 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.498898 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.499216 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.499300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.499597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.499679 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.499975 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.500050 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.500353 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.500428 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.500741 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.500819 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.501164 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.501243 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.501537 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.501612 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.501925 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.502002 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.502332 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.502406 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.502722 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.502798 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.503143 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.503226 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.503568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.503650 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.503965 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.504075 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.504346 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] auth.external = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.504424 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] auth.external = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.504725 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.504802 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.505241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.505334 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.505626 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.505710 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.506008 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] auth.password = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.506088 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] auth.password = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.506385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] auth.token = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.506460 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] auth.token = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.506779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.506855 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.507166 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.507249 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.507571 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.507647 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.507953 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.508036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.508358 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.508435 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.509340 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.509467 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.509727 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.509805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.510119 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] credential.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.510198 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] credential.caching = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.510526 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.510609 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.510935 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.511013 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.511346 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.511427 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.511750 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.511832 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.512154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.512231 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.512540 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.512619 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.512948 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.513030 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.513397 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.513477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.513789 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.513874 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.514207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.514296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.514672 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.514751 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.515078 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.515156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.515510 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.515603 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.515907 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.515986 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.516329 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.516407 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.516716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] federation.caching = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.516793 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] federation.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.517157 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.517240 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.517538 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.517619 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.517948 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.518024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.518330 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.518407 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.518738 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.518818 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.519130 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.519207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.519550 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.519641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.519940 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.520017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.520362 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.520478 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.520751 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.520854 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.521181 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.521270 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.521571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.521648 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity.caching = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.521975 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.522157 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.522382 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.522460 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.522771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.522849 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.523160 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.523246 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.523563 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.523642 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.523944 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.524021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.524365 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.524456 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.524774 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.524853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.525209 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.525313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.525596 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.525688 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.525976 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.526055 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.526354 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.526430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.526755 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.526840 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.527158 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.527234 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.527562 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.527638 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.527984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.528074 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.528392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.528469 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.528831 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.528908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.529255 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.529345 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.529645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.529723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.530027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.530104 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.530418 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.530503 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.530798 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.530875 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.531186 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.531263 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.531582 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.531669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.531977 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.532055 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.532383 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.532461 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.532761 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.532855 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.533193 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.533281 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.533606 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.533684 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.533996 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.534376 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.534653 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.534731 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.535061 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.535137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.535443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.535536 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.535837 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.535923 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.536212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.536290 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.536603 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.536682 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.536992 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.537075 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.537419 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.537511 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.537810 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.537891 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.538367 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.538445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.538784 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.538863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.539196 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.539275 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.539586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.539664 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.539997 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.540074 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.540407 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.540487 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.540815 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.540892 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.541234 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.541336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.541627 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.541708 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.542017 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.542096 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.542397 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.542474 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.542794 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.542876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.543222 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.543301 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.543606 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.543683 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.544013 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.544093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.544419 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.544496 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.544821 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.544899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.545238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.545322 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.545619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.545697 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.546009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.546087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.546396 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.546475 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.546783 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.546872 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.547166 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.547249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.547571 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.547650 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.547979 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.548056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.548386 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.548462 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.548793 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.548870 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.549227 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.549306 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.549613 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.549689 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.550016 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.550096 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.550403 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.550480 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.550794 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.550871 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.551184 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.551263 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.551573 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.551651 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.551973 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.552050 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.552378 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.552457 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.552770 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.552847 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.553219 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.553301 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.553602 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.553681 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.554002 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.554079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.554389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.554467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.554776 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.554856 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.555167 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.555250 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.556086 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.556172 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.556486 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.556571 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.556865 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.556942 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.557279 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.557363 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.557675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] resource.caching = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.557755 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] resource.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.558087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.558165 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.558493 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.558570 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.558886 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.558992 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.559294 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.559381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.559706 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.559793 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.560094 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.560181 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.560499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.560584 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.560889 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.561048 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.561310 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.561396 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.561697 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] role.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.561783 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] role.caching = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.562100 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] role.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.562197 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] role.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.562479 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.562564 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.562887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.562973 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.563293 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.563387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.563702 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.563788 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.564108 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.564195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.564515 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.564610 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.564920 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.565007 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.565352 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.565438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.565759 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.565858 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.566140 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.566228 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.566547 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.566632 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.566955 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.567048 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.567362 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.567447 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.567767 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.567851 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.568396 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.568489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.568787 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.568913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.569224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.569308 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.569640 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.569728 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.570058 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.570137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.570468 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.570544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.570853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.570965 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.571816 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.571903 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.572229 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.572308 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.572627 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.572707 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.573012 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.573088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.573422 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.573500 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.573804 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.573883 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.574216 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.574293 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.574636 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.574712 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.575047 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.575125 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.575438 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.575514 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.575829 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.575904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.576210 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.576295 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.576596 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] token.caching = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.576672 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] token.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.576986 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.577068 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.577424 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.577507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.577814 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.577891 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.578234 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.578314 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.578639 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.578717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.579028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.579104 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.579429 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.579506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.579829 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.579907 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.580238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.580320 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.580631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.580708 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.581024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.581133 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.581440 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.581518 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.581846 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.581922 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.582293 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.582373 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.582674 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.582759 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.583074 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.583160 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.583507 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.583585 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.583930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.connection = **** {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.584014 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.connection = **** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.584329 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.584407 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.584736 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.584820 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.585149 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.585246 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.585550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.585629 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.585939 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.586015 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.586328 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.586426 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.586716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.586842 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.587133 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.587210 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.587535 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.587620 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.587922 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.588000 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.588322 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.588398 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.588707 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.588793 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.589130 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.589209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.589525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.589602 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.589928 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.590017 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.590306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.590383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.590696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.590773 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.591082 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.591168 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:57:47.591355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 13:57:47.591433 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 13:57:47.640576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.640724 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.640934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.641058 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.641314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.641437 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.655207 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.655311 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.701490 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.701705 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.708738 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.708969 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.754852 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.755504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.803239 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.803469 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.804114 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.804351 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.958704 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.958935 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.959124 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.959254 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.959362 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.959440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.959555 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.959638 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.959767 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.959855 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.959980 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.960192 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.983580 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.983855 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.983990 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.984097 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.984220 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.984304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.984442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.984634 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.984725 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.984857 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.984938 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.985070 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.985312 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.985523 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.996732 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:47.997041 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:48.009268 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:48.009497 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:48.009718 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:48.009853 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:48.009938 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:48.010140 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:48.010221 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:48.010355 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:48.010476 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:48.010558 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:48.010768 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:48.011075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:48.011334 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:48.011629 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 13:57:48.027643 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.027853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 13:57:48.028195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.028393 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 13:57:48.028665 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.028834 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.028918 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.029045 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 13:57:48.029194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.029455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.029549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.029723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 13:57:48.030089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.030437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.030804 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.031177 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.039277 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.039558 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.039832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.040657 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.044809 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.045271 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.045545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.045827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.047667 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.050572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.050861 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.051146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.051431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.051713 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.051974 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.052241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.052513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.052734 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.052815 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.053043 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.053340 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.055645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.055930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.056214 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.056496 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.056780 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.057041 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.057339 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.057615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.057884 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.058155 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.058420 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.075938 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.077431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.077716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.080745 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.082213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.082369 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.082495 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.082656 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.082946 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.087624 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.087905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.088183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.089847 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.090136 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.094486 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.094771 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.095725 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.096024 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.096316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.096605 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.096887 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.097197 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.097477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.097750 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.100325 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.100623 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.100912 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.101232 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.101509 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.101781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.102049 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.102317 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.113826 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.114109 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.118024 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.118239 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.118520 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.121261 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.121562 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.122364 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.125580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.125796 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.125892 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.128913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.130068 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.132103 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.132404 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.132692 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.132987 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.133264 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.133350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.133573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.136493 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.136791 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.137075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.137386 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.137675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.137969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.149041 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.149870 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.150139 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.150403 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.154148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.154437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.154704 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.154967 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.157164 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.158668 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.160417 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.160693 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.162025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.163466 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.163549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.163752 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.164036 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.164318 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.164720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.165598 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.165901 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.168671 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.168955 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.169272 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.169560 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.169942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.176384 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.176671 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.176955 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.177268 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.177647 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.177926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.178216 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.181010 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.181321 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.181603 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.181886 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.182269 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.182557 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.182839 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.193616 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.196538 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.198135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.199457 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.200923 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.201004 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.202521 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.202804 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.203208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.203885 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.205401 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.206858 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.207139 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.207530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.209611 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.211018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.214409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.214522 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.214827 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.215115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.215394 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.215845 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.218722 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.219120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.219405 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.219683 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.223201 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.223505 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.223789 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.227451 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.228315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.228607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.231230 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.231516 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.231799 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.232075 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.232347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.232615 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.232893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.233198 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.233470 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.233747 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.234030 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.234306 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.234580 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.234848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.235436 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 13:57:48.235719 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.236006 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.236291 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.236565 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.236838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.237136 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.237428 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.237697 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.237970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.238241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.238515 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.238779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.239045 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 13:57:48.270365 dv-cinder-857434-1-smb devstack@keystone.service[81626]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5576453919c0 pid: 81626 (default app) Sep 13 13:57:48.272530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5576453919c0 pid: 81625 (default app) Sep 13 13:57:48.273621 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62880fcf-c3f8-4cc7-8b09-4387d48e41d3 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:57:48.273908 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62880fcf-c3f8-4cc7-8b09-4387d48e41d3 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:57:48.274180 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62880fcf-c3f8-4cc7-8b09-4387d48e41d3 None None] PATH_INFO: `/v3` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:57:48.278914 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Tue Sep 13 13:57:48 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:57:54.969436 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11f9b2-a37a-4ea6-bf78-8aa3b08c2c58 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:57:54.969933 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11f9b2-a37a-4ea6-bf78-8aa3b08c2c58 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:57:54.970032 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11f9b2-a37a-4ea6-bf78-8aa3b08c2c58 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:57:54.974263 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:57:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 13:57:54.979476 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413193a-1442-4ed7-861a-2d14406725e2 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:57:54.979902 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413193a-1442-4ed7-861a-2d14406725e2 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:57:54.980043 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413193a-1442-4ed7-861a-2d14406725e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:57:55.052060 dv-cinder-857434-1-smb devstack@keystone.service[81626]: INFO dbcounter [None req-b413193a-1442-4ed7-861a-2d14406725e2 None None] Registered counter for database keystone Sep 13 13:57:55.072117 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG oslo_db.sqlalchemy.engines [None req-b413193a-1442-4ed7-861a-2d14406725e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81626) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 13:57:55.078351 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writer thread running {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 13:57:55.257870 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG passlib.handlers.bcrypt [None req-b413193a-1442-4ed7-861a-2d14406725e2 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81626) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 13 13:57:55.258180 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG passlib.handlers.bcrypt [None req-b413193a-1442-4ed7-861a-2d14406725e2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81626) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 13 13:57:55.319167 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b413193a-1442-4ed7-861a-2d14406725e2 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:57:55.320823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b413193a-1442-4ed7-861a-2d14406725e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:57:55.448685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:57:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 13 13:57:55.912759 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11f9b2-a37a-4ea6-bf78-8aa3b08c2c58 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:57:55.980708 dv-cinder-857434-1-smb devstack@keystone.service[81625]: INFO dbcounter [None req-6e11f9b2-a37a-4ea6-bf78-8aa3b08c2c58 None None] Registered counter for database keystone Sep 13 13:57:56.001611 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG oslo_db.sqlalchemy.engines [None req-6e11f9b2-a37a-4ea6-bf78-8aa3b08c2c58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81625) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 13:57:56.008021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writer thread running {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 13:57:56.124941 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11f9b2-a37a-4ea6-bf78-8aa3b08c2c58 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:57:56.129201 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d892f6-0146-4736-bfc4-1b5e32ca7dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:57:56.129812 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d892f6-0146-4736-bfc4-1b5e32ca7dbf admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:57:56.130088 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d892f6-0146-4736-bfc4-1b5e32ca7dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:57:56.130353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d892f6-0146-4736-bfc4-1b5e32ca7dbf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:57:56.138944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d892f6-0146-4736-bfc4-1b5e32ca7dbf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:57:56.190112 dv-cinder-857434-1-smb devstack@keystone.service[81625]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f1d892f6-0146-4736-bfc4-1b5e32ca7dbf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 13 13:57:56.190398 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d892f6-0146-4736-bfc4-1b5e32ca7dbf admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:57:56.200018 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1324 bytes} [Tue Sep 13 13:57:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 13:57:56.206037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413193a-1442-4ed7-861a-2d14406725e2 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:57:56.223441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413193a-1442-4ed7-861a-2d14406725e2 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:57:56.227967 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04c744-2a59-4250-ba50-5d6846628b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:57:56.229071 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04c744-2a59-4250-ba50-5d6846628b51 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:57:56.229381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04c744-2a59-4250-ba50-5d6846628b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:57:56.229654 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04c744-2a59-4250-ba50-5d6846628b51 admin admin] PATH_INFO: `/v3/projects/b2ed08b3b52d45f68ee1e0b8c4e4ceb4` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:57:56.231245 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04c744-2a59-4250-ba50-5d6846628b51 admin admin] RBAC: Authorizing `identity:get_project(project_id=b2ed08b3b52d45f68ee1e0b8c4e4ceb4)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:57:56.284581 dv-cinder-857434-1-smb devstack@keystone.service[81626]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4b04c744-2a59-4250-ba50-5d6846628b51 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 13 13:57:56.284923 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04c744-2a59-4250-ba50-5d6846628b51 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:57:56.289566 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 3/5] 10.222.0.26 () {56 vars in 1207 bytes} [Tue Sep 13 13:57:56 2022] GET /identity/v3/projects/b2ed08b3b52d45f68ee1e0b8c4e4ceb4 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:57:58.415392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29090d9c-59f4-496b-92ce-a2c95a54c149 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:57:58.415967 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29090d9c-59f4-496b-92ce-a2c95a54c149 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:57:58.415967 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29090d9c-59f4-496b-92ce-a2c95a54c149 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:57:58.420068 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 3/6] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:57:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 13:57:58.425490 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e751b07-1757-4eb0-9932-b085b6c2db32 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:57:58.425864 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e751b07-1757-4eb0-9932-b085b6c2db32 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:57:58.426036 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e751b07-1757-4eb0-9932-b085b6c2db32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:57:58.446253 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-4e751b07-1757-4eb0-9932-b085b6c2db32 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:57:58.447758 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4e751b07-1757-4eb0-9932-b085b6c2db32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:57:58.455522 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:57:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 13 13:57:58.722784 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29090d9c-59f4-496b-92ce-a2c95a54c149 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:57:58.738894 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29090d9c-59f4-496b-92ce-a2c95a54c149 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:57:58.743742 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8862b40-995f-4e6d-b9ed-f0ec5df2832a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:57:58.744504 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8862b40-995f-4e6d-b9ed-f0ec5df2832a admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:57:58.744829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8862b40-995f-4e6d-b9ed-f0ec5df2832a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:57:58.745122 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8862b40-995f-4e6d-b9ed-f0ec5df2832a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:57:58.752892 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8862b40-995f-4e6d-b9ed-f0ec5df2832a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:57:58.754703 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8862b40-995f-4e6d-b9ed-f0ec5df2832a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:57:58.763861 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1324 bytes} [Tue Sep 13 13:57:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 13:57:58.769364 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e751b07-1757-4eb0-9932-b085b6c2db32 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:57:58.778562 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e751b07-1757-4eb0-9932-b085b6c2db32 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:57:58.782963 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8022a6c-3498-44d1-86ce-7c334bf66e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:57:58.783583 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8022a6c-3498-44d1-86ce-7c334bf66e1f admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:57:58.784129 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8022a6c-3498-44d1-86ce-7c334bf66e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:57:58.784404 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8022a6c-3498-44d1-86ce-7c334bf66e1f admin admin] PATH_INFO: `/v3/users/97bb92037c8b4cdabc69372647290362` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:57:58.785755 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8022a6c-3498-44d1-86ce-7c334bf66e1f admin admin] RBAC: Authorizing `identity:get_user(user_id=97bb92037c8b4cdabc69372647290362)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:57:58.787624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8022a6c-3498-44d1-86ce-7c334bf66e1f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:57:58.789158 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 5/9] 10.222.0.26 () {56 vars in 1198 bytes} [Tue Sep 13 13:57:58 2022] GET /identity/v3/users/97bb92037c8b4cdabc69372647290362 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:00.994734 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02892014-194d-42b3-bccd-213c6680249e None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:00.995244 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02892014-194d-42b3-bccd-213c6680249e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:00.995456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02892014-194d-42b3-bccd-213c6680249e None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:00.996609 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:01.001902 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc8a85-5c00-4d0b-a64e-b4d8641b7ecf None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:01.002338 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc8a85-5c00-4d0b-a64e-b4d8641b7ecf None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:01.002483 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc8a85-5c00-4d0b-a64e-b4d8641b7ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:01.012664 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17a3b5-1328-474c-b397-0f0335dd2a57 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:01.012947 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17a3b5-1328-474c-b397-0f0335dd2a57 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:01.013256 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17a3b5-1328-474c-b397-0f0335dd2a57 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:01.014547 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 6/11] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 13:58:01.019560 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826eb4c-67a5-49ed-af03-3cc0b74ac7de None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:01.019847 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826eb4c-67a5-49ed-af03-3cc0b74ac7de None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:01.020121 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826eb4c-67a5-49ed-af03-3cc0b74ac7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:01.021270 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b7bc8a85-5c00-4d0b-a64e-b4d8641b7ecf None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:01.022455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b7bc8a85-5c00-4d0b-a64e-b4d8641b7ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:01.062638 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG passlib.handlers.bcrypt [None req-9826eb4c-67a5-49ed-af03-3cc0b74ac7de None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81625) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 13 13:58:01.063035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG passlib.handlers.bcrypt [None req-9826eb4c-67a5-49ed-af03-3cc0b74ac7de None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81625) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 13 13:58:01.102107 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:01.111883 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-9826eb4c-67a5-49ed-af03-3cc0b74ac7de None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:01.113521 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-9826eb4c-67a5-49ed-af03-3cc0b74ac7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:01.214460 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 13:58:01.365642 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc8a85-5c00-4d0b-a64e-b4d8641b7ecf None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:01.390709 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:01.470434 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc8a85-5c00-4d0b-a64e-b4d8641b7ecf None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:01.484867 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826eb4c-67a5-49ed-af03-3cc0b74ac7de None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:01.505910 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6012c-e474-4eed-8abc-b119ee89a7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:01.506550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6012c-e474-4eed-8abc-b119ee89a7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:01.506828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6012c-e474-4eed-8abc-b119ee89a7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:01.507116 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6012c-e474-4eed-8abc-b119ee89a7a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:01.519032 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6012c-e474-4eed-8abc-b119ee89a7a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:01.528455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-ace6012c-e474-4eed-8abc-b119ee89a7a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:58:01.528455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:01.528455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:01.528455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:01.528455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:01.528455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:01.528455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:01.528455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:01.528455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:01.528455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:01.528455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:01.528455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:01.528455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:01.528455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:01.528455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:01.528455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:01.529501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:01.529501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:01.529501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:01.529501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:01.529501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:01.529501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:01.529501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:01.529501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:01.529501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:01.529501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:01.529501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:01.529501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:01.529501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:01.529501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:01.529501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:01.529501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:01.530326 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:01.530326 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:01.530326 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:01.530326 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:01.530326 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:01.530326 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:01.530326 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:01.530326 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:01.530326 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:01.530326 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:01.530326 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:58:01.530326 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:58:01.530326 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 7/14] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 13:58:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:01.535712 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6012c-e474-4eed-8abc-b119ee89a7a9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:01.591873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826eb4c-67a5-49ed-af03-3cc0b74ac7de None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:01.594880 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:01.619163 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:01.631971 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb5194-34b3-431a-9cb5-0cc36892388c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:01.632840 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb5194-34b3-431a-9cb5-0cc36892388c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:01.633203 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb5194-34b3-431a-9cb5-0cc36892388c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:01.633478 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb5194-34b3-431a-9cb5-0cc36892388c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:01.639269 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6012c-e474-4eed-8abc-b119ee89a7a9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:01.673364 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fab4a6-e148-4f46-b557-4f717f21e984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:01.673964 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fab4a6-e148-4f46-b557-4f717f21e984 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:01.674242 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fab4a6-e148-4f46-b557-4f717f21e984 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:01.674514 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fab4a6-e148-4f46-b557-4f717f21e984 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:01.675179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fab4a6-e148-4f46-b557-4f717f21e984 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:01.675479 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fab4a6-e148-4f46-b557-4f717f21e984 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:01.676875 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fab4a6-e148-4f46-b557-4f717f21e984 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:01.688844 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 8/15] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:58:01.694561 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fab4a6-e148-4f46-b557-4f717f21e984 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:01.702101 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb5194-34b3-431a-9cb5-0cc36892388c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:01.704045 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb5194-34b3-431a-9cb5-0cc36892388c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:01.792605 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fab4a6-e148-4f46-b557-4f717f21e984 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:01.801461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:58:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 13:58:01.807631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb5194-34b3-431a-9cb5-0cc36892388c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:01.810451 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:01.825920 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913c081-737c-41a5-afa0-dde225555057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:01.826541 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913c081-737c-41a5-afa0-dde225555057 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:01.826812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913c081-737c-41a5-afa0-dde225555057 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:01.827078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913c081-737c-41a5-afa0-dde225555057 None admin] PATH_INFO: `/v3/users/97bb92037c8b4cdabc69372647290362` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:01.828196 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913c081-737c-41a5-afa0-dde225555057 None admin] RBAC: Authorizing `identity:get_user(user_id=97bb92037c8b4cdabc69372647290362)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:01.829680 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913c081-737c-41a5-afa0-dde225555057 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:01.831221 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 9/17] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:01 2022] GET /identity/v3/users/97bb92037c8b4cdabc69372647290362 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:58:01.837231 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913c081-737c-41a5-afa0-dde225555057 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:01.851220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:01.906247 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb5194-34b3-431a-9cb5-0cc36892388c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:01.934177 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913c081-737c-41a5-afa0-dde225555057 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:01.938956 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6b4b4-1b45-4577-8259-cfe54b4c0a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:01.939795 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6b4b4-1b45-4577-8259-cfe54b4c0a02 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:01.940069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6b4b4-1b45-4577-8259-cfe54b4c0a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:01.940335 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6b4b4-1b45-4577-8259-cfe54b4c0a02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:01.958808 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6b4b4-1b45-4577-8259-cfe54b4c0a02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:01.960258 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6b4b4-1b45-4577-8259-cfe54b4c0a02 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:01.968550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753827d3-e7ba-461a-932e-99731ec7707a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:01.969214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753827d3-e7ba-461a-932e-99731ec7707a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:01.969495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753827d3-e7ba-461a-932e-99731ec7707a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:01.969768 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753827d3-e7ba-461a-932e-99731ec7707a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:01.970888 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753827d3-e7ba-461a-932e-99731ec7707a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:01.972323 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753827d3-e7ba-461a-932e-99731ec7707a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:01.973921 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 10/18] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:58:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:58:01.978445 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-a9d6b4b4-1b45-4577-8259-cfe54b4c0a02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:58:01.978445 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:01.978445 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:01.978445 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:01.978445 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:01.978445 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:01.978445 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:01.978445 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:01.978445 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:01.978445 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:01.978445 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:01.978445 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:01.978445 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:58:01.978445 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:58:01.978445 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:58:01.978445 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:58:01.979353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:01.979353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:01.979353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:01.979353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:01.979353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:01.979353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:01.979353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:01.979353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:01.979353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:01.979353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:01.979353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:01.979353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:01.979353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:01.979353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:01.979353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:01.979353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:01.979353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:58:01.980135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:58:01.980135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:58:01.980135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:58:01.980135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 9/19] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:58:01.980346 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753827d3-e7ba-461a-932e-99731ec7707a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:01.985956 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6b4b4-1b45-4577-8259-cfe54b4c0a02 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:02.042815 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:02.066215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:02.089457 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753827d3-e7ba-461a-932e-99731ec7707a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:02.098500 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6b4b4-1b45-4577-8259-cfe54b4c0a02 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:02.122209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc84fc7-064f-4e89-99d2-fd00f6ae3108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:02.122812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc84fc7-064f-4e89-99d2-fd00f6ae3108 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:02.123091 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc84fc7-064f-4e89-99d2-fd00f6ae3108 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:02.123366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc84fc7-064f-4e89-99d2-fd00f6ae3108 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:02.124093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc84fc7-064f-4e89-99d2-fd00f6ae3108 None admin] RBAC: Adding query filter params (role.id=6dcc8495d2b24b3eab63dd656eb4eb6d, scope.domain.id=default, user.id=97bb92037c8b4cdabc69372647290362) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:02.124396 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc84fc7-064f-4e89-99d2-fd00f6ae3108 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:02.125875 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc84fc7-064f-4e89-99d2-fd00f6ae3108 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:02.132174 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763ed2f-82a4-4c2d-85a8-10d98eb2f169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:02.132548 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 11/20] 10.222.0.26 () {56 vars in 1322 bytes} [Tue Sep 13 13:58:01 2022] GET /identity/v3/role_assignments?user.id=97bb92037c8b4cdabc69372647290362&scope.domain.id=default&role.id=6dcc8495d2b24b3eab63dd656eb4eb6d => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:58:02.132778 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763ed2f-82a4-4c2d-85a8-10d98eb2f169 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:02.133602 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763ed2f-82a4-4c2d-85a8-10d98eb2f169 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:02.133877 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763ed2f-82a4-4c2d-85a8-10d98eb2f169 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:02.134527 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763ed2f-82a4-4c2d-85a8-10d98eb2f169 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:02.134832 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763ed2f-82a4-4c2d-85a8-10d98eb2f169 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:02.136248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763ed2f-82a4-4c2d-85a8-10d98eb2f169 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:02.159755 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 10/21] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:58:04.411797 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45c15d-f600-4ac0-87d5-4c95d63df7bb None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:04.412824 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45c15d-f600-4ac0-87d5-4c95d63df7bb None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:04.413327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45c15d-f600-4ac0-87d5-4c95d63df7bb None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:04.415734 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 12/22] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:04.420821 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d50765-1a0c-47c2-85ff-c6e132e39b08 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:04.421716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d50765-1a0c-47c2-85ff-c6e132e39b08 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:04.422225 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d50765-1a0c-47c2-85ff-c6e132e39b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:04.450114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-59d50765-1a0c-47c2-85ff-c6e132e39b08 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:04.451682 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-59d50765-1a0c-47c2-85ff-c6e132e39b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:04.536050 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 11/23] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:04.838194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dd36d-2798-4408-bb64-a82313e35d1d None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:04.838879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dd36d-2798-4408-bb64-a82313e35d1d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:04.839354 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dd36d-2798-4408-bb64-a82313e35d1d None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:04.841204 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:04.846823 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be0b15-c160-45a0-8bb5-a172ed44f20c None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:04.847346 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be0b15-c160-45a0-8bb5-a172ed44f20c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:04.847819 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be0b15-c160-45a0-8bb5-a172ed44f20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:04.874036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-56be0b15-c160-45a0-8bb5-a172ed44f20c None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:04.875542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-56be0b15-c160-45a0-8bb5-a172ed44f20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:04.907979 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081312c7-975b-42d8-b5ef-11fcfe26d62b None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:04.908590 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081312c7-975b-42d8-b5ef-11fcfe26d62b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:04.909353 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081312c7-975b-42d8-b5ef-11fcfe26d62b None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:04.911230 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 14/25] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:04.916318 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af564aa-10fd-4131-803d-813d8f228e14 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:04.916826 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af564aa-10fd-4131-803d-813d8f228e14 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:04.917340 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af564aa-10fd-4131-803d-813d8f228e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:04.947793 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-8af564aa-10fd-4131-803d-813d8f228e14 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:04.949361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8af564aa-10fd-4131-803d-813d8f228e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:04.961131 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:05.001531 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 12/26] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:05.002456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be0b15-c160-45a0-8bb5-a172ed44f20c None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:05.083996 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 15/27] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 13:58:05.173751 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be0b15-c160-45a0-8bb5-a172ed44f20c None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:05.219151 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0c053-af37-416e-b6b6-5c0c4bb84f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:05.219779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0c053-af37-416e-b6b6-5c0c4bb84f2f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:05.220054 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0c053-af37-416e-b6b6-5c0c4bb84f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:05.220322 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0c053-af37-416e-b6b6-5c0c4bb84f2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:05.237975 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b0c053-af37-416e-b6b6-5c0c4bb84f2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:05.245213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-04b0c053-af37-416e-b6b6-5c0c4bb84f2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:58:05.245213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:05.245213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:05.245213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:05.245213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:05.245213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:05.245213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:05.245213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:05.245213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:05.245213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:05.245213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:05.245213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:05.245213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:05.245213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:05.245213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:05.245213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:05.246053 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:05.246053 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:05.246053 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:05.246053 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:05.246053 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:05.246053 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:05.246053 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:05.246053 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:05.246053 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:05.246053 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:05.246053 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:05.246053 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:05.246053 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:05.246053 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:05.246053 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:05.246053 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:05.247241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:05.247241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:05.247241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:05.247241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:05.247241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:05.247241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:05.247241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:05.247241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:05.247241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:05.247241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:05.247241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:58:05.247241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:58:05.247241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 13/28] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 13:58:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:05.252444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af564aa-10fd-4131-803d-813d8f228e14 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:05.358432 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:05.394741 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af564aa-10fd-4131-803d-813d8f228e14 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:05.398378 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0c053-af37-416e-b6b6-5c0c4bb84f2f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:05.435766 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:05.451171 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bad881-0e6d-4967-b40b-1b30bd78b608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:05.451786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bad881-0e6d-4967-b40b-1b30bd78b608 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:05.452062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bad881-0e6d-4967-b40b-1b30bd78b608 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:05.452330 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bad881-0e6d-4967-b40b-1b30bd78b608 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:05.453117 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bad881-0e6d-4967-b40b-1b30bd78b608 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:05.453312 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bad881-0e6d-4967-b40b-1b30bd78b608 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:05.454814 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bad881-0e6d-4967-b40b-1b30bd78b608 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:05.468701 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 16/29] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:05.474704 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bad881-0e6d-4967-b40b-1b30bd78b608 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:05.509404 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0c053-af37-416e-b6b6-5c0c4bb84f2f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:05.546944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a8a18-0676-428f-a435-99957ece43a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:05.548021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a8a18-0676-428f-a435-99957ece43a4 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:05.548530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a8a18-0676-428f-a435-99957ece43a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:05.548997 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a8a18-0676-428f-a435-99957ece43a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:05.560861 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a8a18-0676-428f-a435-99957ece43a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:05.562641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a8a18-0676-428f-a435-99957ece43a4 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:05.593314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-211a8a18-0676-428f-a435-99957ece43a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:58:05.593314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:05.593314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:05.593314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:05.593314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:05.593314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:05.593314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:05.593314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:05.593314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:05.593314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:05.593314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:05.593314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:05.593314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:58:05.593314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:58:05.593314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:58:05.593314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:58:05.594206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:05.594206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:05.594206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:05.594206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:05.594206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:05.594206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:05.594206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:05.594206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:05.594206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:05.594206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:05.594206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:05.594206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:05.594206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:05.594206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:05.594206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:05.594206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:05.594206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:58:05.594998 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:58:05.594998 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:58:05.594998 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:58:05.596825 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 14/30] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:58:05.597970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a8a18-0676-428f-a435-99957ece43a4 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:05.656172 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bad881-0e6d-4967-b40b-1b30bd78b608 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:05.719537 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:05.726074 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a8a18-0676-428f-a435-99957ece43a4 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:05.740753 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581aa3d-687c-44c5-bde2-1d1230ec0fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:05.741801 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581aa3d-687c-44c5-bde2-1d1230ec0fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:05.742363 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581aa3d-687c-44c5-bde2-1d1230ec0fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:05.742883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581aa3d-687c-44c5-bde2-1d1230ec0fa8 None admin] PATH_INFO: `/v3/users/97bb92037c8b4cdabc69372647290362` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:05.744391 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9581aa3d-687c-44c5-bde2-1d1230ec0fa8 None admin] RBAC: Authorizing `identity:get_user(user_id=97bb92037c8b4cdabc69372647290362)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:05.746089 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9581aa3d-687c-44c5-bde2-1d1230ec0fa8 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:05.751046 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 17/31] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:05 2022] GET /identity/v3/users/97bb92037c8b4cdabc69372647290362 => generated 247 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:05.753912 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581aa3d-687c-44c5-bde2-1d1230ec0fa8 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:05.763423 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:05.800038 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37faef1e-8bde-4f5f-95b2-52fdabf6c9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:05.801068 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37faef1e-8bde-4f5f-95b2-52fdabf6c9ba None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:05.801585 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37faef1e-8bde-4f5f-95b2-52fdabf6c9ba None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:05.802082 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37faef1e-8bde-4f5f-95b2-52fdabf6c9ba None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:05.802994 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37faef1e-8bde-4f5f-95b2-52fdabf6c9ba None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:05.808810 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37faef1e-8bde-4f5f-95b2-52fdabf6c9ba None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:05.891883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581aa3d-687c-44c5-bde2-1d1230ec0fa8 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:05.928769 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bcc79-7886-4f0b-8cbc-7626249e1b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:05.929458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bcc79-7886-4f0b-8cbc-7626249e1b44 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:05.929877 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bcc79-7886-4f0b-8cbc-7626249e1b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:05.930156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bcc79-7886-4f0b-8cbc-7626249e1b44 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:05.930915 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bcc79-7886-4f0b-8cbc-7626249e1b44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:05.931224 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bcc79-7886-4f0b-8cbc-7626249e1b44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:05.932612 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bcc79-7886-4f0b-8cbc-7626249e1b44 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:05.948154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 15/32] 10.222.0.26 () {60 vars in 1131 bytes} [Tue Sep 13 13:58:05 2022] POST /identity/v3/roles => generated 219 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 13:58:05.949287 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37faef1e-8bde-4f5f-95b2-52fdabf6c9ba None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:05.959519 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 18/33] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:05.960836 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca0f95-d254-4131-9011-55a4dec89df0 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:05.961180 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca0f95-d254-4131-9011-55a4dec89df0 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:05.961457 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca0f95-d254-4131-9011-55a4dec89df0 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:05.962929 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 19/34] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:05.967953 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca0f95-d254-4131-9011-55a4dec89df0 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:06.074484 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37faef1e-8bde-4f5f-95b2-52fdabf6c9ba None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:06.101524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:06.160214 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d8818-eb7d-49bd-9ab2-1fe671d8a126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:06.160877 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d8818-eb7d-49bd-9ab2-1fe671d8a126 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:06.161263 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d8818-eb7d-49bd-9ab2-1fe671d8a126 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:06.161454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d8818-eb7d-49bd-9ab2-1fe671d8a126 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:06.164609 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d8818-eb7d-49bd-9ab2-1fe671d8a126 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:06.169014 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d8818-eb7d-49bd-9ab2-1fe671d8a126 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:06.172191 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 16/35] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:58:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:06.173617 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2008dd-5410-4ac7-b2b5-8343c71cebeb None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:06.173904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2008dd-5410-4ac7-b2b5-8343c71cebeb None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:06.174175 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2008dd-5410-4ac7-b2b5-8343c71cebeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:06.196678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-ec2008dd-5410-4ac7-b2b5-8343c71cebeb None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:06.197863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca0f95-d254-4131-9011-55a4dec89df0 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:06.198517 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ec2008dd-5410-4ac7-b2b5-8343c71cebeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:06.212282 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:06.256018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5e5da-1952-4d98-aeab-cc6aa511b4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:06.256645 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5e5da-1952-4d98-aeab-cc6aa511b4e2 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:06.256923 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5e5da-1952-4d98-aeab-cc6aa511b4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:06.257223 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5e5da-1952-4d98-aeab-cc6aa511b4e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:06.257955 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5e5da-1952-4d98-aeab-cc6aa511b4e2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:06.259441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5e5da-1952-4d98-aeab-cc6aa511b4e2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:06.298712 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 17/36] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:06.299589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2008dd-5410-4ac7-b2b5-8343c71cebeb None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:06.442978 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 20/37] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Sep 13 13:58:05 2022] POST /identity/v3/projects => generated 301 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 13:58:06.444413 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86e161-3056-4df8-ad54-eeee313ae079 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:06.444706 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86e161-3056-4df8-ad54-eeee313ae079 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:06.445678 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86e161-3056-4df8-ad54-eeee313ae079 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:06.447256 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 21/38] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:06.452793 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcf892-63eb-40b0-86c5-bc8392654555 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:06.453450 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcf892-63eb-40b0-86c5-bc8392654555 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:06.453450 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcf892-63eb-40b0-86c5-bc8392654555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:06.457758 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2008dd-5410-4ac7-b2b5-8343c71cebeb None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:06.475294 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-0fbcf892-63eb-40b0-86c5-bc8392654555 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:06.477657 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0fbcf892-63eb-40b0-86c5-bc8392654555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:06.503290 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72904da-18a2-45f2-8d2a-f9b581a6d93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:06.503963 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72904da-18a2-45f2-8d2a-f9b581a6d93c None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:06.504243 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72904da-18a2-45f2-8d2a-f9b581a6d93c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:06.504524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72904da-18a2-45f2-8d2a-f9b581a6d93c None admin] PATH_INFO: `/v3/domains/default/users/97bb92037c8b4cdabc69372647290362/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:06.508170 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72904da-18a2-45f2-8d2a-f9b581a6d93c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=97bb92037c8b4cdabc69372647290362, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:06.510051 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72904da-18a2-45f2-8d2a-f9b581a6d93c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:06.543945 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 18/39] 10.222.0.26 () {58 vars in 1361 bytes} [Tue Sep 13 13:58:06 2022] PUT /identity/v3/domains/default/users/97bb92037c8b4cdabc69372647290362/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 13:58:06.552670 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4c1f4-90d9-4482-895d-1977cb456f7a None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:06.552971 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4c1f4-90d9-4482-895d-1977cb456f7a None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:06.553258 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4c1f4-90d9-4482-895d-1977cb456f7a None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:06.554753 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 19/40] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 13:58:06.563187 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d0999-fcf5-48e2-b7ff-6bbe6df86e7b None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:06.563629 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d0999-fcf5-48e2-b7ff-6bbe6df86e7b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:06.564016 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d0999-fcf5-48e2-b7ff-6bbe6df86e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:06.593580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:06.610382 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-894d0999-fcf5-48e2-b7ff-6bbe6df86e7b None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:06.611668 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-894d0999-fcf5-48e2-b7ff-6bbe6df86e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:06.698015 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 22/41] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 13:58:06.718034 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbcf892-63eb-40b0-86c5-bc8392654555 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:06.753171 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 20/42] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 13:58:06.789372 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:06.853168 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbcf892-63eb-40b0-86c5-bc8392654555 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:06.891866 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d89528-13ee-479a-acb5-c33069fd3523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:06.892551 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d89528-13ee-479a-acb5-c33069fd3523 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:06.892837 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d89528-13ee-479a-acb5-c33069fd3523 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:06.893131 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d89528-13ee-479a-acb5-c33069fd3523 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:06.893832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d89528-13ee-479a-acb5-c33069fd3523 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:06.895447 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d89528-13ee-479a-acb5-c33069fd3523 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:06.921271 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 23/43] 10.222.0.26 () {60 vars in 1131 bytes} [Tue Sep 13 13:58:06 2022] POST /identity/v3/roles => generated 225 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 13:58:06.999376 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d0999-fcf5-48e2-b7ff-6bbe6df86e7b None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:07.050892 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d89528-13ee-479a-acb5-c33069fd3523 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:07.119404 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d0999-fcf5-48e2-b7ff-6bbe6df86e7b None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:07.167499 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb00beb-0ed9-447d-affd-43d364a1993a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:07.168319 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb00beb-0ed9-447d-affd-43d364a1993a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:07.168607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb00beb-0ed9-447d-affd-43d364a1993a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:07.168882 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb00beb-0ed9-447d-affd-43d364a1993a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:07.170418 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb00beb-0ed9-447d-affd-43d364a1993a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:07.171896 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb00beb-0ed9-447d-affd-43d364a1993a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:07.173515 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 21/44] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:58:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:07.182208 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb00beb-0ed9-447d-affd-43d364a1993a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:07.182501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d89528-13ee-479a-acb5-c33069fd3523 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:07.186029 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:07.195766 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:07.228317 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668fe97-9770-41f3-be22-5a96cd01ae50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:07.228945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668fe97-9770-41f3-be22-5a96cd01ae50 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:07.229259 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668fe97-9770-41f3-be22-5a96cd01ae50 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:07.230011 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668fe97-9770-41f3-be22-5a96cd01ae50 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:07.230715 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668fe97-9770-41f3-be22-5a96cd01ae50 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:07.232507 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668fe97-9770-41f3-be22-5a96cd01ae50 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:07.252503 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 24/45] 10.222.0.26 () {60 vars in 1131 bytes} [Tue Sep 13 13:58:07 2022] POST /identity/v3/roles => generated 223 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 13:58:07.300299 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb00beb-0ed9-447d-affd-43d364a1993a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:07.339312 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3ba98-cc01-4619-9a96-a8c72f944ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:07.340361 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3ba98-cc01-4619-9a96-a8c72f944ce4 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:07.340887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3ba98-cc01-4619-9a96-a8c72f944ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:07.341416 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3ba98-cc01-4619-9a96-a8c72f944ce4 None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:07.342328 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3ba98-cc01-4619-9a96-a8c72f944ce4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:07.344030 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3ba98-cc01-4619-9a96-a8c72f944ce4 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:07.377012 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 22/46] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Sep 13 13:58:07 2022] POST /identity/v3/projects => generated 312 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 13:58:08.848813 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2b1d2-9803-47f7-9aa4-80f8dd71c02b None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:08.849374 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2b1d2-9803-47f7-9aa4-80f8dd71c02b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:08.849464 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2b1d2-9803-47f7-9aa4-80f8dd71c02b None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:08.850756 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 25/47] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:08.855946 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4634d-8901-415b-a40d-5288517dedcf None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:08.856351 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4634d-8901-415b-a40d-5288517dedcf None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:08.856615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4634d-8901-415b-a40d-5288517dedcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:08.874427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-0ab4634d-8901-415b-a40d-5288517dedcf None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:08.875608 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0ab4634d-8901-415b-a40d-5288517dedcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:08.924934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:08.941626 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 23/48] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:09.208243 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2b1d2-9803-47f7-9aa4-80f8dd71c02b None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:09.311534 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2b1d2-9803-47f7-9aa4-80f8dd71c02b None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:09.345195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cdb915-9831-40df-95e9-bbd94d788d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:09.345826 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdb915-9831-40df-95e9-bbd94d788d69 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:09.346111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdb915-9831-40df-95e9-bbd94d788d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:09.346390 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdb915-9831-40df-95e9-bbd94d788d69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:09.356906 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cdb915-9831-40df-95e9-bbd94d788d69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:09.361834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-22cdb915-9831-40df-95e9-bbd94d788d69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:58:09.361834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:09.361834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:09.361834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:09.361834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:09.361834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:09.361834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:09.361834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:09.361834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:09.361834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:09.361834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:09.361834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:09.361834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:09.361834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:09.361834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:09.361834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:09.362785 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:09.362785 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:09.362785 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:09.362785 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:09.362785 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:09.362785 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:09.362785 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:09.362785 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:09.362785 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:09.362785 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:09.362785 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:09.362785 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:09.362785 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:09.362785 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:09.362785 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:09.362785 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:09.363683 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:09.363683 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:09.363683 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:09.363683 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:09.363683 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:09.363683 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:09.363683 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:09.363683 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:09.363683 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:09.363683 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:09.363683 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:58:09.363683 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:58:09.363683 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 26/49] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 13:58:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:09.368785 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4634d-8901-415b-a40d-5288517dedcf None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:09.470269 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4634d-8901-415b-a40d-5288517dedcf None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:09.547814 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa55737-7502-44a1-9a57-4b2de051d154 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:09.548094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa55737-7502-44a1-9a57-4b2de051d154 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:09.548370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa55737-7502-44a1-9a57-4b2de051d154 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:09.549801 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 27/50] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 13:58:09.556119 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77b7fa-b426-4b7b-8df0-61e7c50bd8c4 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:09.556403 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77b7fa-b426-4b7b-8df0-61e7c50bd8c4 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:09.556673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77b7fa-b426-4b7b-8df0-61e7c50bd8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:09.575204 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-2c77b7fa-b426-4b7b-8df0-61e7c50bd8c4 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:09.576440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2c77b7fa-b426-4b7b-8df0-61e7c50bd8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:09.597318 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:09.607607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b6b7f-3c6e-4c9a-a470-8759716e40fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:09.608210 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b6b7f-3c6e-4c9a-a470-8759716e40fe None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:09.608488 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b6b7f-3c6e-4c9a-a470-8759716e40fe None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:09.608752 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b6b7f-3c6e-4c9a-a470-8759716e40fe None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:09.609445 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b6b7f-3c6e-4c9a-a470-8759716e40fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:09.609742 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b6b7f-3c6e-4c9a-a470-8759716e40fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:09.611106 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b6b7f-3c6e-4c9a-a470-8759716e40fe None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:09.626536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 24/51] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:09.632092 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b6b7f-3c6e-4c9a-a470-8759716e40fe None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:09.646659 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 28/52] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 13:58:09.680316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:09.728734 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b6b7f-3c6e-4c9a-a470-8759716e40fe None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:09.761319 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3dafe-01d3-4f54-bd90-ca6e17877031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:09.761942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3dafe-01d3-4f54-bd90-ca6e17877031 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:09.762223 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3dafe-01d3-4f54-bd90-ca6e17877031 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:09.762495 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3dafe-01d3-4f54-bd90-ca6e17877031 None admin] PATH_INFO: `/v3/users/97bb92037c8b4cdabc69372647290362` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:09.763630 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3dafe-01d3-4f54-bd90-ca6e17877031 None admin] RBAC: Authorizing `identity:get_user(user_id=97bb92037c8b4cdabc69372647290362)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:09.765078 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3dafe-01d3-4f54-bd90-ca6e17877031 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:09.766685 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 25/53] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:09 2022] GET /identity/v3/users/97bb92037c8b4cdabc69372647290362 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:58:09.772247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77b7fa-b426-4b7b-8df0-61e7c50bd8c4 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:09.881695 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77b7fa-b426-4b7b-8df0-61e7c50bd8c4 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:09.913116 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3dafe-01d3-4f54-bd90-ca6e17877031 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:09.916857 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ed0ff-18e4-4778-b4cc-8787a91df3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:09.917530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ed0ff-18e4-4778-b4cc-8787a91df3fb None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:09.917818 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ed0ff-18e4-4778-b4cc-8787a91df3fb None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:09.918093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ed0ff-18e4-4778-b4cc-8787a91df3fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:09.919210 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ed0ff-18e4-4778-b4cc-8787a91df3fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:09.920698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ed0ff-18e4-4778-b4cc-8787a91df3fb None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:09.922473 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 29/54] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:58:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:09.927896 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ed0ff-18e4-4778-b4cc-8787a91df3fb None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:09.953451 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:10.014962 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3dafe-01d3-4f54-bd90-ca6e17877031 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:10.027222 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ed0ff-18e4-4778-b4cc-8787a91df3fb None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:10.031129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:10.050797 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd9bfa-0dd7-4028-a2cf-f882f81b63ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:10.051425 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd9bfa-0dd7-4028-a2cf-f882f81b63ce None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:10.051706 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd9bfa-0dd7-4028-a2cf-f882f81b63ce None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:10.051981 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd9bfa-0dd7-4028-a2cf-f882f81b63ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:10.053088 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd9bfa-0dd7-4028-a2cf-f882f81b63ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:10.055080 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd9bfa-0dd7-4028-a2cf-f882f81b63ce None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:10.056657 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 26/55] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:58:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:58:10.061008 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21d9dd-4c0a-4e94-b4af-edc91b03a44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:10.061655 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21d9dd-4c0a-4e94-b4af-edc91b03a44e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:10.061937 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21d9dd-4c0a-4e94-b4af-edc91b03a44e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:10.062212 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21d9dd-4c0a-4e94-b4af-edc91b03a44e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:10.062314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd9bfa-0dd7-4028-a2cf-f882f81b63ce None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:10.062949 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd21d9dd-4c0a-4e94-b4af-edc91b03a44e None admin] RBAC: Adding query filter params (role.id=6dcc8495d2b24b3eab63dd656eb4eb6d, scope.domain.id=default, user.id=97bb92037c8b4cdabc69372647290362) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:10.063258 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd21d9dd-4c0a-4e94-b4af-edc91b03a44e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:10.064708 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd21d9dd-4c0a-4e94-b4af-edc91b03a44e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:10.071294 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 30/56] 10.222.0.26 () {56 vars in 1322 bytes} [Tue Sep 13 13:58:09 2022] GET /identity/v3/role_assignments?user.id=97bb92037c8b4cdabc69372647290362&scope.domain.id=default&role.id=6dcc8495d2b24b3eab63dd656eb4eb6d => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:58:10.166340 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd9bfa-0dd7-4028-a2cf-f882f81b63ce None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:10.209071 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd356b2f-70e4-4718-be6a-83e41bb2a1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:10.209715 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd356b2f-70e4-4718-be6a-83e41bb2a1c2 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:10.209997 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd356b2f-70e4-4718-be6a-83e41bb2a1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:10.210270 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd356b2f-70e4-4718-be6a-83e41bb2a1c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:10.210966 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd356b2f-70e4-4718-be6a-83e41bb2a1c2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:10.212459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd356b2f-70e4-4718-be6a-83e41bb2a1c2 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:10.239963 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 27/57] 10.222.0.26 () {60 vars in 1140 bytes} [Tue Sep 13 13:58:10 2022] POST /identity/v3/projects => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 13:58:12.381090 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524818a5-3fd4-4131-9b4f-dcc19270085c None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:12.381615 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524818a5-3fd4-4131-9b4f-dcc19270085c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:12.381697 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524818a5-3fd4-4131-9b4f-dcc19270085c None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:12.383574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 31/58] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:12.388778 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915cafe-5d31-420b-9e5b-bc1430a427b9 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:12.389236 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915cafe-5d31-420b-9e5b-bc1430a427b9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:12.389355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915cafe-5d31-420b-9e5b-bc1430a427b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:12.407601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-1915cafe-5d31-420b-9e5b-bc1430a427b9 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:12.409030 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1915cafe-5d31-420b-9e5b-bc1430a427b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:12.436424 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:12.474488 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 28/59] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:12.743585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524818a5-3fd4-4131-9b4f-dcc19270085c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:12.834095 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:12.848535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524818a5-3fd4-4131-9b4f-dcc19270085c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:12.883008 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c162453-7209-4429-a158-cf6036aa97a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:12.883663 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c162453-7209-4429-a158-cf6036aa97a8 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:12.883948 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c162453-7209-4429-a158-cf6036aa97a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:12.884220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c162453-7209-4429-a158-cf6036aa97a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:12.885390 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c162453-7209-4429-a158-cf6036aa97a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:12.886864 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c162453-7209-4429-a158-cf6036aa97a8 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:12.888457 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 32/60] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:58:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:12.894031 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915cafe-5d31-420b-9e5b-bc1430a427b9 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:12.990029 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915cafe-5d31-420b-9e5b-bc1430a427b9 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:13.024086 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c8451-d040-42dc-951d-4bc31db2963b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:13.024621 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c8451-d040-42dc-951d-4bc31db2963b None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:13.024902 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c8451-d040-42dc-951d-4bc31db2963b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:13.025202 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c8451-d040-42dc-951d-4bc31db2963b None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:13.025850 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c8451-d040-42dc-951d-4bc31db2963b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:13.027298 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c8451-d040-42dc-951d-4bc31db2963b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:13.052923 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 29/61] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 13 13:58:12 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 13:58:16.281921 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222e9f5-10b1-4c4c-89c7-0a834430e453 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:16.282948 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222e9f5-10b1-4c4c-89c7-0a834430e453 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:16.283436 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222e9f5-10b1-4c4c-89c7-0a834430e453 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:16.285397 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 33/62] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:16.291280 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f4267-1e33-4f66-9b0b-a7e90d8ecea1 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:16.292090 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f4267-1e33-4f66-9b0b-a7e90d8ecea1 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:16.292560 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f4267-1e33-4f66-9b0b-a7e90d8ecea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:16.317622 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-6a2f4267-1e33-4f66-9b0b-a7e90d8ecea1 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:16.319241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-6a2f4267-1e33-4f66-9b0b-a7e90d8ecea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:16.349751 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:16.419927 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 30/63] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:16.466330 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c61207-e967-4942-aaa1-418eb151756b None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:16.466938 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c61207-e967-4942-aaa1-418eb151756b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:16.467405 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c61207-e967-4942-aaa1-418eb151756b None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:16.469270 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 34/64] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:16.474802 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17945a38-440d-4d1d-8b72-2c341703dbbe None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:16.475330 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17945a38-440d-4d1d-8b72-2c341703dbbe None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:16.475801 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17945a38-440d-4d1d-8b72-2c341703dbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:16.503720 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-17945a38-440d-4d1d-8b72-2c341703dbbe None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:16.505373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-17945a38-440d-4d1d-8b72-2c341703dbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:16.599627 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 31/65] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:16.642046 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e47f0-c76c-4431-a8c5-1b509b94d732 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:16.642641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e47f0-c76c-4431-a8c5-1b509b94d732 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:16.643154 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e47f0-c76c-4431-a8c5-1b509b94d732 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:16.644706 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 35/66] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:16.650566 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7501e1-2c30-4ebe-bd3c-6037d6e1d2c6 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:16.651067 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7501e1-2c30-4ebe-bd3c-6037d6e1d2c6 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:16.651533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7501e1-2c30-4ebe-bd3c-6037d6e1d2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:16.676687 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-9e7501e1-2c30-4ebe-bd3c-6037d6e1d2c6 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:16.678218 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-9e7501e1-2c30-4ebe-bd3c-6037d6e1d2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:16.779871 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 32/67] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:16.822108 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1faff-e239-4591-b8ae-e34c808f56ba None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:16.822714 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1faff-e239-4591-b8ae-e34c808f56ba None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:16.823184 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1faff-e239-4591-b8ae-e34c808f56ba None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:16.824777 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 36/68] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:16.829948 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957624b0-3146-419c-b026-d7bf4e965d18 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:16.830441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957624b0-3146-419c-b026-d7bf4e965d18 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:16.830913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957624b0-3146-419c-b026-d7bf4e965d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:16.853156 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-957624b0-3146-419c-b026-d7bf4e965d18 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:16.854652 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-957624b0-3146-419c-b026-d7bf4e965d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:16.867285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:16.946277 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1faff-e239-4591-b8ae-e34c808f56ba None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:16.954431 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 33/69] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:16.968664 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957624b0-3146-419c-b026-d7bf4e965d18 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:17.075527 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957624b0-3146-419c-b026-d7bf4e965d18 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:17.099071 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1faff-e239-4591-b8ae-e34c808f56ba None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:17.113597 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4c60b-914c-492b-ad5b-f82be6cc470c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:17.114165 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4c60b-914c-492b-ad5b-f82be6cc470c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:17.114451 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4c60b-914c-492b-ad5b-f82be6cc470c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:17.114723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4c60b-914c-492b-ad5b-f82be6cc470c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:17.126430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4c60b-914c-492b-ad5b-f82be6cc470c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:17.131350 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-c2b4c60b-914c-492b-ad5b-f82be6cc470c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:58:17.131350 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:17.131350 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:17.131350 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:17.131350 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:17.131350 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:17.131350 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:17.131350 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:17.131350 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:17.131350 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:17.131350 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:17.131350 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:17.131350 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:17.131350 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:17.131350 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:17.131350 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:17.132211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:17.132211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:17.132211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:17.132211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:17.132211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:17.132211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:17.132211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:17.132211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:17.132211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:17.132211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:17.132211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:17.132211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:17.132211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:17.132211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:17.132211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:17.132211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:17.132993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:17.132993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:17.132993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:17.132993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:17.132993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:17.132993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:17.132993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:17.132993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:17.132993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:17.132993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:17.132993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:58:17.132993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:58:17.132993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 34/70] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 13:58:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:17.138051 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4c60b-914c-492b-ad5b-f82be6cc470c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:17.140786 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:17.142825 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae5e90-6166-4fc6-be51-37ac9eba2634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:17.143577 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae5e90-6166-4fc6-be51-37ac9eba2634 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:17.143887 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae5e90-6166-4fc6-be51-37ac9eba2634 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:17.144218 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae5e90-6166-4fc6-be51-37ac9eba2634 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:17.155871 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae5e90-6166-4fc6-be51-37ac9eba2634 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:17.164004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-bcae5e90-6166-4fc6-be51-37ac9eba2634 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:58:17.164004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:17.164004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:17.164004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:17.164004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:17.164004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:17.164004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:17.164004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:17.164004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:17.164004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:17.164004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:17.164004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:17.164004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:17.164004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:17.164004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:17.164004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:17.165017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:17.165017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:17.165017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:17.165017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:17.165017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:17.165017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:17.165017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:17.165017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:17.165017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:17.165017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:17.165017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:17.165017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:17.165017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:17.165017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:17.165017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:17.165017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:17.165838 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:17.165838 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:17.165838 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:17.165838 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:17.165838 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:17.165838 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:17.165838 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:17.165838 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:17.165838 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:17.165838 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:17.165838 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:58:17.165838 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:58:17.169227 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 37/71] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:17.171650 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9c927-9399-444c-8d22-ddaa919043c5 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:17.172111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9c927-9399-444c-8d22-ddaa919043c5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:17.172802 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9c927-9399-444c-8d22-ddaa919043c5 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:17.174974 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 38/72] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:17.175900 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9c927-9399-444c-8d22-ddaa919043c5 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:17.200040 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:17.250339 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4c60b-914c-492b-ad5b-f82be6cc470c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:17.285362 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9300d-04fb-4967-8444-5ea4e4563b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:17.285986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9300d-04fb-4967-8444-5ea4e4563b22 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:17.286267 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9300d-04fb-4967-8444-5ea4e4563b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:17.286539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9300d-04fb-4967-8444-5ea4e4563b22 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:17.291127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9c927-9399-444c-8d22-ddaa919043c5 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:17.297236 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9300d-04fb-4967-8444-5ea4e4563b22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:17.302035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-e4a9300d-04fb-4967-8444-5ea4e4563b22 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 13:58:17.302035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:17.302035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:17.302035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:17.302035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:17.302035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:17.302035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:17.302035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:17.302035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:17.302035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:17.302035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:17.302035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:17.302035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:17.302035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:17.302035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:17.302035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:17.303025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:17.303025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:17.303025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:17.303025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:17.303025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:17.303025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:17.303025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:17.303025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:17.303025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:17.303025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:17.303025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:17.303025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:17.303025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:17.303025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:17.303025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:17.303025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:17.303873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:17.303873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:17.303873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:17.303873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:17.303873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:17.303873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:17.303873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:17.303873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:17.303873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:17.303873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:17.303873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 13:58:17.303873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:58:17.303873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 35/73] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 13 13:58:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:17.304662 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9300d-04fb-4967-8444-5ea4e4563b22 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:17.328762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6b6b0-e8e6-447e-add9-5553362c4ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:17.329404 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6b6b0-e8e6-447e-add9-5553362c4ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:17.329689 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6b6b0-e8e6-447e-add9-5553362c4ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:17.329964 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6b6b0-e8e6-447e-add9-5553362c4ff6 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:17.330634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6b6b0-e8e6-447e-add9-5553362c4ff6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:17.330941 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6b6b0-e8e6-447e-add9-5553362c4ff6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:17.332349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6b6b0-e8e6-447e-add9-5553362c4ff6 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:17.341034 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 39/74] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:17.342385 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3e6ac-7983-4d9c-8a18-fdb646421943 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:17.342675 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3e6ac-7983-4d9c-8a18-fdb646421943 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:17.342953 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3e6ac-7983-4d9c-8a18-fdb646421943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:17.360803 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-7ad3e6ac-7983-4d9c-8a18-fdb646421943 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:17.362029 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7ad3e6ac-7983-4d9c-8a18-fdb646421943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:17.367513 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:17.406642 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9300d-04fb-4967-8444-5ea4e4563b22 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:17.430379 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 40/75] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:17.431206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3e6ac-7983-4d9c-8a18-fdb646421943 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:17.447652 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:17.456270 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e50a27-fbab-4813-842b-3eb2df712577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:17.456996 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e50a27-fbab-4813-842b-3eb2df712577 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:17.457371 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e50a27-fbab-4813-842b-3eb2df712577 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:17.457715 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e50a27-fbab-4813-842b-3eb2df712577 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:17.458456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e50a27-fbab-4813-842b-3eb2df712577 None admin] RBAC: Adding query filter params (name=member) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:17.458846 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e50a27-fbab-4813-842b-3eb2df712577 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:17.460836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e50a27-fbab-4813-842b-3eb2df712577 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:17.474490 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 36/76] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 13 13:58:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:17.475313 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e50a27-fbab-4813-842b-3eb2df712577 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:17.544062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3e6ac-7983-4d9c-8a18-fdb646421943 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:17.579804 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4540d7-3920-4343-aaa3-1e05f5cfad60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:17.580430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4540d7-3920-4343-aaa3-1e05f5cfad60 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:17.580711 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4540d7-3920-4343-aaa3-1e05f5cfad60 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:17.580981 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4540d7-3920-4343-aaa3-1e05f5cfad60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:17.582167 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4540d7-3920-4343-aaa3-1e05f5cfad60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:17.583625 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4540d7-3920-4343-aaa3-1e05f5cfad60 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:17.584944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e50a27-fbab-4813-842b-3eb2df712577 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:17.585199 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 41/77] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:58:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:17.586492 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4540d7-3920-4343-aaa3-1e05f5cfad60 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:17.619905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:17.634303 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc2ca9-8af3-44cb-b787-75bbbc238f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:17.634912 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc2ca9-8af3-44cb-b787-75bbbc238f81 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:17.635188 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc2ca9-8af3-44cb-b787-75bbbc238f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:17.635663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc2ca9-8af3-44cb-b787-75bbbc238f81 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:17.636121 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc2ca9-8af3-44cb-b787-75bbbc238f81 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:17.636419 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc2ca9-8af3-44cb-b787-75bbbc238f81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:17.637808 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc2ca9-8af3-44cb-b787-75bbbc238f81 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:17.646281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 37/78] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:58:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:17.647063 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc2ca9-8af3-44cb-b787-75bbbc238f81 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:17.681737 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:17.705568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4540d7-3920-4343-aaa3-1e05f5cfad60 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:17.738785 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7509c-5fe1-4a2e-949a-c3f218ddad82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:17.739413 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7509c-5fe1-4a2e-949a-c3f218ddad82 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:17.739692 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7509c-5fe1-4a2e-949a-c3f218ddad82 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:17.739963 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7509c-5fe1-4a2e-949a-c3f218ddad82 None admin] PATH_INFO: `/v3/users/97bb92037c8b4cdabc69372647290362` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:17.741086 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7509c-5fe1-4a2e-949a-c3f218ddad82 None admin] RBAC: Authorizing `identity:get_user(user_id=97bb92037c8b4cdabc69372647290362)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:17.743218 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7509c-5fe1-4a2e-949a-c3f218ddad82 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:17.744981 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 42/79] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:17 2022] GET /identity/v3/users/97bb92037c8b4cdabc69372647290362 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:17.745672 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7509c-5fe1-4a2e-949a-c3f218ddad82 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:17.758970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc2ca9-8af3-44cb-b787-75bbbc238f81 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:17.793179 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6723a93-1bbf-4984-bd12-ba9687c77dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:17.793960 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6723a93-1bbf-4984-bd12-ba9687c77dbd None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:17.794548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6723a93-1bbf-4984-bd12-ba9687c77dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:17.794827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6723a93-1bbf-4984-bd12-ba9687c77dbd None admin] PATH_INFO: `/v3/users/c34f788e4ffe4f7aad092b4dfbe64357` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:17.810283 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6723a93-1bbf-4984-bd12-ba9687c77dbd None admin] RBAC: Authorizing `identity:get_user(user_id=c34f788e4ffe4f7aad092b4dfbe64357)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:17.811758 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6723a93-1bbf-4984-bd12-ba9687c77dbd None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:17.813444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 38/80] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:17 2022] GET /identity/v3/users/c34f788e4ffe4f7aad092b4dfbe64357 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:17.814213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6723a93-1bbf-4984-bd12-ba9687c77dbd None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:17.844064 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7509c-5fe1-4a2e-949a-c3f218ddad82 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:17.860943 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:17.877467 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67457c8-3d20-48c0-b185-77b5b33bd060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:17.878017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67457c8-3d20-48c0-b185-77b5b33bd060 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:17.878299 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67457c8-3d20-48c0-b185-77b5b33bd060 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:17.878578 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67457c8-3d20-48c0-b185-77b5b33bd060 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:17.879225 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67457c8-3d20-48c0-b185-77b5b33bd060 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:17.880707 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67457c8-3d20-48c0-b185-77b5b33bd060 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:17.903733 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:17.917487 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 43/81] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 13 13:58:17 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 13:58:17.917679 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6723a93-1bbf-4984-bd12-ba9687c77dbd None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:17.918376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67457c8-3d20-48c0-b185-77b5b33bd060 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:17.957708 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16333e4a-c4dd-42d7-af93-3f7c71283710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:17.958354 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16333e4a-c4dd-42d7-af93-3f7c71283710 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:17.958638 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16333e4a-c4dd-42d7-af93-3f7c71283710 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:17.958912 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16333e4a-c4dd-42d7-af93-3f7c71283710 None admin] PATH_INFO: `/v3/users/c34f788e4ffe4f7aad092b4dfbe64357` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:17.960118 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16333e4a-c4dd-42d7-af93-3f7c71283710 None admin] RBAC: Authorizing `identity:get_user(user_id=c34f788e4ffe4f7aad092b4dfbe64357)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:17.962266 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16333e4a-c4dd-42d7-af93-3f7c71283710 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:17.963996 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 39/82] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:17 2022] GET /identity/v3/users/c34f788e4ffe4f7aad092b4dfbe64357 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:17.969570 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16333e4a-c4dd-42d7-af93-3f7c71283710 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:18.035070 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67457c8-3d20-48c0-b185-77b5b33bd060 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:18.075201 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620fd5d-c885-43ba-8d8b-d7bdc26f4b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:18.076010 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620fd5d-c885-43ba-8d8b-d7bdc26f4b43 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:18.076292 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620fd5d-c885-43ba-8d8b-d7bdc26f4b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:18.076910 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620fd5d-c885-43ba-8d8b-d7bdc26f4b43 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:18.086738 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16333e4a-c4dd-42d7-af93-3f7c71283710 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:18.091556 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620fd5d-c885-43ba-8d8b-d7bdc26f4b43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:18.096591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-6620fd5d-c885-43ba-8d8b-d7bdc26f4b43 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:58:18.096591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:18.096591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:18.096591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:18.096591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:18.096591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:18.096591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:18.096591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:18.096591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:18.096591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:18.096591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:18.096591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:18.096591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:18.096591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:18.096591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:18.096591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:18.097646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:18.097646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:18.097646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:18.097646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:18.097646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:18.097646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:18.097646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:18.097646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:18.097646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:18.097646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:18.097646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:18.097646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:18.097646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:18.097646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:18.097646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:18.097646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:18.098571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:18.098571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:18.098571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:18.098571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:18.098571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:18.098571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:18.098571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:18.098571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:18.098571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:18.098571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:18.098571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:58:18.098571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:58:18.098571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 44/83] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:18.099346 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620fd5d-c885-43ba-8d8b-d7bdc26f4b43 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:18.103688 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:18.132849 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26ccc0-6ebf-4ae1-9386-67f96858941c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:18.133425 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26ccc0-6ebf-4ae1-9386-67f96858941c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:18.133712 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26ccc0-6ebf-4ae1-9386-67f96858941c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:18.134044 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26ccc0-6ebf-4ae1-9386-67f96858941c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:18.172904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:18.219563 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26ccc0-6ebf-4ae1-9386-67f96858941c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:18.220949 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26ccc0-6ebf-4ae1-9386-67f96858941c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:18.226140 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620fd5d-c885-43ba-8d8b-d7bdc26f4b43 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:18.265619 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ee996-7135-42ff-9574-4447b849bf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:18.266242 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ee996-7135-42ff-9574-4447b849bf02 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:18.266646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ee996-7135-42ff-9574-4447b849bf02 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:18.266947 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ee996-7135-42ff-9574-4447b849bf02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:18.338899 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 40/84] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:58:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:58:18.339665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26ccc0-6ebf-4ae1-9386-67f96858941c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:18.358632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:18.369712 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ee996-7135-42ff-9574-4447b849bf02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:18.372771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ee996-7135-42ff-9574-4447b849bf02 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:18.436495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:18.452799 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26ccc0-6ebf-4ae1-9386-67f96858941c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:18.483484 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 45/85] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:58:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:58:18.484628 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ee996-7135-42ff-9574-4447b849bf02 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:18.491240 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14561af9-4845-4738-876c-b2330ed787ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:18.492032 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14561af9-4845-4738-876c-b2330ed787ea None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:18.492407 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14561af9-4845-4738-876c-b2330ed787ea None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:18.492856 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14561af9-4845-4738-876c-b2330ed787ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:18.574486 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14561af9-4845-4738-876c-b2330ed787ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:18.577370 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14561af9-4845-4738-876c-b2330ed787ea None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:18.592062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ee996-7135-42ff-9574-4447b849bf02 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:18.594161 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:18.636742 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda05a9-424e-4737-8ce3-a01939ad7352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:18.637682 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda05a9-424e-4737-8ce3-a01939ad7352 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:18.638143 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda05a9-424e-4737-8ce3-a01939ad7352 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:18.638644 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda05a9-424e-4737-8ce3-a01939ad7352 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:18.639539 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda05a9-424e-4737-8ce3-a01939ad7352 None admin] RBAC: Adding query filter params (name=member) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:18.640042 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda05a9-424e-4737-8ce3-a01939ad7352 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:18.641723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda05a9-424e-4737-8ce3-a01939ad7352 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:18.650901 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 46/86] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 13 13:58:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:18.651958 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda05a9-424e-4737-8ce3-a01939ad7352 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:18.682102 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:18.709687 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 41/87] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:58:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:58:18.711113 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14561af9-4845-4738-876c-b2330ed787ea None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:18.764264 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda05a9-424e-4737-8ce3-a01939ad7352 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:18.801207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3a175-158f-4f4f-91ca-2d5ed3962f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:18.802247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3a175-158f-4f4f-91ca-2d5ed3962f3f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:18.802782 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3a175-158f-4f4f-91ca-2d5ed3962f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:18.803252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3a175-158f-4f4f-91ca-2d5ed3962f3f None admin] PATH_INFO: `/v3/projects/1aeb29de324e4f558c8157b5cd66f520` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:18.805371 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3a175-158f-4f4f-91ca-2d5ed3962f3f None admin] RBAC: Authorizing `identity:get_project(project_id=1aeb29de324e4f558c8157b5cd66f520)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:18.807162 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3a175-158f-4f4f-91ca-2d5ed3962f3f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:18.809278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 47/88] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:18 2022] GET /identity/v3/projects/1aeb29de324e4f558c8157b5cd66f520 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:18.810288 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3a175-158f-4f4f-91ca-2d5ed3962f3f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:18.836744 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14561af9-4845-4738-876c-b2330ed787ea None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:18.853507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:18.880170 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab12ad-0438-453f-b059-8b014b5d0bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:18.880786 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab12ad-0438-453f-b059-8b014b5d0bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:18.881063 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab12ad-0438-453f-b059-8b014b5d0bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:18.881366 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab12ad-0438-453f-b059-8b014b5d0bd3 None admin] PATH_INFO: `/v3/projects/1aeb29de324e4f558c8157b5cd66f520` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:18.882830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab12ad-0438-453f-b059-8b014b5d0bd3 None admin] RBAC: Authorizing `identity:get_project(project_id=1aeb29de324e4f558c8157b5cd66f520)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:18.884958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab12ad-0438-453f-b059-8b014b5d0bd3 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:18.886649 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 42/89] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:18 2022] GET /identity/v3/projects/1aeb29de324e4f558c8157b5cd66f520 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:18.887410 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab12ad-0438-453f-b059-8b014b5d0bd3 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:18.918364 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:18.929745 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3a175-158f-4f4f-91ca-2d5ed3962f3f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:18.972698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58d0b8-3492-4cfe-a021-ca37b2905c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:18.973961 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58d0b8-3492-4cfe-a021-ca37b2905c68 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:18.974473 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58d0b8-3492-4cfe-a021-ca37b2905c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:18.975037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58d0b8-3492-4cfe-a021-ca37b2905c68 None admin] PATH_INFO: `/v3/users/c34f788e4ffe4f7aad092b4dfbe64357` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:18.977371 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58d0b8-3492-4cfe-a021-ca37b2905c68 None admin] RBAC: Authorizing `identity:get_user(user_id=c34f788e4ffe4f7aad092b4dfbe64357)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:18.979220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58d0b8-3492-4cfe-a021-ca37b2905c68 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:18.981552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 48/90] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:18 2022] GET /identity/v3/users/c34f788e4ffe4f7aad092b4dfbe64357 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:18.982712 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58d0b8-3492-4cfe-a021-ca37b2905c68 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:19.018603 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab12ad-0438-453f-b059-8b014b5d0bd3 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:19.061551 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4b96a-4ee0-46c2-a8f6-592ed7aef480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:19.062183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4b96a-4ee0-46c2-a8f6-592ed7aef480 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:19.062461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4b96a-4ee0-46c2-a8f6-592ed7aef480 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:19.062733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4b96a-4ee0-46c2-a8f6-592ed7aef480 None admin] PATH_INFO: `/v3/projects/1aeb29de324e4f558c8157b5cd66f520` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:19.063848 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4b96a-4ee0-46c2-a8f6-592ed7aef480 None admin] RBAC: Authorizing `identity:get_project(project_id=1aeb29de324e4f558c8157b5cd66f520)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:19.065437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4b96a-4ee0-46c2-a8f6-592ed7aef480 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:19.067256 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 43/91] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:18 2022] GET /identity/v3/projects/1aeb29de324e4f558c8157b5cd66f520 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:19.067917 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4b96a-4ee0-46c2-a8f6-592ed7aef480 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:19.095596 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58d0b8-3492-4cfe-a021-ca37b2905c68 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:19.126449 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:19.133483 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95d25b-51ba-45c4-b292-62fb4372098f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:19.134361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95d25b-51ba-45c4-b292-62fb4372098f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:19.134855 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95d25b-51ba-45c4-b292-62fb4372098f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:19.135326 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95d25b-51ba-45c4-b292-62fb4372098f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:19.136307 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95d25b-51ba-45c4-b292-62fb4372098f None admin] RBAC: Adding query filter params (role.id=6dcc8495d2b24b3eab63dd656eb4eb6d, scope.project.id=1aeb29de324e4f558c8157b5cd66f520, user.id=97bb92037c8b4cdabc69372647290362) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:19.136873 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95d25b-51ba-45c4-b292-62fb4372098f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:19.138728 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95d25b-51ba-45c4-b292-62fb4372098f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:19.144669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 49/92] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:58:18 2022] GET /identity/v3/role_assignments?user.id=97bb92037c8b4cdabc69372647290362&scope.project.id=1aeb29de324e4f558c8157b5cd66f520&role.id=6dcc8495d2b24b3eab63dd656eb4eb6d => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:19.145720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95d25b-51ba-45c4-b292-62fb4372098f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:19.204435 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:19.225543 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4b96a-4ee0-46c2-a8f6-592ed7aef480 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:19.310702 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228533c-7640-4ccf-bddb-74916b9fff32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:19.311550 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228533c-7640-4ccf-bddb-74916b9fff32 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:19.311842 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228533c-7640-4ccf-bddb-74916b9fff32 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:19.312110 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228533c-7640-4ccf-bddb-74916b9fff32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:19.312876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228533c-7640-4ccf-bddb-74916b9fff32 None admin] RBAC: Adding query filter params (role.id=81a57b9863404b45acc1204670e387f2, scope.project.id=1aeb29de324e4f558c8157b5cd66f520, user.id=c34f788e4ffe4f7aad092b4dfbe64357) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:19.313240 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228533c-7640-4ccf-bddb-74916b9fff32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:19.314745 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228533c-7640-4ccf-bddb-74916b9fff32 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:19.333051 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 44/93] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:58:19 2022] GET /identity/v3/role_assignments?user.id=c34f788e4ffe4f7aad092b4dfbe64357&scope.project.id=1aeb29de324e4f558c8157b5cd66f520&role.id=81a57b9863404b45acc1204670e387f2 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:19.334204 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228533c-7640-4ccf-bddb-74916b9fff32 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:19.376401 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95d25b-51ba-45c4-b292-62fb4372098f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:19.463196 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af830f-e09f-45c7-8c58-40bf63125828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:19.463878 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af830f-e09f-45c7-8c58-40bf63125828 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:19.464168 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af830f-e09f-45c7-8c58-40bf63125828 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:19.464446 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af830f-e09f-45c7-8c58-40bf63125828 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:19.568676 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228533c-7640-4ccf-bddb-74916b9fff32 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:19.601497 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:19.618630 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af830f-e09f-45c7-8c58-40bf63125828 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:19.620166 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af830f-e09f-45c7-8c58-40bf63125828 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:19.645018 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46dcc6-3650-4382-b4a5-98a73a3d877b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:19.645680 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46dcc6-3650-4382-b4a5-98a73a3d877b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:19.645952 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46dcc6-3650-4382-b4a5-98a73a3d877b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:19.646228 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46dcc6-3650-4382-b4a5-98a73a3d877b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:19.646976 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46dcc6-3650-4382-b4a5-98a73a3d877b None admin] RBAC: Adding query filter params (role.id=cf8554dac8d343549802afd60c56c0d6, scope.project.id=1aeb29de324e4f558c8157b5cd66f520, user.id=c34f788e4ffe4f7aad092b4dfbe64357) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:19.647293 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46dcc6-3650-4382-b4a5-98a73a3d877b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:19.648791 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46dcc6-3650-4382-b4a5-98a73a3d877b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:19.666133 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 45/94] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:58:19 2022] GET /identity/v3/role_assignments?user.id=c34f788e4ffe4f7aad092b4dfbe64357&scope.project.id=1aeb29de324e4f558c8157b5cd66f520&role.id=cf8554dac8d343549802afd60c56c0d6 => generated 259 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:19.669604 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:19.759950 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 50/95] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:58:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:58:19.765424 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46dcc6-3650-4382-b4a5-98a73a3d877b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:19.887874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46dcc6-3650-4382-b4a5-98a73a3d877b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:19.925570 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6124eca-f781-4282-bd54-ee4a74c99199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:19.926223 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6124eca-f781-4282-bd54-ee4a74c99199 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:19.926575 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6124eca-f781-4282-bd54-ee4a74c99199 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:19.926853 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6124eca-f781-4282-bd54-ee4a74c99199 None admin] PATH_INFO: `/v3/projects/18cc10c3eead460daa9734276c74cdb4` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:19.928162 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6124eca-f781-4282-bd54-ee4a74c99199 None admin] RBAC: Authorizing `identity:get_project(project_id=18cc10c3eead460daa9734276c74cdb4)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:19.929774 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6124eca-f781-4282-bd54-ee4a74c99199 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:19.931484 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 46/96] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:19 2022] GET /identity/v3/projects/18cc10c3eead460daa9734276c74cdb4 => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:19.937378 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af830f-e09f-45c7-8c58-40bf63125828 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:20.078702 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af830f-e09f-45c7-8c58-40bf63125828 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:20.112470 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:20.129782 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631a5db-19f2-407f-a755-3a824d55800d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:20.130462 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631a5db-19f2-407f-a755-3a824d55800d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:20.130751 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631a5db-19f2-407f-a755-3a824d55800d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:20.131028 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631a5db-19f2-407f-a755-3a824d55800d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:20.131766 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631a5db-19f2-407f-a755-3a824d55800d None admin] RBAC: Adding query filter params (role.id=81a57b9863404b45acc1204670e387f2, scope.project.id=18cc10c3eead460daa9734276c74cdb4, user.id=c34f788e4ffe4f7aad092b4dfbe64357) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:20.132129 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631a5db-19f2-407f-a755-3a824d55800d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:20.133698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631a5db-19f2-407f-a755-3a824d55800d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:20.145549 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 51/97] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:58:19 2022] GET /identity/v3/role_assignments?user.id=c34f788e4ffe4f7aad092b4dfbe64357&scope.project.id=18cc10c3eead460daa9734276c74cdb4&role.id=81a57b9863404b45acc1204670e387f2 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:20.318698 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e19db-70ed-4f24-b76c-a6ec6598d4ca None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:20.319068 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e19db-70ed-4f24-b76c-a6ec6598d4ca None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:20.319265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e19db-70ed-4f24-b76c-a6ec6598d4ca None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:20.320663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 47/98] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:20.326625 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ab171-32cd-4c4a-8b66-6b89c6ccb732 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:20.326913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ab171-32cd-4c4a-8b66-6b89c6ccb732 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:20.327193 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ab171-32cd-4c4a-8b66-6b89c6ccb732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:20.354127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-755ab171-32cd-4c4a-8b66-6b89c6ccb732 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:20.355952 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-755ab171-32cd-4c4a-8b66-6b89c6ccb732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:20.458803 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 52/99] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:20.773643 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e19db-70ed-4f24-b76c-a6ec6598d4ca None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:20.800458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058b5df-d527-4144-9c61-1d8fbe1c2cec None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:20.800759 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058b5df-d527-4144-9c61-1d8fbe1c2cec None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:20.801026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058b5df-d527-4144-9c61-1d8fbe1c2cec None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:20.802423 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 53/100] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 13:58:20.808360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709e540-e2ba-4ae0-a016-4f764e14272e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:20.808819 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709e540-e2ba-4ae0-a016-4f764e14272e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:20.809122 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709e540-e2ba-4ae0-a016-4f764e14272e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:20.841207 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:20.846177 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-4709e540-e2ba-4ae0-a016-4f764e14272e None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:20.848316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4709e540-e2ba-4ae0-a016-4f764e14272e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:20.921911 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e19db-70ed-4f24-b76c-a6ec6598d4ca None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:20.963294 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55888013-8e29-4318-9e88-d9e99dcc7cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:20.964385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55888013-8e29-4318-9e88-d9e99dcc7cda None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:20.964667 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55888013-8e29-4318-9e88-d9e99dcc7cda None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:20.965234 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55888013-8e29-4318-9e88-d9e99dcc7cda None admin] PATH_INFO: `/v3/domains/default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:20.966420 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55888013-8e29-4318-9e88-d9e99dcc7cda None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:20.968130 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55888013-8e29-4318-9e88-d9e99dcc7cda None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:20.970123 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 54/101] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 13:58:20.970241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 48/102] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:58:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:20.976502 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709e540-e2ba-4ae0-a016-4f764e14272e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:21.028011 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:21.092478 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709e540-e2ba-4ae0-a016-4f764e14272e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:21.129019 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6087034-619c-43bc-bb09-747afeb4d52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:21.129661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6087034-619c-43bc-bb09-747afeb4d52b None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:21.129945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6087034-619c-43bc-bb09-747afeb4d52b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:21.130220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6087034-619c-43bc-bb09-747afeb4d52b None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:21.130881 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6087034-619c-43bc-bb09-747afeb4d52b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:21.132372 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6087034-619c-43bc-bb09-747afeb4d52b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:21.170210 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 55/103] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Sep 13 13:58:20 2022] POST /identity/v3/projects => generated 302 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 13:58:21.456607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55888013-8e29-4318-9e88-d9e99dcc7cda None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:21.566930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55888013-8e29-4318-9e88-d9e99dcc7cda None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:21.580501 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:21.604416 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a655eef-96e9-40ec-bb7f-596a0dce6cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:21.605050 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a655eef-96e9-40ec-bb7f-596a0dce6cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:21.605351 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a655eef-96e9-40ec-bb7f-596a0dce6cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:21.605622 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a655eef-96e9-40ec-bb7f-596a0dce6cd0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:21.616342 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a655eef-96e9-40ec-bb7f-596a0dce6cd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:21.623908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-9a655eef-96e9-40ec-bb7f-596a0dce6cd0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 13:58:21.623908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:21.623908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:21.623908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:21.623908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:21.623908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:21.623908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:21.623908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:21.623908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:21.623908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:21.623908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:21.623908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:21.623908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:21.623908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:21.623908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:21.623908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:21.624733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:21.624733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:21.624733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:21.624733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:21.624733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:21.624733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:21.624733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:21.624733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:21.624733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:21.624733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:21.624733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:21.624733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:21.624733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:21.624733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:21.624733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:21.624733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:21.625507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:21.625507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:21.625507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:21.625507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:21.625507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:21.625507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:21.625507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:21.625507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:21.625507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:21.625507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:21.625507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 13:58:21.625507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:58:21.625507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 49/104] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:21.633129 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6087034-619c-43bc-bb09-747afeb4d52b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:21.777206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:21.780900 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6087034-619c-43bc-bb09-747afeb4d52b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:21.826418 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706b47b-1e21-46a4-8da5-4d93f0e57a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:21.827051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706b47b-1e21-46a4-8da5-4d93f0e57a46 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:21.827335 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706b47b-1e21-46a4-8da5-4d93f0e57a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:21.827612 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706b47b-1e21-46a4-8da5-4d93f0e57a46 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:21.828291 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706b47b-1e21-46a4-8da5-4d93f0e57a46 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:21.828600 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706b47b-1e21-46a4-8da5-4d93f0e57a46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:21.830081 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706b47b-1e21-46a4-8da5-4d93f0e57a46 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:21.842070 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 56/105] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 13 13:58:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:21.847582 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a655eef-96e9-40ec-bb7f-596a0dce6cd0 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:21.987758 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a655eef-96e9-40ec-bb7f-596a0dce6cd0 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:22.029901 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfd563-a91d-4523-a398-43bc59a0c623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:22.030474 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfd563-a91d-4523-a398-43bc59a0c623 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:22.030757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfd563-a91d-4523-a398-43bc59a0c623 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:22.031036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfd563-a91d-4523-a398-43bc59a0c623 None admin] PATH_INFO: `/v3/users/3a03cc7520334437b3dfcedfecb8fbfd` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:22.054822 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfd563-a91d-4523-a398-43bc59a0c623 None admin] RBAC: Authorizing `identity:get_user(user_id=3a03cc7520334437b3dfcedfecb8fbfd)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:22.056316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfd563-a91d-4523-a398-43bc59a0c623 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:22.058380 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 50/106] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:21 2022] GET /identity/v3/users/3a03cc7520334437b3dfcedfecb8fbfd => generated 289 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:22.063933 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706b47b-1e21-46a4-8da5-4d93f0e57a46 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:22.219943 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706b47b-1e21-46a4-8da5-4d93f0e57a46 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:22.263112 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5255d-16d2-48e1-a9e7-00ce96d91122 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:22.263496 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5255d-16d2-48e1-a9e7-00ce96d91122 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:22.263660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5255d-16d2-48e1-a9e7-00ce96d91122 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:22.265357 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 51/107] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:22.266521 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbc849-8023-41de-9acc-31eba57d3300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:22.267141 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbc849-8023-41de-9acc-31eba57d3300 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:22.267424 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbc849-8023-41de-9acc-31eba57d3300 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:22.267693 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbc849-8023-41de-9acc-31eba57d3300 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:22.270226 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b0b71-a381-4be3-952d-a01d012824bd None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:22.270504 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b0b71-a381-4be3-952d-a01d012824bd None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:22.270763 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b0b71-a381-4be3-952d-a01d012824bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:22.302275 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-336b0b71-a381-4be3-952d-a01d012824bd None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:22.303498 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-336b0b71-a381-4be3-952d-a01d012824bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:22.312403 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:22.345665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:22.390243 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cbc849-8023-41de-9acc-31eba57d3300 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:22.391747 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cbc849-8023-41de-9acc-31eba57d3300 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:22.426850 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 52/108] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 13:58:22.539967 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 57/109] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:58:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:58:22.545926 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b0b71-a381-4be3-952d-a01d012824bd None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:22.670792 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b0b71-a381-4be3-952d-a01d012824bd None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:22.722343 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7118cc-648e-41ce-84ad-e16434e1e575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:22.722982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7118cc-648e-41ce-84ad-e16434e1e575 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:22.723263 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7118cc-648e-41ce-84ad-e16434e1e575 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:22.723538 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7118cc-648e-41ce-84ad-e16434e1e575 None admin] PATH_INFO: `/v3/projects/1aeb29de324e4f558c8157b5cd66f520` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:22.724692 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7118cc-648e-41ce-84ad-e16434e1e575 None admin] RBAC: Authorizing `identity:get_project(project_id=1aeb29de324e4f558c8157b5cd66f520)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:22.726224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7118cc-648e-41ce-84ad-e16434e1e575 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:22.728211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 53/110] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:22 2022] GET /identity/v3/projects/1aeb29de324e4f558c8157b5cd66f520 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:22.733811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbc849-8023-41de-9acc-31eba57d3300 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:22.813219 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:22.870646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbc849-8023-41de-9acc-31eba57d3300 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:22.919148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78910a35-2075-4fd0-b2e4-5f262d821600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:22.920122 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78910a35-2075-4fd0-b2e4-5f262d821600 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:22.920597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78910a35-2075-4fd0-b2e4-5f262d821600 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:22.921064 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78910a35-2075-4fd0-b2e4-5f262d821600 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:22.922138 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78910a35-2075-4fd0-b2e4-5f262d821600 None admin] RBAC: Adding query filter params (role.id=d11e68c76f6d4095a93949ee841afead, scope.project.id=1aeb29de324e4f558c8157b5cd66f520, user.id=3a03cc7520334437b3dfcedfecb8fbfd) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:22.922647 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78910a35-2075-4fd0-b2e4-5f262d821600 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:22.924299 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78910a35-2075-4fd0-b2e4-5f262d821600 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:22.933408 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 58/111] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:58:22 2022] GET /identity/v3/role_assignments?user.id=3a03cc7520334437b3dfcedfecb8fbfd&scope.project.id=1aeb29de324e4f558c8157b5cd66f520&role.id=d11e68c76f6d4095a93949ee841afead => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:58:23.006347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3c45d-e6e4-42cc-b60b-7d3f899a5785 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:23.007442 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3c45d-e6e4-42cc-b60b-7d3f899a5785 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:23.007442 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3c45d-e6e4-42cc-b60b-7d3f899a5785 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:23.009235 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 54/112] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:23.014433 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c38f97-7c13-47d4-9a43-9491e16872a6 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:23.014723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c38f97-7c13-47d4-9a43-9491e16872a6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:23.015003 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c38f97-7c13-47d4-9a43-9491e16872a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:23.035532 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-78c38f97-7c13-47d4-9a43-9491e16872a6 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:23.036727 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-78c38f97-7c13-47d4-9a43-9491e16872a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:23.125177 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 59/113] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:23.153125 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3c45d-e6e4-42cc-b60b-7d3f899a5785 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:23.192315 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84f593-b948-4fe1-8422-0a0fa982cd7d None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:23.192936 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84f593-b948-4fe1-8422-0a0fa982cd7d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:23.193513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84f593-b948-4fe1-8422-0a0fa982cd7d None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:23.195657 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 60/114] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 13:58:23.195757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:23.200707 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3e446-a989-4c1c-8f34-d59ce8c3bd35 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:23.201327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3e446-a989-4c1c-8f34-d59ce8c3bd35 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:23.201804 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3e446-a989-4c1c-8f34-d59ce8c3bd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:23.232367 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-70f3e446-a989-4c1c-8f34-d59ce8c3bd35 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:23.233947 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-70f3e446-a989-4c1c-8f34-d59ce8c3bd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:23.286010 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3c45d-e6e4-42cc-b60b-7d3f899a5785 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:23.328932 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:23.330394 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5fc40-1aa5-4375-912b-7a8416bc3f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:23.331373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5fc40-1aa5-4375-912b-7a8416bc3f8e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:23.331905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5fc40-1aa5-4375-912b-7a8416bc3f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:23.332391 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5fc40-1aa5-4375-912b-7a8416bc3f8e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:23.345464 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c5fc40-1aa5-4375-912b-7a8416bc3f8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:23.351058 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-c3c5fc40-1aa5-4375-912b-7a8416bc3f8e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:58:23.351058 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:23.351058 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:23.351058 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:23.351058 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:23.351058 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:23.351058 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:23.351058 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:23.351058 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:23.351058 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:23.351058 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:23.351058 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:23.351058 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:23.351058 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:23.351058 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:23.351058 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:23.352037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:23.352037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:23.352037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:23.352037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:23.352037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:23.352037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:23.352037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:23.352037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:23.352037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:23.352037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:23.352037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:23.352037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:23.352037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:23.352037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:23.352037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:23.352037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:23.352934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:23.352934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:23.352934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:23.352934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:23.352934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:23.352934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:23.352934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:23.352934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:23.352934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:23.352934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:23.352934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:58:23.352934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:58:23.354777 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 55/115] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:23.360597 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5fc40-1aa5-4375-912b-7a8416bc3f8e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:23.364795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 61/116] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 13:58:23.456893 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:23.472187 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5fc40-1aa5-4375-912b-7a8416bc3f8e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:23.500949 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3e446-a989-4c1c-8f34-d59ce8c3bd35 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:23.511751 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f283b-e01e-452b-96e2-f123a3ba231a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:23.512372 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f283b-e01e-452b-96e2-f123a3ba231a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:23.512751 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f283b-e01e-452b-96e2-f123a3ba231a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:23.513024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f283b-e01e-452b-96e2-f123a3ba231a None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:23.513723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f283b-e01e-452b-96e2-f123a3ba231a None admin] RBAC: Adding query filter params (name=member) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:23.514025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f283b-e01e-452b-96e2-f123a3ba231a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:23.515532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f283b-e01e-452b-96e2-f123a3ba231a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:23.531906 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 56/117] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 13 13:58:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:58:23.538374 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f283b-e01e-452b-96e2-f123a3ba231a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:23.650005 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f283b-e01e-452b-96e2-f123a3ba231a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:23.689461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd0edd-c482-492e-b489-cc7ae4b69a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:23.690511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd0edd-c482-492e-b489-cc7ae4b69a8a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:23.692460 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3e446-a989-4c1c-8f34-d59ce8c3bd35 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:23.692889 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd0edd-c482-492e-b489-cc7ae4b69a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:23.693398 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd0edd-c482-492e-b489-cc7ae4b69a8a None admin] PATH_INFO: `/v3/users/c34f788e4ffe4f7aad092b4dfbe64357` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:23.696695 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd0edd-c482-492e-b489-cc7ae4b69a8a None admin] RBAC: Authorizing `identity:get_user(user_id=c34f788e4ffe4f7aad092b4dfbe64357)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:23.698322 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd0edd-c482-492e-b489-cc7ae4b69a8a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:23.700318 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 57/118] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:23 2022] GET /identity/v3/users/c34f788e4ffe4f7aad092b4dfbe64357 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:58:23.713191 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd0edd-c482-492e-b489-cc7ae4b69a8a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:23.737845 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:23.776311 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033730a-a404-4d72-b28b-9ac5cef288da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:23.776991 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033730a-a404-4d72-b28b-9ac5cef288da None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:23.777299 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033730a-a404-4d72-b28b-9ac5cef288da None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:23.777573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033730a-a404-4d72-b28b-9ac5cef288da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:23.797021 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033730a-a404-4d72-b28b-9ac5cef288da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:23.803085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-8033730a-a404-4d72-b28b-9ac5cef288da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:58:23.803085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:23.803085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:23.803085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:23.803085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:23.803085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:23.803085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:23.803085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:23.803085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:23.803085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:23.803085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:23.803085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:23.803085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:23.803085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:23.803085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:23.803085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:23.804174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:23.804174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:23.804174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:23.804174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:23.804174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:23.804174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:23.804174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:23.804174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:23.804174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:23.804174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:23.804174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:23.804174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:23.804174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:23.804174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:23.804174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:23.804174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:23.805127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:23.805127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:23.805127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:23.805127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:23.805127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:23.805127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:23.805127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:23.805127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:23.805127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:23.805127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:23.805127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:58:23.805127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:58:23.805724 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 62/119] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 13:58:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:58:23.810020 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cdce4-28fe-472a-b675-dd55b622acd6 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:23.810982 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cdce4-28fe-472a-b675-dd55b622acd6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:23.811863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cdce4-28fe-472a-b675-dd55b622acd6 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:23.814845 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 63/120] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:23.815791 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0cdce4-28fe-472a-b675-dd55b622acd6 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:23.876786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:23.883075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd0edd-c482-492e-b489-cc7ae4b69a8a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:23.923950 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9707491-7461-4d7c-875f-9c1bcbb3fa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:23.924928 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9707491-7461-4d7c-875f-9c1bcbb3fa2a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:23.925456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9707491-7461-4d7c-875f-9c1bcbb3fa2a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:23.925939 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9707491-7461-4d7c-875f-9c1bcbb3fa2a None admin] PATH_INFO: `/v3/projects/1aeb29de324e4f558c8157b5cd66f520` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:23.927258 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9707491-7461-4d7c-875f-9c1bcbb3fa2a None admin] RBAC: Authorizing `identity:get_project(project_id=1aeb29de324e4f558c8157b5cd66f520)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:23.929060 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9707491-7461-4d7c-875f-9c1bcbb3fa2a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:23.930833 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 58/121] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:23 2022] GET /identity/v3/projects/1aeb29de324e4f558c8157b5cd66f520 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:23.932234 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbd11f-d7ad-4042-a108-cb36b07e6551 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:23.932710 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbd11f-d7ad-4042-a108-cb36b07e6551 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:23.933199 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbd11f-d7ad-4042-a108-cb36b07e6551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:23.943885 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0cdce4-28fe-472a-b675-dd55b622acd6 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:23.952316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-54dbd11f-d7ad-4042-a108-cb36b07e6551 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:23.953808 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-54dbd11f-d7ad-4042-a108-cb36b07e6551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:23.990117 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463376b-81cb-42ff-8c0c-101b149b1a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:23.990657 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463376b-81cb-42ff-8c0c-101b149b1a4e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:23.990940 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463376b-81cb-42ff-8c0c-101b149b1a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:23.991299 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463376b-81cb-42ff-8c0c-101b149b1a4e None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:23.992877 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463376b-81cb-42ff-8c0c-101b149b1a4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:23.993220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463376b-81cb-42ff-8c0c-101b149b1a4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:23.994860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463376b-81cb-42ff-8c0c-101b149b1a4e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:24.005619 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 64/122] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:24.006764 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463376b-81cb-42ff-8c0c-101b149b1a4e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:24.032289 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 59/123] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:24.033157 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbd11f-d7ad-4042-a108-cb36b07e6551 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:24.056773 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:24.175708 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463376b-81cb-42ff-8c0c-101b149b1a4e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:24.189804 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:24.207346 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbd11f-d7ad-4042-a108-cb36b07e6551 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:24.240766 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f43740-1ada-4b3f-84fd-517ab9a06021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:24.242259 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f43740-1ada-4b3f-84fd-517ab9a06021 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:24.242763 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f43740-1ada-4b3f-84fd-517ab9a06021 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:24.243233 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f43740-1ada-4b3f-84fd-517ab9a06021 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:24.254129 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f43740-1ada-4b3f-84fd-517ab9a06021 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:24.259968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-17f43740-1ada-4b3f-84fd-517ab9a06021 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 13:58:24.259968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:24.259968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:24.259968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:24.259968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:24.259968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:24.259968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:24.259968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:24.259968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:24.259968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:24.259968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:24.259968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:24.259968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:24.259968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:24.259968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:24.259968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:24.260859 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:24.260859 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:24.260859 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:24.260859 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:24.260859 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:24.260859 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:24.260859 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:24.260859 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:24.260859 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:24.260859 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:24.260859 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:24.260859 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:24.260859 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:24.260859 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:24.260859 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:24.260859 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:24.261643 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:24.261643 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:24.261643 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:24.261643 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:24.261643 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:24.261643 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:24.261643 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:24.261643 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:24.261643 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:24.261643 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:24.261643 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 13:58:24.261643 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:58:24.262205 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb666a-9e96-479f-90f2-fd0a95370508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:24.262750 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb666a-9e96-479f-90f2-fd0a95370508 None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:24.262750 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb666a-9e96-479f-90f2-fd0a95370508 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:24.262980 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb666a-9e96-479f-90f2-fd0a95370508 None admin] PATH_INFO: `/v3/projects/1aeb29de324e4f558c8157b5cd66f520/users/c34f788e4ffe4f7aad092b4dfbe64357/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:24.264307 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 65/124] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 13 13:58:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:24.269407 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f43740-1ada-4b3f-84fd-517ab9a06021 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:24.269844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb666a-9e96-479f-90f2-fd0a95370508 None admin] RBAC: Authorizing `identity:create_grant(project_id=1aeb29de324e4f558c8157b5cd66f520, user_id=c34f788e4ffe4f7aad092b4dfbe64357, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:24.271315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb666a-9e96-479f-90f2-fd0a95370508 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:24.289717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 60/125] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 13 13:58:24 2022] PUT /identity/v3/projects/1aeb29de324e4f558c8157b5cd66f520/users/c34f788e4ffe4f7aad092b4dfbe64357/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 13:58:24.292040 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb666a-9e96-479f-90f2-fd0a95370508 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:24.427991 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f43740-1ada-4b3f-84fd-517ab9a06021 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:24.457111 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:24.476716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60fa03-9d60-44eb-98ed-baa7ed5d44a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:24.477856 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60fa03-9d60-44eb-98ed-baa7ed5d44a7 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:24.478348 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60fa03-9d60-44eb-98ed-baa7ed5d44a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:24.479119 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60fa03-9d60-44eb-98ed-baa7ed5d44a7 None admin] PATH_INFO: `/v3/users/97bb92037c8b4cdabc69372647290362` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:24.480955 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60fa03-9d60-44eb-98ed-baa7ed5d44a7 None admin] RBAC: Authorizing `identity:get_user(user_id=97bb92037c8b4cdabc69372647290362)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:24.482816 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60fa03-9d60-44eb-98ed-baa7ed5d44a7 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:24.485305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 66/126] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:24 2022] GET /identity/v3/users/97bb92037c8b4cdabc69372647290362 => generated 247 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:24.486969 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60fa03-9d60-44eb-98ed-baa7ed5d44a7 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:24.527749 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb666a-9e96-479f-90f2-fd0a95370508 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:24.558285 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:24.589950 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b535f-3a05-4710-a63f-bc590b91e10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:24.590170 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b535f-3a05-4710-a63f-bc590b91e10c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:24.590391 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b535f-3a05-4710-a63f-bc590b91e10c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:24.590568 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b535f-3a05-4710-a63f-bc590b91e10c None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:24.591255 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b535f-3a05-4710-a63f-bc590b91e10c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:24.591552 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b535f-3a05-4710-a63f-bc590b91e10c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:24.593203 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b535f-3a05-4710-a63f-bc590b91e10c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:24.603598 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 61/127] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:58:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:24.604696 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b535f-3a05-4710-a63f-bc590b91e10c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:24.668297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60fa03-9d60-44eb-98ed-baa7ed5d44a7 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:24.704319 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d80c8-8015-4244-8de7-1ca368c5cabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:24.704963 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d80c8-8015-4244-8de7-1ca368c5cabb None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:24.705279 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d80c8-8015-4244-8de7-1ca368c5cabb None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:24.705554 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d80c8-8015-4244-8de7-1ca368c5cabb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:24.717110 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d80c8-8015-4244-8de7-1ca368c5cabb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:24.722696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-ac8d80c8-8015-4244-8de7-1ca368c5cabb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:58:24.722696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:24.722696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:24.722696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:24.722696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:24.722696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:24.722696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:24.722696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:24.722696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:24.722696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:24.722696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:24.722696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:24.722696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:24.722696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:24.722696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:24.722696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:24.723529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:24.723529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:24.723529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:24.723529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:24.723529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:24.723529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:24.723529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:24.723529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:24.723529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:24.723529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:24.723529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:24.723529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:24.723529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:24.723529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:24.723529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:24.723529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:24.726446 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:24.726446 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:24.726446 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:24.726446 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:24.726446 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:24.726446 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:24.726446 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:24.726446 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:24.726446 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:24.726446 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:24.726446 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:58:24.726446 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:58:24.726446 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 67/128] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:24.726446 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d4107-eb39-4433-b15c-450d8f7d1f57 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:24.727127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d4107-eb39-4433-b15c-450d8f7d1f57 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:24.727127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d4107-eb39-4433-b15c-450d8f7d1f57 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:24.727236 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 68/129] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:24.727914 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d4107-eb39-4433-b15c-450d8f7d1f57 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:24.743546 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b535f-3a05-4710-a63f-bc590b91e10c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:24.779838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eaa48c-f5dd-4a97-81b0-7e8c6189d513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:24.780710 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eaa48c-f5dd-4a97-81b0-7e8c6189d513 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:24.781191 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eaa48c-f5dd-4a97-81b0-7e8c6189d513 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:24.781621 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eaa48c-f5dd-4a97-81b0-7e8c6189d513 None admin] PATH_INFO: `/v3/projects/1aeb29de324e4f558c8157b5cd66f520` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:24.782891 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eaa48c-f5dd-4a97-81b0-7e8c6189d513 None admin] RBAC: Authorizing `identity:get_project(project_id=1aeb29de324e4f558c8157b5cd66f520)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:24.784970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eaa48c-f5dd-4a97-81b0-7e8c6189d513 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:24.786809 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 62/130] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:24 2022] GET /identity/v3/projects/1aeb29de324e4f558c8157b5cd66f520 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:24.787685 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eaa48c-f5dd-4a97-81b0-7e8c6189d513 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:24.797791 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:24.851549 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:24.863352 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d4107-eb39-4433-b15c-450d8f7d1f57 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:24.896544 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eaa48c-f5dd-4a97-81b0-7e8c6189d513 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:24.912964 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd231b-84be-4d19-8562-780fc84b7b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:24.914104 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd231b-84be-4d19-8562-780fc84b7b9a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:24.914783 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd231b-84be-4d19-8562-780fc84b7b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:24.915400 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd231b-84be-4d19-8562-780fc84b7b9a None admin] PATH_INFO: `/v3/users/c34f788e4ffe4f7aad092b4dfbe64357` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:24.917026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd231b-84be-4d19-8562-780fc84b7b9a None admin] RBAC: Authorizing `identity:get_user(user_id=c34f788e4ffe4f7aad092b4dfbe64357)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:24.919121 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd231b-84be-4d19-8562-780fc84b7b9a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:24.921443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 69/131] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:24 2022] GET /identity/v3/users/c34f788e4ffe4f7aad092b4dfbe64357 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:24.923404 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a891a-2727-4b7f-9b5d-54e1e2ed0bc3 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:24.923875 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a891a-2727-4b7f-9b5d-54e1e2ed0bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:24.924464 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a891a-2727-4b7f-9b5d-54e1e2ed0bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:24.933395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb39cd2-da54-4607-9d0d-6f08de760025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:24.934115 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb39cd2-da54-4607-9d0d-6f08de760025 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:24.934448 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb39cd2-da54-4607-9d0d-6f08de760025 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:24.934786 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb39cd2-da54-4607-9d0d-6f08de760025 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:24.935526 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb39cd2-da54-4607-9d0d-6f08de760025 None admin] RBAC: Adding query filter params (name=member) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:24.935897 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb39cd2-da54-4607-9d0d-6f08de760025 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:24.937409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb39cd2-da54-4607-9d0d-6f08de760025 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:24.946618 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 63/132] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 13 13:58:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:24.947331 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb39cd2-da54-4607-9d0d-6f08de760025 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:24.952824 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d80a891a-2727-4b7f-9b5d-54e1e2ed0bc3 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:24.954397 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d80a891a-2727-4b7f-9b5d-54e1e2ed0bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:25.016073 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:25.047098 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 70/133] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:25.048238 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a891a-2727-4b7f-9b5d-54e1e2ed0bc3 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:25.064854 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb39cd2-da54-4607-9d0d-6f08de760025 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:25.137535 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd0ed0-06c3-4348-9e53-95aab043681c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:25.139190 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd0ed0-06c3-4348-9e53-95aab043681c None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:25.143214 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd0ed0-06c3-4348-9e53-95aab043681c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:25.143687 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd0ed0-06c3-4348-9e53-95aab043681c None admin] PATH_INFO: `/v3/projects/1aeb29de324e4f558c8157b5cd66f520/users/97bb92037c8b4cdabc69372647290362/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:25.146042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd0ed0-06c3-4348-9e53-95aab043681c None admin] RBAC: Authorizing `identity:create_grant(project_id=1aeb29de324e4f558c8157b5cd66f520, user_id=97bb92037c8b4cdabc69372647290362, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:25.148035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd0ed0-06c3-4348-9e53-95aab043681c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:25.169856 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 64/134] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 13 13:58:24 2022] PUT /identity/v3/projects/1aeb29de324e4f558c8157b5cd66f520/users/97bb92037c8b4cdabc69372647290362/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 13:58:25.171191 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd0ed0-06c3-4348-9e53-95aab043681c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:25.179357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:25.199470 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a891a-2727-4b7f-9b5d-54e1e2ed0bc3 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:25.275452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5d540-90c6-4c84-b4a5-e88b1df42198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:25.276364 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5d540-90c6-4c84-b4a5-e88b1df42198 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:25.276765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5d540-90c6-4c84-b4a5-e88b1df42198 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:25.277274 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5d540-90c6-4c84-b4a5-e88b1df42198 None admin] PATH_INFO: `/v3/projects/1aeb29de324e4f558c8157b5cd66f520` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:25.281000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5d540-90c6-4c84-b4a5-e88b1df42198 None admin] RBAC: Authorizing `identity:get_project(project_id=1aeb29de324e4f558c8157b5cd66f520)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:25.282668 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5d540-90c6-4c84-b4a5-e88b1df42198 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:25.284734 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 71/135] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:25 2022] GET /identity/v3/projects/1aeb29de324e4f558c8157b5cd66f520 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:25.291059 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5d540-90c6-4c84-b4a5-e88b1df42198 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:25.294952 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd0ed0-06c3-4348-9e53-95aab043681c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:25.326280 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:25.339248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c082d2c-b0db-4f6a-8796-20e1775ce437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:25.340275 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c082d2c-b0db-4f6a-8796-20e1775ce437 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:25.340778 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c082d2c-b0db-4f6a-8796-20e1775ce437 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:25.341276 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c082d2c-b0db-4f6a-8796-20e1775ce437 None admin] PATH_INFO: `/v3/users/c34f788e4ffe4f7aad092b4dfbe64357` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:25.342651 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c082d2c-b0db-4f6a-8796-20e1775ce437 None admin] RBAC: Authorizing `identity:get_user(user_id=c34f788e4ffe4f7aad092b4dfbe64357)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:25.344398 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c082d2c-b0db-4f6a-8796-20e1775ce437 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:25.346226 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 65/136] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:25 2022] GET /identity/v3/users/c34f788e4ffe4f7aad092b4dfbe64357 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:25.353539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c082d2c-b0db-4f6a-8796-20e1775ce437 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:25.472396 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5d540-90c6-4c84-b4a5-e88b1df42198 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:25.508311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c082d2c-b0db-4f6a-8796-20e1775ce437 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:25.531444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d520c6e-4f1a-4ab2-a100-4780bdad2424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:25.532108 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d520c6e-4f1a-4ab2-a100-4780bdad2424 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:25.532375 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d520c6e-4f1a-4ab2-a100-4780bdad2424 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:25.532650 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d520c6e-4f1a-4ab2-a100-4780bdad2424 None admin] PATH_INFO: `/v3/projects/1aeb29de324e4f558c8157b5cd66f520/users/c34f788e4ffe4f7aad092b4dfbe64357/roles/cf8554dac8d343549802afd60c56c0d6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:25.535182 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d520c6e-4f1a-4ab2-a100-4780bdad2424 None admin] RBAC: Authorizing `identity:create_grant(project_id=1aeb29de324e4f558c8157b5cd66f520, user_id=c34f788e4ffe4f7aad092b4dfbe64357, role_id=cf8554dac8d343549802afd60c56c0d6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:25.536558 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d520c6e-4f1a-4ab2-a100-4780bdad2424 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:25.555883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 72/137] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 13 13:58:25 2022] PUT /identity/v3/projects/1aeb29de324e4f558c8157b5cd66f520/users/c34f788e4ffe4f7aad092b4dfbe64357/roles/cf8554dac8d343549802afd60c56c0d6 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 13:58:25.556761 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d520c6e-4f1a-4ab2-a100-4780bdad2424 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:25.558207 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc308ac-2bf6-4533-8f25-a952a8fd9a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:25.559093 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc308ac-2bf6-4533-8f25-a952a8fd9a5b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:25.559634 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc308ac-2bf6-4533-8f25-a952a8fd9a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:25.560109 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc308ac-2bf6-4533-8f25-a952a8fd9a5b None admin] PATH_INFO: `/v3/projects/18cc10c3eead460daa9734276c74cdb4` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:25.561741 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc308ac-2bf6-4533-8f25-a952a8fd9a5b None admin] RBAC: Authorizing `identity:get_project(project_id=18cc10c3eead460daa9734276c74cdb4)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:25.563508 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc308ac-2bf6-4533-8f25-a952a8fd9a5b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:25.565717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 66/138] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:25 2022] GET /identity/v3/projects/18cc10c3eead460daa9734276c74cdb4 => generated 312 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:25.571571 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc308ac-2bf6-4533-8f25-a952a8fd9a5b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:25.582081 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:25.651140 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:25.697601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc308ac-2bf6-4533-8f25-a952a8fd9a5b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:25.717334 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d520c6e-4f1a-4ab2-a100-4780bdad2424 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:25.736464 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917259f4-dc66-4b3d-8c33-224e0493b2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:25.737527 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917259f4-dc66-4b3d-8c33-224e0493b2f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:25.738037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917259f4-dc66-4b3d-8c33-224e0493b2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:25.738518 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917259f4-dc66-4b3d-8c33-224e0493b2f8 None admin] PATH_INFO: `/v3/projects/18cc10c3eead460daa9734276c74cdb4/users/c34f788e4ffe4f7aad092b4dfbe64357/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:25.740955 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917259f4-dc66-4b3d-8c33-224e0493b2f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=18cc10c3eead460daa9734276c74cdb4, user_id=c34f788e4ffe4f7aad092b4dfbe64357, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:25.742729 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917259f4-dc66-4b3d-8c33-224e0493b2f8 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:25.759102 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 67/139] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 13 13:58:25 2022] PUT /identity/v3/projects/18cc10c3eead460daa9734276c74cdb4/users/c34f788e4ffe4f7aad092b4dfbe64357/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 13:58:25.777979 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30d9c7-67d9-428b-be52-d8924972c2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:25.778998 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30d9c7-67d9-428b-be52-d8924972c2e7 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:25.779506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30d9c7-67d9-428b-be52-d8924972c2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:25.779971 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30d9c7-67d9-428b-be52-d8924972c2e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:25.781562 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30d9c7-67d9-428b-be52-d8924972c2e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:25.783675 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30d9c7-67d9-428b-be52-d8924972c2e7 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:25.786204 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 73/140] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:58:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:25.792461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917259f4-dc66-4b3d-8c33-224e0493b2f8 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:25.913576 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917259f4-dc66-4b3d-8c33-224e0493b2f8 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:25.945619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:25.955500 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc06d69-a2a1-4251-a349-07b2ac67fe0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:25.956150 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc06d69-a2a1-4251-a349-07b2ac67fe0c None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:25.956522 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc06d69-a2a1-4251-a349-07b2ac67fe0c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:25.956760 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc06d69-a2a1-4251-a349-07b2ac67fe0c None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:25.957540 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc06d69-a2a1-4251-a349-07b2ac67fe0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:25.959500 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc06d69-a2a1-4251-a349-07b2ac67fe0c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:25.985272 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 68/141] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 13 13:58:25 2022] POST /identity/v3/users => generated 283 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 13:58:26.064866 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb1bc7-7113-4836-a79c-851bfb316871 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:26.065403 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb1bc7-7113-4836-a79c-851bfb316871 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:26.065474 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb1bc7-7113-4836-a79c-851bfb316871 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:26.067034 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 74/142] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:26.073716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4793cbb-fd2c-4033-b864-95f02b35239d None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:26.074361 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4793cbb-fd2c-4033-b864-95f02b35239d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:26.074361 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4793cbb-fd2c-4033-b864-95f02b35239d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:26.098148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-d4793cbb-fd2c-4033-b864-95f02b35239d None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:26.099507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d4793cbb-fd2c-4033-b864-95f02b35239d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:26.187801 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 69/143] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:26.471661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb1bc7-7113-4836-a79c-851bfb316871 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:26.589576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:26.606748 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb1bc7-7113-4836-a79c-851bfb316871 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:26.667194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e6aa2-c4cf-4496-b36b-9bf04e132d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:26.667837 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e6aa2-c4cf-4496-b36b-9bf04e132d2f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:26.668117 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e6aa2-c4cf-4496-b36b-9bf04e132d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:26.668393 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e6aa2-c4cf-4496-b36b-9bf04e132d2f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:26.683461 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e6aa2-c4cf-4496-b36b-9bf04e132d2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:26.688377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-0e8e6aa2-c4cf-4496-b36b-9bf04e132d2f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 13:58:26.688377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:26.688377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:26.688377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:26.688377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:26.688377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:26.688377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:26.688377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:26.688377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:26.688377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:26.688377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:26.688377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:26.688377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:26.688377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:26.688377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:26.688377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:26.689250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:26.689250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:26.689250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:26.689250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:26.689250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:26.689250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:26.689250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:26.689250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:26.689250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:26.689250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:26.689250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:26.689250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:26.689250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:26.689250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:26.689250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:26.689250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:26.689989 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:26.689989 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:26.689989 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:26.689989 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:26.689989 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:26.689989 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:26.689989 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:26.689989 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:26.689989 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:26.689989 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:26.689989 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 13:58:26.689989 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:58:26.689989 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 75/144] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:26.695853 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4793cbb-fd2c-4033-b864-95f02b35239d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:26.827698 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4793cbb-fd2c-4033-b864-95f02b35239d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:26.844678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:26.870500 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409f418-ba1d-4c85-b018-1988df7479cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:26.871109 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409f418-ba1d-4c85-b018-1988df7479cc None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:26.871384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409f418-ba1d-4c85-b018-1988df7479cc None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:26.871651 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409f418-ba1d-4c85-b018-1988df7479cc None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:26.872315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409f418-ba1d-4c85-b018-1988df7479cc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:26.872614 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409f418-ba1d-4c85-b018-1988df7479cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:26.874016 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409f418-ba1d-4c85-b018-1988df7479cc None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:26.884421 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 70/145] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 13 13:58:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:26.889924 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e6aa2-c4cf-4496-b36b-9bf04e132d2f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:27.030064 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e6aa2-c4cf-4496-b36b-9bf04e132d2f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:27.068632 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407108e2-be5e-438c-abdb-56324c8a5297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:27.069361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407108e2-be5e-438c-abdb-56324c8a5297 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:27.069648 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407108e2-be5e-438c-abdb-56324c8a5297 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:27.069920 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407108e2-be5e-438c-abdb-56324c8a5297 None admin] PATH_INFO: `/v3/users/3a03cc7520334437b3dfcedfecb8fbfd` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:27.071168 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407108e2-be5e-438c-abdb-56324c8a5297 None admin] RBAC: Authorizing `identity:get_user(user_id=3a03cc7520334437b3dfcedfecb8fbfd)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:27.072696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407108e2-be5e-438c-abdb-56324c8a5297 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:27.074639 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 76/146] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:26 2022] GET /identity/v3/users/3a03cc7520334437b3dfcedfecb8fbfd => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:27.080346 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409f418-ba1d-4c85-b018-1988df7479cc None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:27.193196 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409f418-ba1d-4c85-b018-1988df7479cc None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:27.211323 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a87a8e-76a2-4967-a8dc-7b7f79ccc49a None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:27.211620 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a87a8e-76a2-4967-a8dc-7b7f79ccc49a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:27.211869 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a87a8e-76a2-4967-a8dc-7b7f79ccc49a None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:27.213499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 77/147] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:27.218291 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f26a2-966a-483c-a456-14aa5907836d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:27.218568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f26a2-966a-483c-a456-14aa5907836d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:27.218838 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f26a2-966a-483c-a456-14aa5907836d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:27.245017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-084f26a2-966a-483c-a456-14aa5907836d None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:27.246240 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-084f26a2-966a-483c-a456-14aa5907836d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:27.260803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f6fc4-4b1c-4c11-9a87-e5b26bdd119b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:27.261484 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f6fc4-4b1c-4c11-9a87-e5b26bdd119b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:27.261762 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f6fc4-4b1c-4c11-9a87-e5b26bdd119b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:27.262030 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f6fc4-4b1c-4c11-9a87-e5b26bdd119b None admin] PATH_INFO: `/v3/projects/1aeb29de324e4f558c8157b5cd66f520` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:27.264817 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f6fc4-4b1c-4c11-9a87-e5b26bdd119b None admin] RBAC: Authorizing `identity:get_project(project_id=1aeb29de324e4f558c8157b5cd66f520)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:27.266301 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f6fc4-4b1c-4c11-9a87-e5b26bdd119b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:27.267966 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 71/148] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:27 2022] GET /identity/v3/projects/1aeb29de324e4f558c8157b5cd66f520 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:27.276176 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f6fc4-4b1c-4c11-9a87-e5b26bdd119b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:27.281475 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:27.348979 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:27.382308 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 78/149] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 13:58:27.432098 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f6fc4-4b1c-4c11-9a87-e5b26bdd119b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:27.481848 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e52607-31d1-40af-89d0-cc1969521423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:27.482516 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e52607-31d1-40af-89d0-cc1969521423 None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:27.482789 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e52607-31d1-40af-89d0-cc1969521423 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:27.483060 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e52607-31d1-40af-89d0-cc1969521423 None admin] PATH_INFO: `/v3/projects/1aeb29de324e4f558c8157b5cd66f520/users/3a03cc7520334437b3dfcedfecb8fbfd/roles/d11e68c76f6d4095a93949ee841afead` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:27.485036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e52607-31d1-40af-89d0-cc1969521423 None admin] RBAC: Authorizing `identity:create_grant(project_id=1aeb29de324e4f558c8157b5cd66f520, user_id=3a03cc7520334437b3dfcedfecb8fbfd, role_id=d11e68c76f6d4095a93949ee841afead)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:27.486531 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e52607-31d1-40af-89d0-cc1969521423 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:27.514268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 72/150] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 13 13:58:27 2022] PUT /identity/v3/projects/1aeb29de324e4f558c8157b5cd66f520/users/3a03cc7520334437b3dfcedfecb8fbfd/roles/d11e68c76f6d4095a93949ee841afead => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 13:58:27.972700 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f26a2-966a-483c-a456-14aa5907836d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:28.081722 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f26a2-966a-483c-a456-14aa5907836d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:28.121283 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af6fef-b77a-4380-8406-932409f77bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:28.121930 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af6fef-b77a-4380-8406-932409f77bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:28.122208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af6fef-b77a-4380-8406-932409f77bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:28.122480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af6fef-b77a-4380-8406-932409f77bc6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:28.136376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af6fef-b77a-4380-8406-932409f77bc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:28.141362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-11af6fef-b77a-4380-8406-932409f77bc6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:58:28.141362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:28.141362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:28.141362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:28.141362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:28.141362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:28.141362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:28.141362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:28.141362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:28.141362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:28.141362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:28.141362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:28.141362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:28.141362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:28.141362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:28.141362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:28.142220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:28.142220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:28.142220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:28.142220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:28.142220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:28.142220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:28.142220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:28.142220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:28.142220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:28.142220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:28.142220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:28.142220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:28.142220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:28.142220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:28.142220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:28.142220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:28.142994 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:28.142994 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:28.142994 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:28.142994 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:28.142994 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:28.142994 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:28.142994 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:28.142994 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:28.142994 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:28.142994 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:28.142994 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:58:28.142994 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:58:28.142994 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 79/151] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:28.150071 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e52607-31d1-40af-89d0-cc1969521423 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:28.303210 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:28.306825 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e52607-31d1-40af-89d0-cc1969521423 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:28.351514 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74945a8d-b7e7-4bf6-b503-52ef5d154e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:28.352117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74945a8d-b7e7-4bf6-b503-52ef5d154e50 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:28.352390 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74945a8d-b7e7-4bf6-b503-52ef5d154e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:28.352656 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74945a8d-b7e7-4bf6-b503-52ef5d154e50 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:28.353346 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74945a8d-b7e7-4bf6-b503-52ef5d154e50 None admin] RBAC: Adding query filter params (name=member) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:28.353644 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74945a8d-b7e7-4bf6-b503-52ef5d154e50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:28.355017 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74945a8d-b7e7-4bf6-b503-52ef5d154e50 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:28.366187 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 73/152] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 13 13:58:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:28.374215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af6fef-b77a-4380-8406-932409f77bc6 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:28.387130 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:28.532303 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af6fef-b77a-4380-8406-932409f77bc6 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:28.571071 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95975c13-fa0b-4b3e-993b-72bb585b79cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:28.571619 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95975c13-fa0b-4b3e-993b-72bb585b79cd None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:28.571955 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95975c13-fa0b-4b3e-993b-72bb585b79cd None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:28.572267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95975c13-fa0b-4b3e-993b-72bb585b79cd None admin] PATH_INFO: `/v3/users/c34f788e4ffe4f7aad092b4dfbe64357` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:28.573423 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95975c13-fa0b-4b3e-993b-72bb585b79cd None admin] RBAC: Authorizing `identity:get_user(user_id=c34f788e4ffe4f7aad092b4dfbe64357)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:28.575226 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95975c13-fa0b-4b3e-993b-72bb585b79cd None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:28.576844 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 80/153] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:28 2022] GET /identity/v3/users/c34f788e4ffe4f7aad092b4dfbe64357 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:28.582531 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74945a8d-b7e7-4bf6-b503-52ef5d154e50 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:28.717362 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74945a8d-b7e7-4bf6-b503-52ef5d154e50 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:28.753319 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472d953-e10a-4926-91d3-ab27e446ac39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:28.753933 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472d953-e10a-4926-91d3-ab27e446ac39 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:28.754212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472d953-e10a-4926-91d3-ab27e446ac39 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:28.754484 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472d953-e10a-4926-91d3-ab27e446ac39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:28.786638 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:28.836723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472d953-e10a-4926-91d3-ab27e446ac39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:28.838157 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472d953-e10a-4926-91d3-ab27e446ac39 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:28.980806 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 74/154] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:58:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:58:28.986560 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95975c13-fa0b-4b3e-993b-72bb585b79cd None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:29.109545 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:29.120618 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace93bfd-54b1-4ef3-9172-a97082cf1a00 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:29.121266 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace93bfd-54b1-4ef3-9172-a97082cf1a00 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:29.121749 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace93bfd-54b1-4ef3-9172-a97082cf1a00 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:29.123578 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 75/155] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:29.128343 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a514b6f-8b47-4c98-94d9-522e1da74f1e None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:29.128866 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a514b6f-8b47-4c98-94d9-522e1da74f1e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:29.129393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a514b6f-8b47-4c98-94d9-522e1da74f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:29.140892 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95975c13-fa0b-4b3e-993b-72bb585b79cd None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:29.168598 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-1a514b6f-8b47-4c98-94d9-522e1da74f1e None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:29.170486 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1a514b6f-8b47-4c98-94d9-522e1da74f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:29.201845 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ee35c-a1ed-4f40-9510-1ce7b8a9d009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:29.202881 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ee35c-a1ed-4f40-9510-1ce7b8a9d009 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:29.203355 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ee35c-a1ed-4f40-9510-1ce7b8a9d009 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:29.204022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ee35c-a1ed-4f40-9510-1ce7b8a9d009 None admin] PATH_INFO: `/v3/projects/1aeb29de324e4f558c8157b5cd66f520` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:29.205497 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ee35c-a1ed-4f40-9510-1ce7b8a9d009 None admin] RBAC: Authorizing `identity:get_project(project_id=1aeb29de324e4f558c8157b5cd66f520)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:29.207474 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ee35c-a1ed-4f40-9510-1ce7b8a9d009 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:29.213191 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 81/156] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:28 2022] GET /identity/v3/projects/1aeb29de324e4f558c8157b5cd66f520 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:29.214733 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d97ee-ddfd-4e35-b756-a005ac22fed8 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:29.215359 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d97ee-ddfd-4e35-b756-a005ac22fed8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:29.215839 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d97ee-ddfd-4e35-b756-a005ac22fed8 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:29.217387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 82/157] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:29.222844 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea42ae1-55b8-4520-b132-107d2af746c5 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:29.223406 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea42ae1-55b8-4520-b132-107d2af746c5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:29.223872 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea42ae1-55b8-4520-b132-107d2af746c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:29.266103 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-9ea42ae1-55b8-4520-b132-107d2af746c5 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:29.267662 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9ea42ae1-55b8-4520-b132-107d2af746c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:29.334565 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:29.374982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 76/158] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:29.376159 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a514b6f-8b47-4c98-94d9-522e1da74f1e None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:29.402481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 83/159] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 13:58:29.586053 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a514b6f-8b47-4c98-94d9-522e1da74f1e None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:29.631492 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f4185-ef0a-4fb1-a789-ca56bf090c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:29.632620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f4185-ef0a-4fb1-a789-ca56bf090c5e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:29.632931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f4185-ef0a-4fb1-a789-ca56bf090c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:29.633336 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f4185-ef0a-4fb1-a789-ca56bf090c5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:29.634222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f4185-ef0a-4fb1-a789-ca56bf090c5e None admin] RBAC: Adding query filter params (role.id=81a57b9863404b45acc1204670e387f2, scope.project.id=1aeb29de324e4f558c8157b5cd66f520, user.id=c34f788e4ffe4f7aad092b4dfbe64357) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:29.634530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f4185-ef0a-4fb1-a789-ca56bf090c5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:29.636149 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f4185-ef0a-4fb1-a789-ca56bf090c5e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:29.642734 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 77/160] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:58:29 2022] GET /identity/v3/role_assignments?user.id=c34f788e4ffe4f7aad092b4dfbe64357&scope.project.id=1aeb29de324e4f558c8157b5cd66f520&role.id=81a57b9863404b45acc1204670e387f2 => generated 608 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:29.764806 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea42ae1-55b8-4520-b132-107d2af746c5 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:29.862656 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:29.906521 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea42ae1-55b8-4520-b132-107d2af746c5 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:29.948619 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c59c3c-fe23-4ab2-9f60-b4c6ce8e8ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:29.949303 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c59c3c-fe23-4ab2-9f60-b4c6ce8e8ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:29.949577 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c59c3c-fe23-4ab2-9f60-b4c6ce8e8ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:29.949841 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c59c3c-fe23-4ab2-9f60-b4c6ce8e8ad1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:29.966971 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c59c3c-fe23-4ab2-9f60-b4c6ce8e8ad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:29.971820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-20c59c3c-fe23-4ab2-9f60-b4c6ce8e8ad1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 13:58:29.971820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:29.971820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:29.971820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:29.971820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:29.971820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:29.971820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:29.971820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:29.971820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:29.971820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:29.971820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:29.971820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:29.971820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:29.971820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:29.971820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:29.971820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:29.972716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:29.972716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:29.972716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:29.972716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:29.972716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:29.972716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:29.972716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:29.972716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:29.972716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:29.972716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:29.972716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:29.972716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:29.972716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:29.972716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:29.972716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:29.972716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:29.973492 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:29.973492 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:29.973492 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:29.973492 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:29.973492 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:29.973492 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:29.973492 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:29.973492 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:29.973492 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:29.973492 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:29.973492 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 13:58:29.973492 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:58:29.973492 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 84/161] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 13 13:58:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:29.981121 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f4185-ef0a-4fb1-a789-ca56bf090c5e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:30.054045 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c59c3c-fe23-4ab2-9f60-b4c6ce8e8ad1 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:30.067924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:30.149589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f4185-ef0a-4fb1-a789-ca56bf090c5e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:30.198335 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c563df4-c7e0-45d2-9a28-13c9a5eb6f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:30.199601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c563df4-c7e0-45d2-9a28-13c9a5eb6f76 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:30.200055 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c563df4-c7e0-45d2-9a28-13c9a5eb6f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:30.200477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c59c3c-fe23-4ab2-9f60-b4c6ce8e8ad1 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:30.200879 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c563df4-c7e0-45d2-9a28-13c9a5eb6f76 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:30.201727 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c563df4-c7e0-45d2-9a28-13c9a5eb6f76 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:30.202177 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c563df4-c7e0-45d2-9a28-13c9a5eb6f76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:30.203746 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c563df4-c7e0-45d2-9a28-13c9a5eb6f76 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:30.217063 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 78/162] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:58:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:30.222494 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c563df4-c7e0-45d2-9a28-13c9a5eb6f76 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:30.241524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:30.253795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e90ce-2947-4b8d-9914-e26d6a09f3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:30.254442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e90ce-2947-4b8d-9914-e26d6a09f3e0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:30.254723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e90ce-2947-4b8d-9914-e26d6a09f3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:30.254992 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e90ce-2947-4b8d-9914-e26d6a09f3e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:30.278864 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e90ce-2947-4b8d-9914-e26d6a09f3e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:30.284097 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-214e90ce-2947-4b8d-9914-e26d6a09f3e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:58:30.284097 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:30.284097 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:30.284097 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:30.284097 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:30.284097 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:30.284097 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:30.284097 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:30.284097 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:30.284097 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:30.284097 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:30.284097 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:30.284097 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:30.284097 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:30.284097 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:30.284097 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:30.289316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:30.289316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:30.289316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:30.289316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:30.289316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:30.289316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:30.289316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:30.289316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:30.289316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:30.289316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:30.289316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:30.289316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:30.289316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:30.289316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:30.289316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:30.289316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:30.290291 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:30.290291 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:30.290291 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:30.290291 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:30.290291 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:30.290291 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:30.290291 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:30.290291 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:30.290291 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:30.290291 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:30.290291 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:58:30.290291 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:58:30.290291 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 85/163] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 13:58:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:30.294520 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e90ce-2947-4b8d-9914-e26d6a09f3e0 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:30.373020 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c563df4-c7e0-45d2-9a28-13c9a5eb6f76 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:30.409136 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:30.424543 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971271ae-52fd-42fb-b9d7-0cf36da4e05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:30.425586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971271ae-52fd-42fb-b9d7-0cf36da4e05d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:30.426009 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971271ae-52fd-42fb-b9d7-0cf36da4e05d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:30.426446 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971271ae-52fd-42fb-b9d7-0cf36da4e05d None admin] PATH_INFO: `/v3/users/c34f788e4ffe4f7aad092b4dfbe64357` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:30.434107 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971271ae-52fd-42fb-b9d7-0cf36da4e05d None admin] RBAC: Authorizing `identity:get_user(user_id=c34f788e4ffe4f7aad092b4dfbe64357)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:30.434597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e90ce-2947-4b8d-9914-e26d6a09f3e0 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:30.436052 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971271ae-52fd-42fb-b9d7-0cf36da4e05d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:30.437943 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 79/164] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:30 2022] GET /identity/v3/users/c34f788e4ffe4f7aad092b4dfbe64357 => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:58:30.443722 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971271ae-52fd-42fb-b9d7-0cf36da4e05d None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:30.479090 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42d0c9-ca94-47e6-9de1-e432660fa605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:30.479801 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42d0c9-ca94-47e6-9de1-e432660fa605 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:30.479969 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42d0c9-ca94-47e6-9de1-e432660fa605 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:30.480307 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42d0c9-ca94-47e6-9de1-e432660fa605 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:30.480905 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42d0c9-ca94-47e6-9de1-e432660fa605 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:30.485116 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42d0c9-ca94-47e6-9de1-e432660fa605 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:30.485116 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42d0c9-ca94-47e6-9de1-e432660fa605 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:30.495541 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 86/165] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:30.501663 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42d0c9-ca94-47e6-9de1-e432660fa605 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:30.589057 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:30.596917 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971271ae-52fd-42fb-b9d7-0cf36da4e05d None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:30.649921 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6bdcce-7e8e-4d2a-a47c-85d0aaaaf5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:30.650814 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bdcce-7e8e-4d2a-a47c-85d0aaaaf5d6 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:30.651241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bdcce-7e8e-4d2a-a47c-85d0aaaaf5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:30.651666 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bdcce-7e8e-4d2a-a47c-85d0aaaaf5d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:30.659556 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42d0c9-ca94-47e6-9de1-e432660fa605 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:30.725894 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440ccd9-421a-4c08-9e53-ac8636e49236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:30.726615 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440ccd9-421a-4c08-9e53-ac8636e49236 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:30.726819 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440ccd9-421a-4c08-9e53-ac8636e49236 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:30.727091 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440ccd9-421a-4c08-9e53-ac8636e49236 None admin] PATH_INFO: `/v3/users/97bb92037c8b4cdabc69372647290362` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:30.728259 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440ccd9-421a-4c08-9e53-ac8636e49236 None admin] RBAC: Authorizing `identity:get_user(user_id=97bb92037c8b4cdabc69372647290362)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:30.729570 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:30.729770 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440ccd9-421a-4c08-9e53-ac8636e49236 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:30.731708 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 87/166] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:30 2022] GET /identity/v3/users/97bb92037c8b4cdabc69372647290362 => generated 247 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:30.732963 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c69ea-1ee9-4fb1-a479-f871455d0fa1 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:30.733274 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c69ea-1ee9-4fb1-a479-f871455d0fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:30.733542 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c69ea-1ee9-4fb1-a479-f871455d0fa1 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:30.734762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 88/167] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:30.740750 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c69ea-1ee9-4fb1-a479-f871455d0fa1 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:30.751248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6bdcce-7e8e-4d2a-a47c-85d0aaaaf5d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:30.758724 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6bdcce-7e8e-4d2a-a47c-85d0aaaaf5d6 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:30.998512 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c69ea-1ee9-4fb1-a479-f871455d0fa1 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:31.045124 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:31.078387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aab5de-f6dc-4d7d-903e-cc82d8a12943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:31.079268 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aab5de-f6dc-4d7d-903e-cc82d8a12943 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:31.079704 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aab5de-f6dc-4d7d-903e-cc82d8a12943 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:31.080100 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aab5de-f6dc-4d7d-903e-cc82d8a12943 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:31.110494 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 80/168] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:58:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:58:31.111921 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e43b6b-c7a9-4eab-8944-a571d9605369 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:31.112311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e43b6b-c7a9-4eab-8944-a571d9605369 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:31.112689 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e43b6b-c7a9-4eab-8944-a571d9605369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:31.151214 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-56e43b6b-c7a9-4eab-8944-a571d9605369 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:31.152658 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-56e43b6b-c7a9-4eab-8944-a571d9605369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:31.262750 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aab5de-f6dc-4d7d-903e-cc82d8a12943 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:31.267992 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aab5de-f6dc-4d7d-903e-cc82d8a12943 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:31.298899 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 81/169] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:31.302713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e43b6b-c7a9-4eab-8944-a571d9605369 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:31.339724 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:31.534542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e43b6b-c7a9-4eab-8944-a571d9605369 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:31.601721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619a966-1ba4-49c7-a1fd-668b0ff20eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:31.602367 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619a966-1ba4-49c7-a1fd-668b0ff20eba None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:31.602747 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619a966-1ba4-49c7-a1fd-668b0ff20eba None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:31.602931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619a966-1ba4-49c7-a1fd-668b0ff20eba None admin] PATH_INFO: `/v3/projects/1aeb29de324e4f558c8157b5cd66f520` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:31.604204 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619a966-1ba4-49c7-a1fd-668b0ff20eba None admin] RBAC: Authorizing `identity:get_project(project_id=1aeb29de324e4f558c8157b5cd66f520)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:31.605961 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619a966-1ba4-49c7-a1fd-668b0ff20eba None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:31.613492 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 82/170] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:31 2022] GET /identity/v3/projects/1aeb29de324e4f558c8157b5cd66f520 => generated 298 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:31.614652 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf897bc-8036-40e6-85c7-253f74246e5d None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:31.614934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf897bc-8036-40e6-85c7-253f74246e5d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:31.616541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf897bc-8036-40e6-85c7-253f74246e5d None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:31.617593 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 83/171] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:31.625216 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8514510-cecd-4f6d-adb9-bb3718133e8a None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:31.625578 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8514510-cecd-4f6d-adb9-bb3718133e8a None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:31.625861 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8514510-cecd-4f6d-adb9-bb3718133e8a None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:31.627370 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 84/172] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:31 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:31.628232 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8514510-cecd-4f6d-adb9-bb3718133e8a None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:31.681977 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 89/173] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:58:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 941 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 13:58:31.687264 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b6a48-d2fa-422e-84ca-b65095fd745f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:31.687264 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b6a48-d2fa-422e-84ca-b65095fd745f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:31.687264 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b6a48-d2fa-422e-84ca-b65095fd745f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:31.707347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b02b6a48-d2fa-422e-84ca-b65095fd745f None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:31.709517 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b02b6a48-d2fa-422e-84ca-b65095fd745f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:31.734330 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:31.768395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:31.793969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8514510-cecd-4f6d-adb9-bb3718133e8a None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:31.799066 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 90/174] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:31.800319 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866c46e-b2e6-4152-a2da-4446039cb992 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:31.800600 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866c46e-b2e6-4152-a2da-4446039cb992 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:31.800869 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866c46e-b2e6-4152-a2da-4446039cb992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:31.825394 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-9866c46e-b2e6-4152-a2da-4446039cb992 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:31.827057 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9866c46e-b2e6-4152-a2da-4446039cb992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:31.840591 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335823ac-98dd-4a1f-b269-29de441243c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:31.841708 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335823ac-98dd-4a1f-b269-29de441243c8 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:31.842299 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335823ac-98dd-4a1f-b269-29de441243c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:31.842831 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335823ac-98dd-4a1f-b269-29de441243c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:31.843798 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335823ac-98dd-4a1f-b269-29de441243c8 None admin] RBAC: Adding query filter params (role.id=cf8554dac8d343549802afd60c56c0d6, scope.project.id=1aeb29de324e4f558c8157b5cd66f520, user.id=c34f788e4ffe4f7aad092b4dfbe64357) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:31.844375 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335823ac-98dd-4a1f-b269-29de441243c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:31.847091 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335823ac-98dd-4a1f-b269-29de441243c8 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:31.854447 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 85/175] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:58:31 2022] GET /identity/v3/role_assignments?user.id=c34f788e4ffe4f7aad092b4dfbe64357&scope.project.id=1aeb29de324e4f558c8157b5cd66f520&role.id=cf8554dac8d343549802afd60c56c0d6 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:31.855475 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335823ac-98dd-4a1f-b269-29de441243c8 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:31.939495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 91/176] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:31.941913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866c46e-b2e6-4152-a2da-4446039cb992 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:32.051753 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335823ac-98dd-4a1f-b269-29de441243c8 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:32.111287 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:32.117489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4770f-c03f-45f9-8f04-6b850d55c7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:32.118385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4770f-c03f-45f9-8f04-6b850d55c7d8 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:32.118875 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4770f-c03f-45f9-8f04-6b850d55c7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:32.119811 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4770f-c03f-45f9-8f04-6b850d55c7d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:32.133130 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866c46e-b2e6-4152-a2da-4446039cb992 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:32.134180 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4770f-c03f-45f9-8f04-6b850d55c7d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:32.139060 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-6dd4770f-c03f-45f9-8f04-6b850d55c7d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:58:32.139060 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:32.139060 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:32.139060 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:32.139060 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:32.139060 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:32.139060 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:32.139060 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:32.139060 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:32.139060 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:32.139060 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:32.139060 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:32.139060 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:32.139060 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:32.139060 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:32.139060 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:32.139915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:32.139915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:32.139915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:32.139915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:32.139915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:32.139915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:32.139915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:32.139915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:32.139915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:32.139915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:32.139915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:32.139915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:32.139915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:32.139915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:32.139915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:32.139915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:32.140678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:32.140678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:32.140678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:32.140678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:32.140678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:32.140678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:32.140678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:32.140678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:32.140678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:32.140678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:32.140678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:58:32.140678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:58:32.140678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 86/177] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:32.146463 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f937b94-71d5-4647-804f-85a71c6c8591 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:32.146463 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f937b94-71d5-4647-804f-85a71c6c8591 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:32.146463 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f937b94-71d5-4647-804f-85a71c6c8591 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:32.148441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 87/178] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:32.153289 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372a9f9-1f97-4c81-9dfd-2f54215f283c None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:32.153289 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372a9f9-1f97-4c81-9dfd-2f54215f283c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:32.153289 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372a9f9-1f97-4c81-9dfd-2f54215f283c None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:32.156496 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 88/179] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:32.156496 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372a9f9-1f97-4c81-9dfd-2f54215f283c None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:32.169372 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:32.184490 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db571c3d-d2d2-413b-9bfe-995cdfaae421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:32.185336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db571c3d-d2d2-413b-9bfe-995cdfaae421 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:32.185516 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db571c3d-d2d2-413b-9bfe-995cdfaae421 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:32.185772 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db571c3d-d2d2-413b-9bfe-995cdfaae421 None admin] PATH_INFO: `/v3/projects/1aeb29de324e4f558c8157b5cd66f520` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:32.186901 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db571c3d-d2d2-413b-9bfe-995cdfaae421 None admin] RBAC: Authorizing `identity:get_project(project_id=1aeb29de324e4f558c8157b5cd66f520)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:32.188368 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db571c3d-d2d2-413b-9bfe-995cdfaae421 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:32.190044 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 92/180] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:31 2022] GET /identity/v3/projects/1aeb29de324e4f558c8157b5cd66f520 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:32.195379 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db571c3d-d2d2-413b-9bfe-995cdfaae421 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:32.268248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372a9f9-1f97-4c81-9dfd-2f54215f283c None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:32.300760 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db571c3d-d2d2-413b-9bfe-995cdfaae421 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:32.303027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39398cbc-add4-46e3-b15e-628159c50ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:32.303622 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39398cbc-add4-46e3-b15e-628159c50ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:32.303897 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39398cbc-add4-46e3-b15e-628159c50ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:32.304162 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39398cbc-add4-46e3-b15e-628159c50ff0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:32.314373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39398cbc-add4-46e3-b15e-628159c50ff0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:32.319230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-39398cbc-add4-46e3-b15e-628159c50ff0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:58:32.319230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:32.319230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:32.319230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:32.319230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:32.319230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:32.319230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:32.319230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:32.319230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:32.319230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:32.319230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:32.319230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:32.319230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:32.319230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:32.319230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:32.319230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:32.320120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:32.320120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:32.320120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:32.320120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:32.320120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:32.320120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:32.320120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:32.320120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:32.320120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:32.320120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:32.320120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:32.320120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:32.320120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:32.320120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:32.320120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:32.320120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:32.320915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:32.320915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:32.320915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:32.320915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:32.320915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:32.320915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:32.320915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:32.320915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:32.320915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:32.320915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:32.320915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:58:32.320915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:58:32.320915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 89/181] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 13:58:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:32.321604 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753784c-a7e8-400d-94d8-668a9ca47139 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:32.322146 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753784c-a7e8-400d-94d8-668a9ca47139 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:32.322146 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753784c-a7e8-400d-94d8-668a9ca47139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:32.335093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43539a47-9d3c-43b5-915c-c2914de48c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:32.335706 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43539a47-9d3c-43b5-915c-c2914de48c2f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:32.335991 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43539a47-9d3c-43b5-915c-c2914de48c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:32.336259 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43539a47-9d3c-43b5-915c-c2914de48c2f None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:32.336915 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43539a47-9d3c-43b5-915c-c2914de48c2f None admin] RBAC: Adding query filter params (name=member) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:32.337252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43539a47-9d3c-43b5-915c-c2914de48c2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:32.338614 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43539a47-9d3c-43b5-915c-c2914de48c2f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:32.339932 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-d753784c-a7e8-400d-94d8-668a9ca47139 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:32.341133 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d753784c-a7e8-400d-94d8-668a9ca47139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:32.346706 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 93/182] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 13 13:58:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:32.347931 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e43c61-ed60-40df-90c6-3c38db8f5807 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:32.348522 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e43c61-ed60-40df-90c6-3c38db8f5807 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:32.348628 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e43c61-ed60-40df-90c6-3c38db8f5807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:32.366560 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b4e43c61-ed60-40df-90c6-3c38db8f5807 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:32.367715 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b4e43c61-ed60-40df-90c6-3c38db8f5807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:32.375047 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:32.401552 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:32.406723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 90/183] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:32.416458 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753784c-a7e8-400d-94d8-668a9ca47139 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:32.452252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 94/184] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:32.452924 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e43c61-ed60-40df-90c6-3c38db8f5807 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:32.534069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753784c-a7e8-400d-94d8-668a9ca47139 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:32.569197 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb0863-7c00-4ff1-9bbe-299216b3eaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:32.569720 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb0863-7c00-4ff1-9bbe-299216b3eaa1 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:32.569993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb0863-7c00-4ff1-9bbe-299216b3eaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:32.570315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb0863-7c00-4ff1-9bbe-299216b3eaa1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:32.571060 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb0863-7c00-4ff1-9bbe-299216b3eaa1 None admin] RBAC: Adding query filter params (role.id=6dcc8495d2b24b3eab63dd656eb4eb6d, scope.project.id=1aeb29de324e4f558c8157b5cd66f520, user.id=97bb92037c8b4cdabc69372647290362) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:32.571472 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb0863-7c00-4ff1-9bbe-299216b3eaa1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:32.572972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb0863-7c00-4ff1-9bbe-299216b3eaa1 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:32.585132 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 91/185] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:58:32 2022] GET /identity/v3/role_assignments?user.id=97bb92037c8b4cdabc69372647290362&scope.project.id=1aeb29de324e4f558c8157b5cd66f520&role.id=6dcc8495d2b24b3eab63dd656eb4eb6d => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:32.585336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e43c61-ed60-40df-90c6-3c38db8f5807 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:32.585430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb0863-7c00-4ff1-9bbe-299216b3eaa1 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:32.682794 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ab176-d315-4704-a8d4-d4e2c563f8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:32.684060 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ab176-d315-4704-a8d4-d4e2c563f8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:32.685878 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ab176-d315-4704-a8d4-d4e2c563f8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:32.686380 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ab176-d315-4704-a8d4-d4e2c563f8b8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:32.695632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:32.701660 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ab176-d315-4704-a8d4-d4e2c563f8b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:32.707215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-4d8ab176-d315-4704-a8d4-d4e2c563f8b8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 13:58:32.707215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:32.707215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:32.707215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:32.707215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:32.707215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:32.707215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:32.707215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:32.707215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:32.707215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:32.707215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:32.707215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:32.707215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:32.707215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:32.707215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:32.707215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:32.708152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:32.708152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:32.708152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:32.708152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:32.708152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:32.708152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:32.708152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:32.708152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:32.708152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:32.708152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:32.708152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:32.708152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:32.708152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:32.708152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:32.708152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:32.708152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:32.708927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:32.708927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:32.708927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:32.708927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:32.708927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:32.708927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:32.708927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:32.708927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:32.708927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:32.708927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:32.708927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 13:58:32.708927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:58:32.711582 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 95/186] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:32.712646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ab176-d315-4704-a8d4-d4e2c563f8b8 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:32.716457 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:32.745376 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb0863-7c00-4ff1-9bbe-299216b3eaa1 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:32.782576 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe645a-53ed-46ab-afa5-13ab9f7dc1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:32.783441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe645a-53ed-46ab-afa5-13ab9f7dc1bd None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:32.783729 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe645a-53ed-46ab-afa5-13ab9f7dc1bd None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:32.784000 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe645a-53ed-46ab-afa5-13ab9f7dc1bd None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:32.784776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe645a-53ed-46ab-afa5-13ab9f7dc1bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:32.784974 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe645a-53ed-46ab-afa5-13ab9f7dc1bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:32.786394 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe645a-53ed-46ab-afa5-13ab9f7dc1bd None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:32.796119 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 92/187] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:32.796867 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe645a-53ed-46ab-afa5-13ab9f7dc1bd None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:32.835564 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ab176-d315-4704-a8d4-d4e2c563f8b8 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:32.872722 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179c29e-ea04-49db-b45b-fe25da27c843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:32.873385 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179c29e-ea04-49db-b45b-fe25da27c843 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:32.873665 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179c29e-ea04-49db-b45b-fe25da27c843 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:32.873939 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179c29e-ea04-49db-b45b-fe25da27c843 None admin] PATH_INFO: `/v3/users/c34f788e4ffe4f7aad092b4dfbe64357` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:32.875084 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179c29e-ea04-49db-b45b-fe25da27c843 None admin] RBAC: Authorizing `identity:get_user(user_id=c34f788e4ffe4f7aad092b4dfbe64357)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:32.876537 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179c29e-ea04-49db-b45b-fe25da27c843 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:32.878258 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 96/188] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:32 2022] GET /identity/v3/users/c34f788e4ffe4f7aad092b4dfbe64357 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:32.878258 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179c29e-ea04-49db-b45b-fe25da27c843 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:32.905851 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe645a-53ed-46ab-afa5-13ab9f7dc1bd None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:32.928420 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:32.939249 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299ac99-92c9-49ae-aa9a-dfc6eb42726e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:32.939881 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299ac99-92c9-49ae-aa9a-dfc6eb42726e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:32.940138 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299ac99-92c9-49ae-aa9a-dfc6eb42726e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:32.940402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299ac99-92c9-49ae-aa9a-dfc6eb42726e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:32.950556 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:32.950810 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299ac99-92c9-49ae-aa9a-dfc6eb42726e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:32.956027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-3299ac99-92c9-49ae-aa9a-dfc6eb42726e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 13:58:32.956027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:32.956027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:32.956027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:32.956027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:32.956027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:32.956027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:32.956027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:32.956027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:32.956027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:32.956027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:32.956027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:32.956027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:32.956027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:32.956027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:32.956027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:32.956968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:32.956968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:32.956968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:32.956968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:32.956968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:32.956968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:32.956968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:32.956968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:32.956968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:32.956968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:32.956968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:32.956968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:32.956968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:32.956968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:32.956968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:32.956968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:32.961776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:32.961776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:32.961776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:32.961776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:32.961776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:32.961776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:32.961776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:32.961776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:32.961776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:32.961776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:32.961776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 13:58:32.961776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:58:32.961776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 93/189] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 13 13:58:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:32.961776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299ac99-92c9-49ae-aa9a-dfc6eb42726e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:32.988026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179c29e-ea04-49db-b45b-fe25da27c843 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:33.021657 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f0bc6-ab45-4ca7-85eb-d70bd8c2a083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:33.023293 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f0bc6-ab45-4ca7-85eb-d70bd8c2a083 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:33.023293 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f0bc6-ab45-4ca7-85eb-d70bd8c2a083 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:33.023293 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f0bc6-ab45-4ca7-85eb-d70bd8c2a083 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:33.023583 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f0bc6-ab45-4ca7-85eb-d70bd8c2a083 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:33.023829 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f0bc6-ab45-4ca7-85eb-d70bd8c2a083 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:33.025252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f0bc6-ab45-4ca7-85eb-d70bd8c2a083 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:33.033527 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 97/190] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 13 13:58:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:33.035147 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f0bc6-ab45-4ca7-85eb-d70bd8c2a083 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:33.059273 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299ac99-92c9-49ae-aa9a-dfc6eb42726e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:33.092652 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92545cd0-3afc-4b35-98f7-343de5cee260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:33.093246 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92545cd0-3afc-4b35-98f7-343de5cee260 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:33.093530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92545cd0-3afc-4b35-98f7-343de5cee260 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:33.093804 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92545cd0-3afc-4b35-98f7-343de5cee260 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:33.094966 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92545cd0-3afc-4b35-98f7-343de5cee260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:33.096429 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92545cd0-3afc-4b35-98f7-343de5cee260 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:33.098036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 94/191] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:58:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:33.098793 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92545cd0-3afc-4b35-98f7-343de5cee260 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:33.136045 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f0bc6-ab45-4ca7-85eb-d70bd8c2a083 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:33.151718 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:33.164459 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:33.169649 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029b8dc-5594-48a9-b044-faa97ca0c1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:33.170266 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029b8dc-5594-48a9-b044-faa97ca0c1ad None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:33.170541 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029b8dc-5594-48a9-b044-faa97ca0c1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:33.170809 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029b8dc-5594-48a9-b044-faa97ca0c1ad None admin] PATH_INFO: `/v3/users/73a23d3081b541e2be4bc62612d26026` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:33.184047 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029b8dc-5594-48a9-b044-faa97ca0c1ad None admin] RBAC: Authorizing `identity:get_user(user_id=73a23d3081b541e2be4bc62612d26026)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:33.185542 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029b8dc-5594-48a9-b044-faa97ca0c1ad None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:33.187131 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 98/192] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:33 2022] GET /identity/v3/users/73a23d3081b541e2be4bc62612d26026 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:33.187884 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029b8dc-5594-48a9-b044-faa97ca0c1ad None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:33.203586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92545cd0-3afc-4b35-98f7-343de5cee260 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:33.237075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c647e-c1a3-4d6e-866f-7ecac8c849e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:33.237700 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c647e-c1a3-4d6e-866f-7ecac8c849e6 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:33.237979 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c647e-c1a3-4d6e-866f-7ecac8c849e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:33.238252 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c647e-c1a3-4d6e-866f-7ecac8c849e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:33.285248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029b8dc-5594-48a9-b044-faa97ca0c1ad None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:33.306244 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c647e-c1a3-4d6e-866f-7ecac8c849e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:33.307732 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c647e-c1a3-4d6e-866f-7ecac8c849e6 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:33.319079 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9e2ab-00ef-424d-91dd-27bcff4d300d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:33.319680 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9e2ab-00ef-424d-91dd-27bcff4d300d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:33.319959 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9e2ab-00ef-424d-91dd-27bcff4d300d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:33.320230 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9e2ab-00ef-424d-91dd-27bcff4d300d None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:33.320901 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9e2ab-00ef-424d-91dd-27bcff4d300d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:33.321232 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9e2ab-00ef-424d-91dd-27bcff4d300d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:33.322599 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9e2ab-00ef-424d-91dd-27bcff4d300d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:33.331013 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 99/193] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:58:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:33.331955 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9e2ab-00ef-424d-91dd-27bcff4d300d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:33.358743 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:33.384324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:33.407267 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 95/194] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:58:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:58:33.408058 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c647e-c1a3-4d6e-866f-7ecac8c849e6 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:33.436140 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9e2ab-00ef-424d-91dd-27bcff4d300d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:33.469908 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293cdf4-9061-4d8c-8c3e-7f87dba8a51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:33.470538 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293cdf4-9061-4d8c-8c3e-7f87dba8a51e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:33.470820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293cdf4-9061-4d8c-8c3e-7f87dba8a51e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:33.471100 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293cdf4-9061-4d8c-8c3e-7f87dba8a51e None admin] PATH_INFO: `/v3/users/3a03cc7520334437b3dfcedfecb8fbfd` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:33.472231 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293cdf4-9061-4d8c-8c3e-7f87dba8a51e None admin] RBAC: Authorizing `identity:get_user(user_id=3a03cc7520334437b3dfcedfecb8fbfd)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:33.473717 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293cdf4-9061-4d8c-8c3e-7f87dba8a51e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:33.475326 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 100/195] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:33 2022] GET /identity/v3/users/3a03cc7520334437b3dfcedfecb8fbfd => generated 289 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:33.476086 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293cdf4-9061-4d8c-8c3e-7f87dba8a51e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:33.507807 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c647e-c1a3-4d6e-866f-7ecac8c849e6 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:33.541204 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864b852-3dae-4099-bd6f-f7ff6fa231d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:33.541792 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864b852-3dae-4099-bd6f-f7ff6fa231d3 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:33.542073 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864b852-3dae-4099-bd6f-f7ff6fa231d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:33.542341 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864b852-3dae-4099-bd6f-f7ff6fa231d3 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:33.542972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864b852-3dae-4099-bd6f-f7ff6fa231d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:33.544412 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864b852-3dae-4099-bd6f-f7ff6fa231d3 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:33.564404 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 96/196] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 13 13:58:33 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 13:58:33.564404 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864b852-3dae-4099-bd6f-f7ff6fa231d3 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:33.580293 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293cdf4-9061-4d8c-8c3e-7f87dba8a51e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:33.584284 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:33.608518 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:33.628618 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39634208-c8f1-4229-816c-7a006d788d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:33.629251 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39634208-c8f1-4229-816c-7a006d788d6c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:33.629538 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39634208-c8f1-4229-816c-7a006d788d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:33.629811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39634208-c8f1-4229-816c-7a006d788d6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:33.690756 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864b852-3dae-4099-bd6f-f7ff6fa231d3 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:33.705207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39634208-c8f1-4229-816c-7a006d788d6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:33.706724 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39634208-c8f1-4229-816c-7a006d788d6c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:33.728099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d07985-09ec-421d-86f8-cc0ee5e902e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:33.728741 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d07985-09ec-421d-86f8-cc0ee5e902e5 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:33.729082 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d07985-09ec-421d-86f8-cc0ee5e902e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:33.729337 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d07985-09ec-421d-86f8-cc0ee5e902e5 None admin] PATH_INFO: `/v3/users/73a23d3081b541e2be4bc62612d26026` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:33.730553 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d07985-09ec-421d-86f8-cc0ee5e902e5 None admin] RBAC: Authorizing `identity:get_user(user_id=73a23d3081b541e2be4bc62612d26026)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:33.732029 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d07985-09ec-421d-86f8-cc0ee5e902e5 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:33.733677 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 97/197] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:33 2022] GET /identity/v3/users/73a23d3081b541e2be4bc62612d26026 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:33.738969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d07985-09ec-421d-86f8-cc0ee5e902e5 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:33.823611 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 101/198] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:58:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:58:33.824480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39634208-c8f1-4229-816c-7a006d788d6c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:33.850302 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:33.853287 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:33.889837 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d07985-09ec-421d-86f8-cc0ee5e902e5 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:33.930580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6680fa9-3532-4ad4-b02a-07fe6837db4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:33.931209 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6680fa9-3532-4ad4-b02a-07fe6837db4c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:33.931656 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6680fa9-3532-4ad4-b02a-07fe6837db4c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:33.931939 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6680fa9-3532-4ad4-b02a-07fe6837db4c None admin] PATH_INFO: `/v3/projects/18cc10c3eead460daa9734276c74cdb4` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:33.933893 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6680fa9-3532-4ad4-b02a-07fe6837db4c None admin] RBAC: Authorizing `identity:get_project(project_id=18cc10c3eead460daa9734276c74cdb4)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:33.934870 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6680fa9-3532-4ad4-b02a-07fe6837db4c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:33.938176 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 98/199] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:33 2022] GET /identity/v3/projects/18cc10c3eead460daa9734276c74cdb4 => generated 312 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:33.938956 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6680fa9-3532-4ad4-b02a-07fe6837db4c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:33.951899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39634208-c8f1-4229-816c-7a006d788d6c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:33.993393 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7495f6d-5bc9-435d-818c-88ab994e2a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:33.994016 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7495f6d-5bc9-435d-818c-88ab994e2a66 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:33.994297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7495f6d-5bc9-435d-818c-88ab994e2a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:33.994571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7495f6d-5bc9-435d-818c-88ab994e2a66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:34.066460 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6680fa9-3532-4ad4-b02a-07fe6837db4c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:34.074572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7495f6d-5bc9-435d-818c-88ab994e2a66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:34.076065 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7495f6d-5bc9-435d-818c-88ab994e2a66 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:34.103091 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93874c12-b96d-42ae-bc4c-f04357999f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:34.103963 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93874c12-b96d-42ae-bc4c-f04357999f4d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:34.104435 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93874c12-b96d-42ae-bc4c-f04357999f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:34.104547 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:34.105391 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93874c12-b96d-42ae-bc4c-f04357999f4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:34.123330 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:34.188688 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93874c12-b96d-42ae-bc4c-f04357999f4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:34.190806 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93874c12-b96d-42ae-bc4c-f04357999f4d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:34.214650 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 102/200] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:58:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:58:34.215812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7495f6d-5bc9-435d-818c-88ab994e2a66 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:34.309750 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 99/201] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:58:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:58:34.310433 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93874c12-b96d-42ae-bc4c-f04357999f4d None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:34.353982 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7495f6d-5bc9-435d-818c-88ab994e2a66 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:34.362973 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:34.387575 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:34.407944 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968f8c8-29b7-4d69-927c-e0fbd76563da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:34.409667 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968f8c8-29b7-4d69-927c-e0fbd76563da None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:34.410380 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968f8c8-29b7-4d69-927c-e0fbd76563da None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:34.410835 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968f8c8-29b7-4d69-927c-e0fbd76563da None admin] PATH_INFO: `/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:34.413363 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6968f8c8-29b7-4d69-927c-e0fbd76563da None admin] RBAC: Authorizing `identity:get_project(project_id=11155a320d8a4d4bb8eebe5129dd9cf8)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:34.414847 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6968f8c8-29b7-4d69-927c-e0fbd76563da None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:34.421719 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 103/202] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:34 2022] GET /identity/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:34.421719 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968f8c8-29b7-4d69-927c-e0fbd76563da None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:34.440441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93874c12-b96d-42ae-bc4c-f04357999f4d None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:34.484283 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437f6a3-aeae-4dea-8708-f1f8d15c88fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:34.485208 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437f6a3-aeae-4dea-8708-f1f8d15c88fb None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:34.485729 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437f6a3-aeae-4dea-8708-f1f8d15c88fb None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:34.486183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437f6a3-aeae-4dea-8708-f1f8d15c88fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:34.487247 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437f6a3-aeae-4dea-8708-f1f8d15c88fb None admin] RBAC: Adding query filter params (role.id=81a57b9863404b45acc1204670e387f2, scope.project.id=18cc10c3eead460daa9734276c74cdb4, user.id=c34f788e4ffe4f7aad092b4dfbe64357) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:34.487744 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437f6a3-aeae-4dea-8708-f1f8d15c88fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:34.490109 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437f6a3-aeae-4dea-8708-f1f8d15c88fb None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:34.499224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 100/203] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:58:34 2022] GET /identity/v3/role_assignments?user.id=c34f788e4ffe4f7aad092b4dfbe64357&scope.project.id=18cc10c3eead460daa9734276c74cdb4&role.id=81a57b9863404b45acc1204670e387f2 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:34.500312 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437f6a3-aeae-4dea-8708-f1f8d15c88fb None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:34.542928 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968f8c8-29b7-4d69-927c-e0fbd76563da None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:34.633375 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6127c4-f5aa-4a8a-bebd-2d7975acb76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:34.634567 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6127c4-f5aa-4a8a-bebd-2d7975acb76b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:34.634987 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6127c4-f5aa-4a8a-bebd-2d7975acb76b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:34.635413 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6127c4-f5aa-4a8a-bebd-2d7975acb76b None admin] PATH_INFO: `/v3/projects/1aeb29de324e4f558c8157b5cd66f520` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:34.637178 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6127c4-f5aa-4a8a-bebd-2d7975acb76b None admin] RBAC: Authorizing `identity:get_project(project_id=1aeb29de324e4f558c8157b5cd66f520)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:34.638893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6127c4-f5aa-4a8a-bebd-2d7975acb76b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:34.640831 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 104/204] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:34 2022] GET /identity/v3/projects/1aeb29de324e4f558c8157b5cd66f520 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:34.645241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437f6a3-aeae-4dea-8708-f1f8d15c88fb None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:34.646312 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6127c4-f5aa-4a8a-bebd-2d7975acb76b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:34.652811 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:34.687333 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c0292-d72f-4f36-8dfe-df9f71562f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:34.688008 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c0292-d72f-4f36-8dfe-df9f71562f4b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:34.688301 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c0292-d72f-4f36-8dfe-df9f71562f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:34.688574 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c0292-d72f-4f36-8dfe-df9f71562f4b None admin] PATH_INFO: `/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:34.690181 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c0292-d72f-4f36-8dfe-df9f71562f4b None admin] RBAC: Authorizing `identity:get_project(project_id=11155a320d8a4d4bb8eebe5129dd9cf8)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:34.691898 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c0292-d72f-4f36-8dfe-df9f71562f4b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:34.694554 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 101/205] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:34 2022] GET /identity/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:34.695400 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c0292-d72f-4f36-8dfe-df9f71562f4b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:34.743955 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:34.798568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6127c4-f5aa-4a8a-bebd-2d7975acb76b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:34.830058 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c0292-d72f-4f36-8dfe-df9f71562f4b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:34.842135 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd343c-e610-4639-87dd-5a663342b9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:34.842734 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd343c-e610-4639-87dd-5a663342b9e9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:34.843015 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd343c-e610-4639-87dd-5a663342b9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:34.843285 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd343c-e610-4639-87dd-5a663342b9e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:34.844348 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd343c-e610-4639-87dd-5a663342b9e9 None admin] RBAC: Adding query filter params (role.id=6dcc8495d2b24b3eab63dd656eb4eb6d, scope.project.id=11155a320d8a4d4bb8eebe5129dd9cf8, user.id=73a23d3081b541e2be4bc62612d26026) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:34.844681 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd343c-e610-4639-87dd-5a663342b9e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:34.846442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd343c-e610-4639-87dd-5a663342b9e9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:34.853716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 105/206] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:58:34 2022] GET /identity/v3/role_assignments?user.id=73a23d3081b541e2be4bc62612d26026&scope.project.id=11155a320d8a4d4bb8eebe5129dd9cf8&role.id=6dcc8495d2b24b3eab63dd656eb4eb6d => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:34.854529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd343c-e610-4639-87dd-5a663342b9e9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:34.895781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a66fd-7af7-46b4-8ce8-cf007cf0938d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:34.896832 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a66fd-7af7-46b4-8ce8-cf007cf0938d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:34.897898 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a66fd-7af7-46b4-8ce8-cf007cf0938d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:34.898372 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a66fd-7af7-46b4-8ce8-cf007cf0938d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:34.899452 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a66fd-7af7-46b4-8ce8-cf007cf0938d None admin] RBAC: Adding query filter params (role.id=d11e68c76f6d4095a93949ee841afead, scope.project.id=1aeb29de324e4f558c8157b5cd66f520, user.id=3a03cc7520334437b3dfcedfecb8fbfd) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:34.901624 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a66fd-7af7-46b4-8ce8-cf007cf0938d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:34.904388 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a66fd-7af7-46b4-8ce8-cf007cf0938d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:34.921427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 102/207] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:58:34 2022] GET /identity/v3/role_assignments?user.id=3a03cc7520334437b3dfcedfecb8fbfd&scope.project.id=1aeb29de324e4f558c8157b5cd66f520&role.id=d11e68c76f6d4095a93949ee841afead => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:35.035628 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd343c-e610-4639-87dd-5a663342b9e9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:35.066874 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:35.089264 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003e6a4-32e1-4508-9ade-c538c9678daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:35.089502 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003e6a4-32e1-4508-9ade-c538c9678daf None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:35.089713 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003e6a4-32e1-4508-9ade-c538c9678daf None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:35.089921 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003e6a4-32e1-4508-9ade-c538c9678daf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:35.090666 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003e6a4-32e1-4508-9ade-c538c9678daf None admin] RBAC: Adding query filter params (role.id=cf8554dac8d343549802afd60c56c0d6, scope.project.id=11155a320d8a4d4bb8eebe5129dd9cf8, user.id=73a23d3081b541e2be4bc62612d26026) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:35.090980 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003e6a4-32e1-4508-9ade-c538c9678daf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:35.092514 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003e6a4-32e1-4508-9ade-c538c9678daf None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:35.099545 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 106/208] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:58:34 2022] GET /identity/v3/role_assignments?user.id=73a23d3081b541e2be4bc62612d26026&scope.project.id=11155a320d8a4d4bb8eebe5129dd9cf8&role.id=cf8554dac8d343549802afd60c56c0d6 => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:36.065363 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6753c89-40d3-45fa-8829-6e2abf40e09b None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:36.065879 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6753c89-40d3-45fa-8829-6e2abf40e09b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:36.065879 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6753c89-40d3-45fa-8829-6e2abf40e09b None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:36.067687 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 103/209] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:36.075395 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2213fbb-8ad7-438a-ac49-ba02aa3b369c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:36.075895 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2213fbb-8ad7-438a-ac49-ba02aa3b369c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:36.075965 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2213fbb-8ad7-438a-ac49-ba02aa3b369c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:36.095262 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c2213fbb-8ad7-438a-ac49-ba02aa3b369c None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:36.096437 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c2213fbb-8ad7-438a-ac49-ba02aa3b369c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:36.101525 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adf3af-8b18-4de6-8d78-ddf629f79d57 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:36.101801 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adf3af-8b18-4de6-8d78-ddf629f79d57 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:36.102064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adf3af-8b18-4de6-8d78-ddf629f79d57 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:36.103396 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 104/210] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:36.108284 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd942fb8-159a-4ea2-bb49-b1ed36943741 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:36.108555 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd942fb8-159a-4ea2-bb49-b1ed36943741 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:36.108824 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd942fb8-159a-4ea2-bb49-b1ed36943741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:36.133146 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-bd942fb8-159a-4ea2-bb49-b1ed36943741 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:36.134965 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-bd942fb8-159a-4ea2-bb49-b1ed36943741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:36.172975 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 107/211] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:36.209951 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:36.214083 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 105/212] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 13:58:36.446252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2213fbb-8ad7-438a-ac49-ba02aa3b369c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:36.505469 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd942fb8-159a-4ea2-bb49-b1ed36943741 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:36.554153 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2213fbb-8ad7-438a-ac49-ba02aa3b369c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:36.569578 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:36.591069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be858e-daed-4caa-9b40-f545e2701de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:36.591496 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be858e-daed-4caa-9b40-f545e2701de7 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:36.591774 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be858e-daed-4caa-9b40-f545e2701de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:36.592047 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be858e-daed-4caa-9b40-f545e2701de7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:36.593207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be858e-daed-4caa-9b40-f545e2701de7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:36.594669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be858e-daed-4caa-9b40-f545e2701de7 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:36.602032 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 108/213] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:58:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:36.603287 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be858e-daed-4caa-9b40-f545e2701de7 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:36.641675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd942fb8-159a-4ea2-bb49-b1ed36943741 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:36.681137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293906d-a4b1-43c7-a190-5c36061bb58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:36.681772 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293906d-a4b1-43c7-a190-5c36061bb58b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:36.682050 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293906d-a4b1-43c7-a190-5c36061bb58b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:36.682321 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293906d-a4b1-43c7-a190-5c36061bb58b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:36.694294 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293906d-a4b1-43c7-a190-5c36061bb58b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:36.699660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-4293906d-a4b1-43c7-a190-5c36061bb58b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:58:36.699660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:36.699660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:36.699660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:36.699660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:36.699660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:36.699660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:36.699660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:36.699660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:36.699660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:36.699660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:36.699660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:36.699660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:36.699660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:36.699660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:36.699660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:36.700507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:36.700507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:36.700507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:36.700507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:36.700507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:36.700507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:36.700507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:36.700507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:36.700507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:36.700507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:36.700507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:36.700507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:36.700507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:36.700507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:36.700507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:36.700507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:36.701323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:36.701323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:36.701323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:36.701323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:36.701323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:36.701323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:36.701323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:36.701323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:36.701323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:36.701323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:36.701323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:58:36.701323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:58:36.701323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 106/214] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:36.708116 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293906d-a4b1-43c7-a190-5c36061bb58b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:36.728910 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be858e-daed-4caa-9b40-f545e2701de7 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:36.741991 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:36.771258 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b7bc1-351b-4541-8553-11707b8523a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:36.772280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b7bc1-351b-4541-8553-11707b8523a3 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:36.772772 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b7bc1-351b-4541-8553-11707b8523a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:36.773299 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b7bc1-351b-4541-8553-11707b8523a3 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:36.774243 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b7bc1-351b-4541-8553-11707b8523a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:36.775947 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b7bc1-351b-4541-8553-11707b8523a3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:36.809522 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 109/215] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 13 13:58:36 2022] POST /identity/v3/users => generated 297 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 13:58:36.822161 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293906d-a4b1-43c7-a190-5c36061bb58b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:36.862500 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f766a4-72f5-43fd-858e-71384dc906c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:36.863181 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f766a4-72f5-43fd-858e-71384dc906c9 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:36.863463 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f766a4-72f5-43fd-858e-71384dc906c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:36.863734 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f766a4-72f5-43fd-858e-71384dc906c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:36.864430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f766a4-72f5-43fd-858e-71384dc906c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:36.864734 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f766a4-72f5-43fd-858e-71384dc906c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:36.866892 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f766a4-72f5-43fd-858e-71384dc906c9 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:36.877248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 107/216] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 13 13:58:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:58:36.883440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b7bc1-351b-4541-8553-11707b8523a3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:36.931029 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:37.000457 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b7bc1-351b-4541-8553-11707b8523a3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:37.044997 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9151e7-a83d-4373-9c7a-326d208e67f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:37.045719 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9151e7-a83d-4373-9c7a-326d208e67f5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:37.046003 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9151e7-a83d-4373-9c7a-326d208e67f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:37.046269 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9151e7-a83d-4373-9c7a-326d208e67f5 None admin] PATH_INFO: `/v3/users/49a01eede041408a9a2c1166eb93ab46` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:37.062185 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9151e7-a83d-4373-9c7a-326d208e67f5 None admin] RBAC: Authorizing `identity:get_user(user_id=49a01eede041408a9a2c1166eb93ab46)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:37.063795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9151e7-a83d-4373-9c7a-326d208e67f5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:37.065537 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 110/217] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:36 2022] GET /identity/v3/users/49a01eede041408a9a2c1166eb93ab46 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:37.071848 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f766a4-72f5-43fd-858e-71384dc906c9 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:37.176402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:37.185660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f766a4-72f5-43fd-858e-71384dc906c9 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:37.221418 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66795f2b-4928-4b94-9bd2-a47cf8b4caff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:37.222041 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66795f2b-4928-4b94-9bd2-a47cf8b4caff None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:37.222323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66795f2b-4928-4b94-9bd2-a47cf8b4caff None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:37.222586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66795f2b-4928-4b94-9bd2-a47cf8b4caff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:37.252687 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1cbee-5402-4e9e-a3ee-d73453069dd8 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:37.253180 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1cbee-5402-4e9e-a3ee-d73453069dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:37.253180 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1cbee-5402-4e9e-a3ee-d73453069dd8 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:37.254539 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 111/218] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 13:58:37.260894 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e6d2f-88d2-4fd9-ad7d-4da90072b9be None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:37.261438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e6d2f-88d2-4fd9-ad7d-4da90072b9be None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:37.261895 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e6d2f-88d2-4fd9-ad7d-4da90072b9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:37.292560 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ed3e6d2f-88d2-4fd9-ad7d-4da90072b9be None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:37.294470 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ed3e6d2f-88d2-4fd9-ad7d-4da90072b9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:37.311221 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66795f2b-4928-4b94-9bd2-a47cf8b4caff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:37.312717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66795f2b-4928-4b94-9bd2-a47cf8b4caff None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:37.380586 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 112/219] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 13:58:37.413745 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:37.417278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0141f-5e37-441d-a4f3-cba968e67dcc None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:37.417788 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0141f-5e37-441d-a4f3-cba968e67dcc None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:37.418264 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0141f-5e37-441d-a4f3-cba968e67dcc None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:37.420121 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 113/220] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:37.423925 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 108/221] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:58:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:58:37.425430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a2a2b-cfb8-4940-8e39-f09bd4430042 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:37.425710 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a2a2b-cfb8-4940-8e39-f09bd4430042 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:37.425979 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a2a2b-cfb8-4940-8e39-f09bd4430042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:37.429959 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66795f2b-4928-4b94-9bd2-a47cf8b4caff None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:37.445066 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-369a2a2b-cfb8-4940-8e39-f09bd4430042 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:37.446276 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-369a2a2b-cfb8-4940-8e39-f09bd4430042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:37.485315 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:37.541047 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66795f2b-4928-4b94-9bd2-a47cf8b4caff None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:37.583117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156abb5e-65c6-4879-8203-06b998b0b8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:37.583747 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156abb5e-65c6-4879-8203-06b998b0b8e9 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:37.584025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156abb5e-65c6-4879-8203-06b998b0b8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:37.584798 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156abb5e-65c6-4879-8203-06b998b0b8e9 None admin] PATH_INFO: `/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:37.586681 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156abb5e-65c6-4879-8203-06b998b0b8e9 None admin] RBAC: Authorizing `identity:get_project(project_id=11155a320d8a4d4bb8eebe5129dd9cf8)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:37.588135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156abb5e-65c6-4879-8203-06b998b0b8e9 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:37.590542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 109/222] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:37 2022] GET /identity/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:58:37.596588 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156abb5e-65c6-4879-8203-06b998b0b8e9 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:37.599007 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 114/223] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:37.664473 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:37.674826 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a2a2b-cfb8-4940-8e39-f09bd4430042 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:37.723385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156abb5e-65c6-4879-8203-06b998b0b8e9 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:37.790095 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578b574-071f-4d56-ac66-4d3e4332edc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:37.790940 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578b574-071f-4d56-ac66-4d3e4332edc4 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:37.791433 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578b574-071f-4d56-ac66-4d3e4332edc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:37.791842 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578b574-071f-4d56-ac66-4d3e4332edc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:37.793896 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578b574-071f-4d56-ac66-4d3e4332edc4 None admin] RBAC: Adding query filter params (role.id=81a57b9863404b45acc1204670e387f2, scope.project.id=11155a320d8a4d4bb8eebe5129dd9cf8, user.id=49a01eede041408a9a2c1166eb93ab46) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:37.794350 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578b574-071f-4d56-ac66-4d3e4332edc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:37.795930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578b574-071f-4d56-ac66-4d3e4332edc4 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:37.808037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 110/224] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:58:37 2022] GET /identity/v3/role_assignments?user.id=49a01eede041408a9a2c1166eb93ab46&scope.project.id=11155a320d8a4d4bb8eebe5129dd9cf8&role.id=81a57b9863404b45acc1204670e387f2 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:37.826462 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a2a2b-cfb8-4940-8e39-f09bd4430042 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:37.871157 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d11148-15f9-4c53-995d-7576cc9de602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:37.872034 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d11148-15f9-4c53-995d-7576cc9de602 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:37.872455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d11148-15f9-4c53-995d-7576cc9de602 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:37.872868 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d11148-15f9-4c53-995d-7576cc9de602 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:37.883934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d11148-15f9-4c53-995d-7576cc9de602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:37.889247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-d6d11148-15f9-4c53-995d-7576cc9de602 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:58:37.889247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:37.889247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:37.889247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:37.889247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:37.889247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:37.889247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:37.889247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:37.889247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:37.889247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:37.889247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:37.889247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:37.889247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:37.889247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:37.889247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:37.889247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:37.890357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:37.890357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:37.890357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:37.890357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:37.890357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:37.890357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:37.890357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:37.890357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:37.890357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:37.890357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:37.890357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:37.890357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:37.890357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:37.890357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:37.890357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:37.890357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:37.891316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:37.891316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:37.891316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:37.891316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:37.891316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:37.891316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:37.891316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:37.891316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:37.891316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:37.891316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:37.891316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:58:37.891316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:58:37.893314 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 115/225] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 13:58:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:37.902228 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578b574-071f-4d56-ac66-4d3e4332edc4 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:38.024327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d11148-15f9-4c53-995d-7576cc9de602 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:38.051887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578b574-071f-4d56-ac66-4d3e4332edc4 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:38.057238 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:38.098888 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:38.118898 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97cdb7-ecdf-4352-a6c1-1e9595eabef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:38.119478 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97cdb7-ecdf-4352-a6c1-1e9595eabef9 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:38.119752 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97cdb7-ecdf-4352-a6c1-1e9595eabef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:38.120015 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97cdb7-ecdf-4352-a6c1-1e9595eabef9 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:38.120686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97cdb7-ecdf-4352-a6c1-1e9595eabef9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:38.120983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97cdb7-ecdf-4352-a6c1-1e9595eabef9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:38.122400 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97cdb7-ecdf-4352-a6c1-1e9595eabef9 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:38.143706 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 111/226] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:38.149233 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97cdb7-ecdf-4352-a6c1-1e9595eabef9 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:38.166462 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d11148-15f9-4c53-995d-7576cc9de602 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:38.205209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29be0e-00cf-4179-833e-453bd08ae9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:38.206172 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29be0e-00cf-4179-833e-453bd08ae9ff None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:38.206613 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29be0e-00cf-4179-833e-453bd08ae9ff None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:38.207111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29be0e-00cf-4179-833e-453bd08ae9ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:38.217953 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29be0e-00cf-4179-833e-453bd08ae9ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:38.223435 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-9b29be0e-00cf-4179-833e-453bd08ae9ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 13:58:38.223435 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:38.223435 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:38.223435 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:38.223435 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:38.223435 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:38.223435 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:38.223435 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:38.223435 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:38.223435 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:38.223435 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:38.223435 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:38.223435 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:38.223435 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:38.223435 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:38.223435 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:38.224482 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:38.224482 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:38.224482 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:38.224482 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:38.224482 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:38.224482 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:38.224482 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:38.224482 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:38.224482 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:38.224482 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:38.224482 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:38.224482 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:38.224482 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:38.224482 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:38.224482 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:38.224482 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:38.225927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:38.225927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:38.225927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:38.225927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:38.225927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:38.225927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:38.225927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:38.225927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:38.225927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:38.225927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:38.225927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 13:58:38.225927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:58:38.227859 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 116/227] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 13 13:58:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:58:38.238084 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29be0e-00cf-4179-833e-453bd08ae9ff None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:38.346189 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97cdb7-ecdf-4352-a6c1-1e9595eabef9 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:38.383579 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36baccdd-0f38-43ba-b27c-c7dd7b943aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:38.384227 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36baccdd-0f38-43ba-b27c-c7dd7b943aad None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:38.384486 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36baccdd-0f38-43ba-b27c-c7dd7b943aad None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:38.384756 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36baccdd-0f38-43ba-b27c-c7dd7b943aad None admin] PATH_INFO: `/v3/users/73a23d3081b541e2be4bc62612d26026` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:38.386081 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36baccdd-0f38-43ba-b27c-c7dd7b943aad None admin] RBAC: Authorizing `identity:get_user(user_id=73a23d3081b541e2be4bc62612d26026)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:38.387542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36baccdd-0f38-43ba-b27c-c7dd7b943aad None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:38.389163 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 112/228] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:38 2022] GET /identity/v3/users/73a23d3081b541e2be4bc62612d26026 => generated 283 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:38.400178 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:38.403517 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36baccdd-0f38-43ba-b27c-c7dd7b943aad None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:38.446451 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29be0e-00cf-4179-833e-453bd08ae9ff None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:38.500501 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:38.509110 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66176fc3-3701-4794-87db-458cf6ca4e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:38.509736 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66176fc3-3701-4794-87db-458cf6ca4e20 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:38.510012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66176fc3-3701-4794-87db-458cf6ca4e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:38.510280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66176fc3-3701-4794-87db-458cf6ca4e20 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:38.510951 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66176fc3-3701-4794-87db-458cf6ca4e20 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:38.511251 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66176fc3-3701-4794-87db-458cf6ca4e20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:38.513837 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66176fc3-3701-4794-87db-458cf6ca4e20 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:38.530623 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 117/229] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:58:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:38.537281 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66176fc3-3701-4794-87db-458cf6ca4e20 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:38.585233 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36baccdd-0f38-43ba-b27c-c7dd7b943aad None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:38.655533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e285b7b-94c6-4351-8019-742645943b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:38.656171 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e285b7b-94c6-4351-8019-742645943b05 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:38.656449 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e285b7b-94c6-4351-8019-742645943b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:38.656721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e285b7b-94c6-4351-8019-742645943b05 None admin] PATH_INFO: `/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:38.659113 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e285b7b-94c6-4351-8019-742645943b05 None admin] RBAC: Authorizing `identity:get_project(project_id=11155a320d8a4d4bb8eebe5129dd9cf8)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:38.661215 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e285b7b-94c6-4351-8019-742645943b05 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:38.663420 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 113/230] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:38 2022] GET /identity/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:58:38.674918 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e285b7b-94c6-4351-8019-742645943b05 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:38.733535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66176fc3-3701-4794-87db-458cf6ca4e20 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:38.797705 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac20c7-1042-4a70-94a5-4afd1841ef94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:38.799601 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac20c7-1042-4a70-94a5-4afd1841ef94 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:38.800226 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac20c7-1042-4a70-94a5-4afd1841ef94 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:38.800803 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac20c7-1042-4a70-94a5-4afd1841ef94 None admin] PATH_INFO: `/v3/users/73a23d3081b541e2be4bc62612d26026` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:38.803353 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac20c7-1042-4a70-94a5-4afd1841ef94 None admin] RBAC: Authorizing `identity:get_user(user_id=73a23d3081b541e2be4bc62612d26026)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:38.806094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac20c7-1042-4a70-94a5-4afd1841ef94 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:38.809286 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 118/231] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:38 2022] GET /identity/v3/users/73a23d3081b541e2be4bc62612d26026 => generated 283 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:38.814744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac20c7-1042-4a70-94a5-4afd1841ef94 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:38.828480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:38.866063 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e285b7b-94c6-4351-8019-742645943b05 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:38.908080 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:38.930891 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfcd94-9208-44d1-b170-03f1b8cbd3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:38.932722 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfcd94-9208-44d1-b170-03f1b8cbd3b0 None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:38.934241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfcd94-9208-44d1-b170-03f1b8cbd3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:38.934704 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfcd94-9208-44d1-b170-03f1b8cbd3b0 None admin] PATH_INFO: `/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8/users/73a23d3081b541e2be4bc62612d26026/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:38.938814 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bfcd94-9208-44d1-b170-03f1b8cbd3b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=11155a320d8a4d4bb8eebe5129dd9cf8, user_id=73a23d3081b541e2be4bc62612d26026, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:38.943180 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bfcd94-9208-44d1-b170-03f1b8cbd3b0 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:38.969222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 114/232] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 13 13:58:38 2022] PUT /identity/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8/users/73a23d3081b541e2be4bc62612d26026/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 13:58:39.019405 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac20c7-1042-4a70-94a5-4afd1841ef94 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:39.081942 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab97e1-6693-4fc0-8405-404b3d2fd364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:39.082598 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab97e1-6693-4fc0-8405-404b3d2fd364 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:39.082876 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab97e1-6693-4fc0-8405-404b3d2fd364 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:39.083149 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab97e1-6693-4fc0-8405-404b3d2fd364 None admin] PATH_INFO: `/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:39.084364 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab97e1-6693-4fc0-8405-404b3d2fd364 None admin] RBAC: Authorizing `identity:get_project(project_id=11155a320d8a4d4bb8eebe5129dd9cf8)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:39.090024 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab97e1-6693-4fc0-8405-404b3d2fd364 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:39.092187 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 119/233] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:38 2022] GET /identity/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8 => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:39.097997 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfcd94-9208-44d1-b170-03f1b8cbd3b0 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:39.231295 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfcd94-9208-44d1-b170-03f1b8cbd3b0 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:39.268665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4048b1-587f-403e-9cb1-f83d97964070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:39.269649 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4048b1-587f-403e-9cb1-f83d97964070 None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:39.270143 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4048b1-587f-403e-9cb1-f83d97964070 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:39.270585 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4048b1-587f-403e-9cb1-f83d97964070 None admin] PATH_INFO: `/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8/users/73a23d3081b541e2be4bc62612d26026/roles/cf8554dac8d343549802afd60c56c0d6` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:39.273057 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4048b1-587f-403e-9cb1-f83d97964070 None admin] RBAC: Authorizing `identity:create_grant(project_id=11155a320d8a4d4bb8eebe5129dd9cf8, user_id=73a23d3081b541e2be4bc62612d26026, role_id=cf8554dac8d343549802afd60c56c0d6)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:39.275089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4048b1-587f-403e-9cb1-f83d97964070 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:39.294143 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 115/234] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 13 13:58:39 2022] PUT /identity/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8/users/73a23d3081b541e2be4bc62612d26026/roles/cf8554dac8d343549802afd60c56c0d6 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 13:58:39.664168 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0642b-daed-47c3-8659-b45f7b9b6b1c None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:39.664691 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0642b-daed-47c3-8659-b45f7b9b6b1c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:39.664691 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0642b-daed-47c3-8659-b45f7b9b6b1c None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:39.666249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 120/235] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:39.671600 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de053f-1d25-4b20-a0fa-d19deac8b0e1 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:39.672123 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de053f-1d25-4b20-a0fa-d19deac8b0e1 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:39.672628 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de053f-1d25-4b20-a0fa-d19deac8b0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:39.694662 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-82de053f-1d25-4b20-a0fa-d19deac8b0e1 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:39.696195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-82de053f-1d25-4b20-a0fa-d19deac8b0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:39.707107 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71951a2e-5cab-4788-b0fc-3d5bebac14ae None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:39.707412 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71951a2e-5cab-4788-b0fc-3d5bebac14ae None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:39.707669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71951a2e-5cab-4788-b0fc-3d5bebac14ae None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:39.709401 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 121/236] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:39.722382 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fe0b6-09aa-48fa-99f8-04ff66219ed5 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:39.722679 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fe0b6-09aa-48fa-99f8-04ff66219ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:39.722951 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fe0b6-09aa-48fa-99f8-04ff66219ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:39.738750 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:39.766103 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ad7fe0b6-09aa-48fa-99f8-04ff66219ed5 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:39.767307 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ad7fe0b6-09aa-48fa-99f8-04ff66219ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:39.777217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 116/237] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:39.848264 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 122/238] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 13 13:58:40.143131 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de053f-1d25-4b20-a0fa-d19deac8b0e1 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:40.164048 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fe0b6-09aa-48fa-99f8-04ff66219ed5 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:40.167203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:40.328011 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de053f-1d25-4b20-a0fa-d19deac8b0e1 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:40.362929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bb82d-3521-44c1-bc17-98793786fe46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:40.363563 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bb82d-3521-44c1-bc17-98793786fe46 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:40.363844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bb82d-3521-44c1-bc17-98793786fe46 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:40.364119 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bb82d-3521-44c1-bc17-98793786fe46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:40.364291 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fe0b6-09aa-48fa-99f8-04ff66219ed5 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:40.365269 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932bb82d-3521-44c1-bc17-98793786fe46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:40.367401 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932bb82d-3521-44c1-bc17-98793786fe46 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:40.368989 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 117/239] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:58:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:40.382274 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bb82d-3521-44c1-bc17-98793786fe46 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:40.405587 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a44fe-f82e-475b-bc8e-eb58a3ebef91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:40.406143 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a44fe-f82e-475b-bc8e-eb58a3ebef91 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:40.406419 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a44fe-f82e-475b-bc8e-eb58a3ebef91 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:40.406685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a44fe-f82e-475b-bc8e-eb58a3ebef91 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:40.418112 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a44fe-f82e-475b-bc8e-eb58a3ebef91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:40.422968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-db1a44fe-f82e-475b-bc8e-eb58a3ebef91 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 13:58:40.422968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:40.422968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:40.422968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:40.422968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:40.422968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:40.422968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:40.422968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:40.422968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:40.422968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:40.422968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:40.422968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:40.422968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:40.422968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:40.422968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:40.422968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:40.423805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:40.423805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:40.423805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:40.423805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:40.423805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:40.423805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:40.423805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:40.423805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:40.423805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:40.423805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:40.423805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:40.423805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:40.423805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:40.423805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:40.423805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:40.423805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:40.424555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:40.424555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:40.424555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:40.424555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:40.424555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:40.424555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:40.424555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:40.424555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:40.424555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:40.424555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:40.424555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 13:58:40.424555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:58:40.424555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 123/240] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:58:40.425910 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a02e0-6645-4dd6-a0a5-3ab4b76a5bbd None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:40.425910 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a02e0-6645-4dd6-a0a5-3ab4b76a5bbd None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:40.425910 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a02e0-6645-4dd6-a0a5-3ab4b76a5bbd None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:40.429477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:40.432659 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 124/241] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:40.433580 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a02e0-6645-4dd6-a0a5-3ab4b76a5bbd None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:40.492011 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bb82d-3521-44c1-bc17-98793786fe46 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:40.499752 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:40.531174 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab3080-7399-4921-839f-0c77b6e55395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:40.532005 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab3080-7399-4921-839f-0c77b6e55395 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:40.532424 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab3080-7399-4921-839f-0c77b6e55395 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:40.532913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab3080-7399-4921-839f-0c77b6e55395 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:40.534085 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab3080-7399-4921-839f-0c77b6e55395 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:40.535750 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab3080-7399-4921-839f-0c77b6e55395 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:40.540446 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a02e0-6645-4dd6-a0a5-3ab4b76a5bbd None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:40.563514 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 118/242] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 13 13:58:40 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 13:58:40.565975 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7bafc-0b77-4cad-8005-470442f89abb None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:40.566514 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7bafc-0b77-4cad-8005-470442f89abb None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:40.566930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7bafc-0b77-4cad-8005-470442f89abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:40.602845 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-66b7bafc-0b77-4cad-8005-470442f89abb None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:40.604823 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-66b7bafc-0b77-4cad-8005-470442f89abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:40.609075 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8e3b5-96b0-4ff7-92f0-f12f76dcf8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:40.609937 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8e3b5-96b0-4ff7-92f0-f12f76dcf8d7 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:40.610357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8e3b5-96b0-4ff7-92f0-f12f76dcf8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:40.610764 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8e3b5-96b0-4ff7-92f0-f12f76dcf8d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:40.611591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8e3b5-96b0-4ff7-92f0-f12f76dcf8d7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:40.612062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8e3b5-96b0-4ff7-92f0-f12f76dcf8d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:40.613692 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8e3b5-96b0-4ff7-92f0-f12f76dcf8d7 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:40.632001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 125/243] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 13 13:58:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:40.639402 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8e3b5-96b0-4ff7-92f0-f12f76dcf8d7 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:40.765351 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 119/244] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:40.824003 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8e3b5-96b0-4ff7-92f0-f12f76dcf8d7 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:40.851257 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:40.865365 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2dc00-5029-4797-8bda-6619662d2607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:40.866509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2dc00-5029-4797-8bda-6619662d2607 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:40.866787 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2dc00-5029-4797-8bda-6619662d2607 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:40.867048 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2dc00-5029-4797-8bda-6619662d2607 None admin] PATH_INFO: `/v3/users/f7866fe20c2a47c0ae84f39e8c1f1a35` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:40.886165 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2dc00-5029-4797-8bda-6619662d2607 None admin] RBAC: Authorizing `identity:get_user(user_id=f7866fe20c2a47c0ae84f39e8c1f1a35)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:40.887710 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2dc00-5029-4797-8bda-6619662d2607 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:40.889387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 126/245] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:40 2022] GET /identity/v3/users/f7866fe20c2a47c0ae84f39e8c1f1a35 => generated 297 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:40.895103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7bafc-0b77-4cad-8005-470442f89abb None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:40.927493 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:41.009579 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7bafc-0b77-4cad-8005-470442f89abb None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:41.045906 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2dc00-5029-4797-8bda-6619662d2607 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:41.048045 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc53c9-d742-4d7a-b392-8122c18b05d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:41.048660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc53c9-d742-4d7a-b392-8122c18b05d3 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:41.048931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc53c9-d742-4d7a-b392-8122c18b05d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:41.049244 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc53c9-d742-4d7a-b392-8122c18b05d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:41.133921 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc53c9-d742-4d7a-b392-8122c18b05d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:41.135494 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc53c9-d742-4d7a-b392-8122c18b05d3 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:41.165404 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:41.197831 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2dc00-5029-4797-8bda-6619662d2607 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:41.239719 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522dd707-6ed0-4fdc-a5a8-11f98312d34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:41.240354 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dd707-6ed0-4fdc-a5a8-11f98312d34c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:41.241262 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dd707-6ed0-4fdc-a5a8-11f98312d34c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:41.241560 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dd707-6ed0-4fdc-a5a8-11f98312d34c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:41.254227 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522dd707-6ed0-4fdc-a5a8-11f98312d34c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:41.255579 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 120/246] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:58:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:58:41.259125 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-522dd707-6ed0-4fdc-a5a8-11f98312d34c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:58:41.259125 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:41.259125 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:41.259125 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:41.259125 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:41.259125 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:41.259125 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:41.259125 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:41.259125 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:41.259125 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:41.259125 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:41.259125 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:41.259125 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:41.259125 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:41.259125 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:41.259125 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:41.260012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:41.260012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:41.260012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:41.260012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:41.260012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:41.260012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:41.260012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:41.260012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:41.260012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:41.260012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:41.260012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:41.260012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:41.260012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:41.260012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:41.260012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:41.260012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:41.260810 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:41.260810 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:41.260810 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:41.260810 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:41.260810 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:41.260810 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:41.260810 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:41.260810 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:41.260810 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:41.260810 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:41.260810 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:58:41.260810 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:58:41.260810 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 127/247] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:58:41.266327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc53c9-d742-4d7a-b392-8122c18b05d3 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:41.267932 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522dd707-6ed0-4fdc-a5a8-11f98312d34c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:41.321361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:41.386845 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522dd707-6ed0-4fdc-a5a8-11f98312d34c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:41.426384 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6c0cf-c1f8-46f5-b89d-e891ea7e4cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:41.427137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6c0cf-c1f8-46f5-b89d-e891ea7e4cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:41.427423 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6c0cf-c1f8-46f5-b89d-e891ea7e4cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:41.427694 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6c0cf-c1f8-46f5-b89d-e891ea7e4cb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:41.428890 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6c0cf-c1f8-46f5-b89d-e891ea7e4cb9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:41.429222 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6c0cf-c1f8-46f5-b89d-e891ea7e4cb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:41.430759 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6c0cf-c1f8-46f5-b89d-e891ea7e4cb9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:41.440591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 128/248] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 13 13:58:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:58:41.450333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6c0cf-c1f8-46f5-b89d-e891ea7e4cb9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:41.483186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc53c9-d742-4d7a-b392-8122c18b05d3 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:41.530837 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:41.554981 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865f743-39b8-4954-857d-eca3dfbfa614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:41.554981 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865f743-39b8-4954-857d-eca3dfbfa614 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:41.554981 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865f743-39b8-4954-857d-eca3dfbfa614 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:41.555324 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865f743-39b8-4954-857d-eca3dfbfa614 None admin] PATH_INFO: `/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:41.561823 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865f743-39b8-4954-857d-eca3dfbfa614 None admin] RBAC: Authorizing `identity:get_project(project_id=11155a320d8a4d4bb8eebe5129dd9cf8)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:41.563293 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865f743-39b8-4954-857d-eca3dfbfa614 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:41.566886 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 121/249] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:41 2022] GET /identity/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8 => generated 302 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:41.573983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865f743-39b8-4954-857d-eca3dfbfa614 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:41.680784 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6c0cf-c1f8-46f5-b89d-e891ea7e4cb9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:41.694751 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:41.732905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865f743-39b8-4954-857d-eca3dfbfa614 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:41.761538 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e3283-a18f-4d1a-9cf9-27ab81887df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:41.763630 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e3283-a18f-4d1a-9cf9-27ab81887df6 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:41.764866 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e3283-a18f-4d1a-9cf9-27ab81887df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:41.765978 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e3283-a18f-4d1a-9cf9-27ab81887df6 None admin] PATH_INFO: `/v3/users/49a01eede041408a9a2c1166eb93ab46` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:41.767543 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e3283-a18f-4d1a-9cf9-27ab81887df6 None admin] RBAC: Authorizing `identity:get_user(user_id=49a01eede041408a9a2c1166eb93ab46)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:41.770285 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e3283-a18f-4d1a-9cf9-27ab81887df6 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:41.772866 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 129/250] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:41 2022] GET /identity/v3/users/49a01eede041408a9a2c1166eb93ab46 => generated 297 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:58:41.774863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2712f6a-f370-4813-aad3-4c49da520fc9 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:41.775554 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2712f6a-f370-4813-aad3-4c49da520fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:41.776917 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2712f6a-f370-4813-aad3-4c49da520fc9 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:41.778945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 130/251] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:41.780615 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2712f6a-f370-4813-aad3-4c49da520fc9 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:41.783514 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4817d8-3119-486d-8165-3e9e3837330b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:41.784355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4817d8-3119-486d-8165-3e9e3837330b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:41.784849 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4817d8-3119-486d-8165-3e9e3837330b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:41.785361 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4817d8-3119-486d-8165-3e9e3837330b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:41.786295 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4817d8-3119-486d-8165-3e9e3837330b None admin] RBAC: Adding query filter params (role.id=d11e68c76f6d4095a93949ee841afead, scope.project.id=11155a320d8a4d4bb8eebe5129dd9cf8, user.id=f7866fe20c2a47c0ae84f39e8c1f1a35) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:41.787214 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4817d8-3119-486d-8165-3e9e3837330b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:41.791204 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4817d8-3119-486d-8165-3e9e3837330b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:41.802621 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 122/252] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:58:41 2022] GET /identity/v3/role_assignments?user.id=f7866fe20c2a47c0ae84f39e8c1f1a35&scope.project.id=11155a320d8a4d4bb8eebe5129dd9cf8&role.id=d11e68c76f6d4095a93949ee841afead => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:41.809122 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06b119-10ba-4901-b9dc-553ae0a62f9b None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:41.809705 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06b119-10ba-4901-b9dc-553ae0a62f9b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:41.810233 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06b119-10ba-4901-b9dc-553ae0a62f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:41.841210 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-5c06b119-10ba-4901-b9dc-553ae0a62f9b None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:41.841210 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5c06b119-10ba-4901-b9dc-553ae0a62f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:41.925506 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:41.952416 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 123/253] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:41.996965 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2712f6a-f370-4813-aad3-4c49da520fc9 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:42.044074 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b401dcf-fe73-42df-ac06-58a0562932e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:42.045440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b401dcf-fe73-42df-ac06-58a0562932e0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:42.045944 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b401dcf-fe73-42df-ac06-58a0562932e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:42.046408 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b401dcf-fe73-42df-ac06-58a0562932e0 None admin] PATH_INFO: `/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:42.047992 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b401dcf-fe73-42df-ac06-58a0562932e0 None admin] RBAC: Authorizing `identity:get_project(project_id=11155a320d8a4d4bb8eebe5129dd9cf8)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:42.049806 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b401dcf-fe73-42df-ac06-58a0562932e0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:42.051875 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 131/254] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:41 2022] GET /identity/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:42.058440 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06b119-10ba-4901-b9dc-553ae0a62f9b None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:42.176257 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b508b-6a32-4c48-b2b3-d6079791daf1 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:42.176552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b508b-6a32-4c48-b2b3-d6079791daf1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:42.176725 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b508b-6a32-4c48-b2b3-d6079791daf1 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:42.178685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 132/255] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:42.184077 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3acad1-cd38-4a0e-a0ce-04db7c1be3a6 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:42.184399 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3acad1-cd38-4a0e-a0ce-04db7c1be3a6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:42.184618 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3acad1-cd38-4a0e-a0ce-04db7c1be3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:42.200920 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06b119-10ba-4901-b9dc-553ae0a62f9b None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:42.204649 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5a3acad1-cd38-4a0e-a0ce-04db7c1be3a6 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:42.205883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5a3acad1-cd38-4a0e-a0ce-04db7c1be3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:42.265556 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84804a5f-3b70-40eb-b0c4-890d40e15c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:42.266231 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84804a5f-3b70-40eb-b0c4-890d40e15c56 None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:42.266512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84804a5f-3b70-40eb-b0c4-890d40e15c56 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:42.266780 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84804a5f-3b70-40eb-b0c4-890d40e15c56 None admin] PATH_INFO: `/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8/users/49a01eede041408a9a2c1166eb93ab46/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:42.270600 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84804a5f-3b70-40eb-b0c4-890d40e15c56 None admin] RBAC: Authorizing `identity:create_grant(project_id=11155a320d8a4d4bb8eebe5129dd9cf8, user_id=49a01eede041408a9a2c1166eb93ab46, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:42.273274 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84804a5f-3b70-40eb-b0c4-890d40e15c56 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:42.276134 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:42.299315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 124/256] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 13 13:58:42 2022] PUT /identity/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8/users/49a01eede041408a9a2c1166eb93ab46/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 13:58:42.300172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84804a5f-3b70-40eb-b0c4-890d40e15c56 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:42.325563 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 133/257] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 13:58:42.370841 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:42.446420 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84804a5f-3b70-40eb-b0c4-890d40e15c56 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:42.497302 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b987d2-2554-4890-a57b-c2bcf80177eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:42.498064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b987d2-2554-4890-a57b-c2bcf80177eb None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:42.498242 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b987d2-2554-4890-a57b-c2bcf80177eb None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:42.498513 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b987d2-2554-4890-a57b-c2bcf80177eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:42.512364 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b987d2-2554-4890-a57b-c2bcf80177eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:42.517488 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-b1b987d2-2554-4890-a57b-c2bcf80177eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:58:42.517488 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:42.517488 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:42.517488 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:42.517488 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:42.517488 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:42.517488 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:42.517488 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:42.517488 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:42.517488 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:42.517488 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:42.517488 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:42.517488 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:42.517488 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:42.517488 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:42.517488 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:42.518381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:42.518381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:42.518381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:42.518381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:42.518381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:42.518381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:42.518381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:42.518381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:42.518381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:42.518381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:42.518381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:42.518381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:42.518381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:42.518381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:42.518381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:42.518381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:42.519739 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:42.519739 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:42.519739 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:42.519739 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:42.519739 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:42.519739 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:42.519739 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:42.519739 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:42.519739 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:42.519739 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:42.519739 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:58:42.519739 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:58:42.519739 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 125/258] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 13:58:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:42.525132 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3acad1-cd38-4a0e-a0ce-04db7c1be3a6 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:42.650749 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3acad1-cd38-4a0e-a0ce-04db7c1be3a6 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:42.699003 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da15517-878b-4105-a678-48609f79787a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:42.699627 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da15517-878b-4105-a678-48609f79787a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:42.699908 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da15517-878b-4105-a678-48609f79787a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:42.700177 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da15517-878b-4105-a678-48609f79787a None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:42.700842 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da15517-878b-4105-a678-48609f79787a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:42.701184 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da15517-878b-4105-a678-48609f79787a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:42.702570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da15517-878b-4105-a678-48609f79787a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:42.711230 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 134/259] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:42.716782 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b987d2-2554-4890-a57b-c2bcf80177eb None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:42.775629 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da15517-878b-4105-a678-48609f79787a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:42.821316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:42.901532 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da15517-878b-4105-a678-48609f79787a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:42.923186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b987d2-2554-4890-a57b-c2bcf80177eb None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:42.943295 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:42.961887 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa47e79-1c4b-4ee4-abfa-b85a1369542d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:42.962460 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa47e79-1c4b-4ee4-abfa-b85a1369542d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:42.962802 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa47e79-1c4b-4ee4-abfa-b85a1369542d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:42.963075 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa47e79-1c4b-4ee4-abfa-b85a1369542d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:42.984201 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa47e79-1c4b-4ee4-abfa-b85a1369542d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:42.993585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-ffa47e79-1c4b-4ee4-abfa-b85a1369542d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 13:58:42.993585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:42.993585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:42.993585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:42.993585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:42.993585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:42.993585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:42.993585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:42.993585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:42.993585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:42.993585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:42.993585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:42.993585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:42.993585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:42.993585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:42.993585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:42.994530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:42.994530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:42.994530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:42.994530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:42.994530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:42.994530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:42.994530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:42.994530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:42.994530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:42.994530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:42.994530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:42.994530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:42.994530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:42.994530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:42.994530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:42.994530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:42.995313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:42.995313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:42.995313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:42.995313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:42.995313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:42.995313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:42.995313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:42.995313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:42.995313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:42.995313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:42.995313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 13:58:42.995313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:58:42.995313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 135/260] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 13 13:58:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:43.004446 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa47e79-1c4b-4ee4-abfa-b85a1369542d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:43.010800 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655271c-0084-455f-b8bd-b74b0bb4c370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:43.011439 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655271c-0084-455f-b8bd-b74b0bb4c370 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:43.011713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655271c-0084-455f-b8bd-b74b0bb4c370 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:43.011979 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655271c-0084-455f-b8bd-b74b0bb4c370 None admin] PATH_INFO: `/v3/users/73a23d3081b541e2be4bc62612d26026` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:43.017803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655271c-0084-455f-b8bd-b74b0bb4c370 None admin] RBAC: Authorizing `identity:get_user(user_id=73a23d3081b541e2be4bc62612d26026)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:43.019274 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655271c-0084-455f-b8bd-b74b0bb4c370 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:43.021041 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 126/261] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:42 2022] GET /identity/v3/users/73a23d3081b541e2be4bc62612d26026 => generated 283 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:43.029753 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655271c-0084-455f-b8bd-b74b0bb4c370 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:43.174993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655271c-0084-455f-b8bd-b74b0bb4c370 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:43.215760 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c88d4a-bb75-4254-8a51-62c956628de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:43.216304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c88d4a-bb75-4254-8a51-62c956628de1 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:43.216584 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c88d4a-bb75-4254-8a51-62c956628de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:43.216860 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c88d4a-bb75-4254-8a51-62c956628de1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:43.264898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:43.272557 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:43.279273 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa47e79-1c4b-4ee4-abfa-b85a1369542d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:43.301030 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c88d4a-bb75-4254-8a51-62c956628de1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:43.302784 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c88d4a-bb75-4254-8a51-62c956628de1 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:43.382164 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b0712-5a25-4a2b-ad87-c8d156627798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:43.382795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b0712-5a25-4a2b-ad87-c8d156627798 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:43.383070 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b0712-5a25-4a2b-ad87-c8d156627798 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:43.383336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b0712-5a25-4a2b-ad87-c8d156627798 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:43.384003 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b0712-5a25-4a2b-ad87-c8d156627798 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:43.384295 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b0712-5a25-4a2b-ad87-c8d156627798 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:43.385712 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b0712-5a25-4a2b-ad87-c8d156627798 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:43.409942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 127/262] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:58:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 13:58:43.413200 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 136/263] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:58:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:43.416206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c88d4a-bb75-4254-8a51-62c956628de1 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:43.419117 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b0712-5a25-4a2b-ad87-c8d156627798 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:43.585585 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:43.593543 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c88d4a-bb75-4254-8a51-62c956628de1 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:43.662685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b0712-5a25-4a2b-ad87-c8d156627798 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:43.686709 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942cbb1-4c6b-4091-be63-ee11746fba91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:43.687354 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942cbb1-4c6b-4091-be63-ee11746fba91 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:43.687629 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942cbb1-4c6b-4091-be63-ee11746fba91 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:43.687896 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942cbb1-4c6b-4091-be63-ee11746fba91 None admin] PATH_INFO: `/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:43.694384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942cbb1-4c6b-4091-be63-ee11746fba91 None admin] RBAC: Authorizing `identity:get_project(project_id=11155a320d8a4d4bb8eebe5129dd9cf8)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:43.695853 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942cbb1-4c6b-4091-be63-ee11746fba91 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:43.697898 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 128/264] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:43 2022] GET /identity/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8 => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:43.704071 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942cbb1-4c6b-4091-be63-ee11746fba91 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:43.722030 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe349b-804c-4395-a5ae-a0c1c438c79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:43.722683 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe349b-804c-4395-a5ae-a0c1c438c79a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:43.722956 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe349b-804c-4395-a5ae-a0c1c438c79a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:43.723451 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe349b-804c-4395-a5ae-a0c1c438c79a None admin] PATH_INFO: `/v3/users/73a23d3081b541e2be4bc62612d26026` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:43.724808 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe349b-804c-4395-a5ae-a0c1c438c79a None admin] RBAC: Authorizing `identity:get_user(user_id=73a23d3081b541e2be4bc62612d26026)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:43.726474 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe349b-804c-4395-a5ae-a0c1c438c79a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:43.728526 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 137/265] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:43 2022] GET /identity/v3/users/73a23d3081b541e2be4bc62612d26026 => generated 283 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:43.736549 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe349b-804c-4395-a5ae-a0c1c438c79a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:43.774839 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:43.856933 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe349b-804c-4395-a5ae-a0c1c438c79a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:43.896184 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa63a1-18a1-40d2-b838-de371e90add1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:43.897386 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa63a1-18a1-40d2-b838-de371e90add1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:43.897866 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa63a1-18a1-40d2-b838-de371e90add1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:43.898356 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa63a1-18a1-40d2-b838-de371e90add1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:43.975684 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa63a1-18a1-40d2-b838-de371e90add1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:43.977640 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa63a1-18a1-40d2-b838-de371e90add1 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:44.013198 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:44.014802 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942cbb1-4c6b-4091-be63-ee11746fba91 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:44.095433 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8b676-b206-4882-b77f-f013e26a3222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:44.096040 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8b676-b206-4882-b77f-f013e26a3222 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:44.096311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8b676-b206-4882-b77f-f013e26a3222 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:44.096583 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8b676-b206-4882-b77f-f013e26a3222 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:44.097340 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8b676-b206-4882-b77f-f013e26a3222 None admin] RBAC: Adding query filter params (role.id=6dcc8495d2b24b3eab63dd656eb4eb6d, scope.project.id=11155a320d8a4d4bb8eebe5129dd9cf8, user.id=73a23d3081b541e2be4bc62612d26026) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:44.097644 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8b676-b206-4882-b77f-f013e26a3222 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:44.099075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8b676-b206-4882-b77f-f013e26a3222 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:44.118191 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 129/266] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:58:43 2022] GET /identity/v3/role_assignments?user.id=73a23d3081b541e2be4bc62612d26026&scope.project.id=11155a320d8a4d4bb8eebe5129dd9cf8&role.id=6dcc8495d2b24b3eab63dd656eb4eb6d => generated 608 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:58:44.164146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 138/267] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:58:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 13:58:44.169773 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8b676-b206-4882-b77f-f013e26a3222 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:44.181313 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:44.252045 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72831b57-0a36-4539-b548-4af9d9ffbbb6 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:44.252372 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72831b57-0a36-4539-b548-4af9d9ffbbb6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:44.252588 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72831b57-0a36-4539-b548-4af9d9ffbbb6 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:44.253984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 139/268] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:44.264174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd1091-eb51-40d2-aa02-be0da0c4d01d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:44.264472 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd1091-eb51-40d2-aa02-be0da0c4d01d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:44.264712 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd1091-eb51-40d2-aa02-be0da0c4d01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:44.302371 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-97dd1091-eb51-40d2-aa02-be0da0c4d01d None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:44.304099 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-97dd1091-eb51-40d2-aa02-be0da0c4d01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:44.351538 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8b676-b206-4882-b77f-f013e26a3222 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:44.404512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c77499-4928-43f0-bb71-3d9d71a9b964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:44.405073 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c77499-4928-43f0-bb71-3d9d71a9b964 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:44.405452 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c77499-4928-43f0-bb71-3d9d71a9b964 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:44.405724 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c77499-4928-43f0-bb71-3d9d71a9b964 None admin] PATH_INFO: `/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:44.406855 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c77499-4928-43f0-bb71-3d9d71a9b964 None admin] RBAC: Authorizing `identity:get_project(project_id=11155a320d8a4d4bb8eebe5129dd9cf8)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:44.408552 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c77499-4928-43f0-bb71-3d9d71a9b964 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:44.410385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 130/269] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:44 2022] GET /identity/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:44.411517 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e164c44-470d-4116-9220-cb37925ea07d None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:44.411793 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e164c44-470d-4116-9220-cb37925ea07d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:44.412059 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e164c44-470d-4116-9220-cb37925ea07d None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:44.417478 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 131/270] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:44.419513 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e164c44-470d-4116-9220-cb37925ea07d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:44.430251 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 140/271] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 13:58:44.431573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab16ab-3574-4fae-87cf-dea007755d03 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:44.431856 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab16ab-3574-4fae-87cf-dea007755d03 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:44.432182 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab16ab-3574-4fae-87cf-dea007755d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:44.453363 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-56ab16ab-3574-4fae-87cf-dea007755d03 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:44.454547 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-56ab16ab-3574-4fae-87cf-dea007755d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:44.544098 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:44.555979 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:44.573765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 141/272] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:44.606019 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e164c44-470d-4116-9220-cb37925ea07d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:44.670138 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca52dc6-caa1-4a1e-90d4-2da64bad975c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:44.670659 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca52dc6-caa1-4a1e-90d4-2da64bad975c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:44.670934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca52dc6-caa1-4a1e-90d4-2da64bad975c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:44.671197 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca52dc6-caa1-4a1e-90d4-2da64bad975c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:44.671923 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca52dc6-caa1-4a1e-90d4-2da64bad975c None admin] RBAC: Adding query filter params (role.id=cf8554dac8d343549802afd60c56c0d6, scope.project.id=11155a320d8a4d4bb8eebe5129dd9cf8, user.id=73a23d3081b541e2be4bc62612d26026) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:44.672225 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca52dc6-caa1-4a1e-90d4-2da64bad975c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:44.673695 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca52dc6-caa1-4a1e-90d4-2da64bad975c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:44.681130 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 132/273] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:58:44 2022] GET /identity/v3/role_assignments?user.id=73a23d3081b541e2be4bc62612d26026&scope.project.id=11155a320d8a4d4bb8eebe5129dd9cf8&role.id=cf8554dac8d343549802afd60c56c0d6 => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:58:44.830450 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab16ab-3574-4fae-87cf-dea007755d03 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:44.900508 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca52dc6-caa1-4a1e-90d4-2da64bad975c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:44.994116 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab16ab-3574-4fae-87cf-dea007755d03 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:45.039722 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f5898-83b4-4dac-b70e-0d2cce7f5f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:45.041194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f5898-83b4-4dac-b70e-0d2cce7f5f63 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:45.041720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f5898-83b4-4dac-b70e-0d2cce7f5f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:45.042184 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f5898-83b4-4dac-b70e-0d2cce7f5f63 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:45.045321 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f5898-83b4-4dac-b70e-0d2cce7f5f63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:45.047025 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f5898-83b4-4dac-b70e-0d2cce7f5f63 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:45.048827 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 142/274] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:58:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:45.053355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca52dc6-caa1-4a1e-90d4-2da64bad975c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:45.055681 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f5898-83b4-4dac-b70e-0d2cce7f5f63 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:45.091839 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3af30-0102-48a9-bcf2-bf6bfc461c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:45.092477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3af30-0102-48a9-bcf2-bf6bfc461c4c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:45.092786 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3af30-0102-48a9-bcf2-bf6bfc461c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:45.093009 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3af30-0102-48a9-bcf2-bf6bfc461c4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:45.101739 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:45.107607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3af30-0102-48a9-bcf2-bf6bfc461c4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:45.112844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-34d3af30-0102-48a9-bcf2-bf6bfc461c4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:58:45.112844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:45.112844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:45.112844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:45.112844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:45.112844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:45.112844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:45.112844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:45.112844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:45.112844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:45.112844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:45.112844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:45.112844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:45.112844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:45.112844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:45.112844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:45.113860 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:45.113860 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:45.113860 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:45.113860 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:45.113860 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:45.113860 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:45.113860 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:45.113860 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:45.113860 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:45.113860 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:45.113860 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:45.113860 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:45.113860 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:45.113860 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:45.113860 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:45.113860 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:45.115212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:45.115212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:45.115212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:45.115212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:45.115212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:45.115212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:45.115212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:45.115212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:45.115212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:45.115212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:45.115212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:58:45.115212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:58:45.115212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 133/275] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:58:45.121119 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3af30-0102-48a9-bcf2-bf6bfc461c4c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:45.124658 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:45.179860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f5898-83b4-4dac-b70e-0d2cce7f5f63 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:45.227324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fd910-5e60-4663-9e67-7d3068a27bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:45.229838 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fd910-5e60-4663-9e67-7d3068a27bbb None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:45.230120 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fd910-5e60-4663-9e67-7d3068a27bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:45.230387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fd910-5e60-4663-9e67-7d3068a27bbb None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:45.231051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396fd910-5e60-4663-9e67-7d3068a27bbb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:45.232570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396fd910-5e60-4663-9e67-7d3068a27bbb None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:45.245986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3af30-0102-48a9-bcf2-bf6bfc461c4c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:45.265495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 143/276] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 13 13:58:45 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 13:58:45.265495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980a8c6-8fcc-4335-bb11-05aba130ef4b None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:45.265495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980a8c6-8fcc-4335-bb11-05aba130ef4b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:45.265495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980a8c6-8fcc-4335-bb11-05aba130ef4b None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:45.265940 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 144/277] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:45.272646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcfaa0-2882-4356-b7fa-06c18fa6e06f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:45.273023 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcfaa0-2882-4356-b7fa-06c18fa6e06f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:45.273396 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcfaa0-2882-4356-b7fa-06c18fa6e06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:45.295168 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f1bcfaa0-2882-4356-b7fa-06c18fa6e06f None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:45.296741 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f1bcfaa0-2882-4356-b7fa-06c18fa6e06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:45.297162 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519102e9-e26e-4060-b161-79025b70dfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:45.297947 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519102e9-e26e-4060-b161-79025b70dfe0 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:45.298388 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519102e9-e26e-4060-b161-79025b70dfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:45.298814 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519102e9-e26e-4060-b161-79025b70dfe0 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:45.299687 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519102e9-e26e-4060-b161-79025b70dfe0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:45.300128 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519102e9-e26e-4060-b161-79025b70dfe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:45.301724 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519102e9-e26e-4060-b161-79025b70dfe0 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:45.312688 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 134/278] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 13 13:58:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:45.321472 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519102e9-e26e-4060-b161-79025b70dfe0 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:45.385239 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 145/279] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 13:58:45.401535 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:45.445325 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519102e9-e26e-4060-b161-79025b70dfe0 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:45.480606 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c57d5c-62c6-436f-8c87-60acec998857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:45.481510 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c57d5c-62c6-436f-8c87-60acec998857 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:45.481944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c57d5c-62c6-436f-8c87-60acec998857 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:45.482414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c57d5c-62c6-436f-8c87-60acec998857 None admin] PATH_INFO: `/v3/users/bb7eb88af4204fcdb934a3953cbb8de8` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:45.496822 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c57d5c-62c6-436f-8c87-60acec998857 None admin] RBAC: Authorizing `identity:get_user(user_id=bb7eb88af4204fcdb934a3953cbb8de8)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:45.498500 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c57d5c-62c6-436f-8c87-60acec998857 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:45.500631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 135/280] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:45 2022] GET /identity/v3/users/bb7eb88af4204fcdb934a3953cbb8de8 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:58:45.507507 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bcfaa0-2882-4356-b7fa-06c18fa6e06f None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:45.552093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:45.634733 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bcfaa0-2882-4356-b7fa-06c18fa6e06f None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:45.671427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c57d5c-62c6-436f-8c87-60acec998857 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:45.676822 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4afc6-0828-4d16-a2de-0ff417ab628b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:45.677495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4afc6-0828-4d16-a2de-0ff417ab628b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:45.677877 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4afc6-0828-4d16-a2de-0ff417ab628b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:45.678606 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4afc6-0828-4d16-a2de-0ff417ab628b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:45.679338 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4afc6-0828-4d16-a2de-0ff417ab628b None admin] RBAC: Adding query filter params (role.id=81a57b9863404b45acc1204670e387f2, user.id=bb7eb88af4204fcdb934a3953cbb8de8, scope.system=all) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:45.679642 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4afc6-0828-4d16-a2de-0ff417ab628b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:45.681090 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4afc6-0828-4d16-a2de-0ff417ab628b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:45.687765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 146/281] 10.222.0.26 () {56 vars in 1308 bytes} [Tue Sep 13 13:58:45 2022] GET /identity/v3/role_assignments?user.id=bb7eb88af4204fcdb934a3953cbb8de8&scope.system=all&role.id=81a57b9863404b45acc1204670e387f2 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:45.692311 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3a108-60c9-4d4f-b31c-ff1f092caf34 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:45.692598 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3a108-60c9-4d4f-b31c-ff1f092caf34 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:45.692874 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3a108-60c9-4d4f-b31c-ff1f092caf34 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:45.694601 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 147/282] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:45.700076 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ca2ce-19f0-470f-88d0-660ea371ec89 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:45.700582 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ca2ce-19f0-470f-88d0-660ea371ec89 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:45.700993 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ca2ce-19f0-470f-88d0-660ea371ec89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:45.727131 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-009ca2ce-19f0-470f-88d0-660ea371ec89 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:45.729344 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-009ca2ce-19f0-470f-88d0-660ea371ec89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:45.814916 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 148/283] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 13:58:45.822480 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c57d5c-62c6-436f-8c87-60acec998857 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:45.847927 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:45.864333 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ec05e-1bf8-4cd9-b990-e4cdfbc6cff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:45.865918 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ec05e-1bf8-4cd9-b990-e4cdfbc6cff2 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:45.866390 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ec05e-1bf8-4cd9-b990-e4cdfbc6cff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:45.866848 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ec05e-1bf8-4cd9-b990-e4cdfbc6cff2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:45.879869 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ec05e-1bf8-4cd9-b990-e4cdfbc6cff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:45.886135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-858ec05e-1bf8-4cd9-b990-e4cdfbc6cff2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 13:58:45.886135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:45.886135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:45.886135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:45.886135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:45.886135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:45.886135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:45.886135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:45.886135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:45.886135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:45.886135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:45.886135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:45.886135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:45.886135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:45.886135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:45.886135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:45.886995 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:45.886995 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:45.886995 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:45.886995 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:45.886995 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:45.886995 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:45.886995 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:45.886995 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:45.886995 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:45.886995 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:45.886995 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:45.886995 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:45.886995 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:45.886995 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:45.886995 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:45.886995 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:45.887799 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:45.887799 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:45.887799 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:45.887799 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:45.887799 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:45.887799 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:45.887799 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:45.887799 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:45.887799 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:45.887799 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:45.887799 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 13:58:45.887799 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:58:45.890132 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 136/284] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:58:45.898201 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ca2ce-19f0-470f-88d0-660ea371ec89 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:45.933966 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:46.005980 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ca2ce-19f0-470f-88d0-660ea371ec89 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:46.041856 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93190bed-591e-412a-b9e4-94f03f843bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:46.042458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93190bed-591e-412a-b9e4-94f03f843bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:46.042727 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93190bed-591e-412a-b9e4-94f03f843bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:46.042995 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93190bed-591e-412a-b9e4-94f03f843bd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:46.043657 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93190bed-591e-412a-b9e4-94f03f843bd7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:46.043955 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93190bed-591e-412a-b9e4-94f03f843bd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:46.045463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93190bed-591e-412a-b9e4-94f03f843bd7 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:46.054608 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 149/285] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 13 13:58:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:46.061551 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ec05e-1bf8-4cd9-b990-e4cdfbc6cff2 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:46.124351 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93190bed-591e-412a-b9e4-94f03f843bd7 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:46.229311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ec05e-1bf8-4cd9-b990-e4cdfbc6cff2 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:46.297650 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80899646-8ef4-4767-b1e5-40bb9fb2a918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:46.299254 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80899646-8ef4-4767-b1e5-40bb9fb2a918 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:46.299914 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80899646-8ef4-4767-b1e5-40bb9fb2a918 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:46.301024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80899646-8ef4-4767-b1e5-40bb9fb2a918 None admin] PATH_INFO: `/v3/users/f7866fe20c2a47c0ae84f39e8c1f1a35` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:46.303525 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80899646-8ef4-4767-b1e5-40bb9fb2a918 None admin] RBAC: Authorizing `identity:get_user(user_id=f7866fe20c2a47c0ae84f39e8c1f1a35)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:46.304049 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:46.306064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80899646-8ef4-4767-b1e5-40bb9fb2a918 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:46.309533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 137/286] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:46 2022] GET /identity/v3/users/f7866fe20c2a47c0ae84f39e8c1f1a35 => generated 297 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:46.316946 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80899646-8ef4-4767-b1e5-40bb9fb2a918 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:46.323850 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93190bed-591e-412a-b9e4-94f03f843bd7 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:46.385940 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc030350-95ac-4a6e-8a05-def07402b294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:46.386517 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc030350-95ac-4a6e-8a05-def07402b294 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:46.386802 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc030350-95ac-4a6e-8a05-def07402b294 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:46.387076 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc030350-95ac-4a6e-8a05-def07402b294 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:46.392455 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:46.413961 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc030350-95ac-4a6e-8a05-def07402b294 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:46.419651 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-cc030350-95ac-4a6e-8a05-def07402b294 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:58:46.419651 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:46.419651 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:46.419651 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:46.419651 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:46.419651 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:46.419651 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:46.419651 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:46.419651 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:46.419651 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:46.419651 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:46.419651 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:46.419651 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:46.419651 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:46.419651 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:46.419651 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:46.420525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:46.420525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:46.420525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:46.420525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:46.420525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:46.420525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:46.420525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:46.420525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:46.420525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:46.420525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:46.420525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:46.420525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:46.420525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:46.420525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:46.420525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:46.420525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:46.421319 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:46.421319 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:46.421319 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:46.421319 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:46.421319 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:46.421319 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:46.421319 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:46.421319 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:46.421319 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:46.421319 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:46.421319 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:58:46.421319 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:58:46.425272 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 150/287] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:58:46.430624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc030350-95ac-4a6e-8a05-def07402b294 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:46.443183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80899646-8ef4-4767-b1e5-40bb9fb2a918 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:46.479967 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9584ec-9646-4b8b-97f2-541de28de593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:46.480977 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9584ec-9646-4b8b-97f2-541de28de593 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:46.481471 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9584ec-9646-4b8b-97f2-541de28de593 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:46.481981 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9584ec-9646-4b8b-97f2-541de28de593 None admin] PATH_INFO: `/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:46.483338 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9584ec-9646-4b8b-97f2-541de28de593 None admin] RBAC: Authorizing `identity:get_project(project_id=11155a320d8a4d4bb8eebe5129dd9cf8)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:46.484975 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9584ec-9646-4b8b-97f2-541de28de593 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:46.486922 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 138/288] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:46 2022] GET /identity/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:46.493033 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9584ec-9646-4b8b-97f2-541de28de593 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:46.624257 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9584ec-9646-4b8b-97f2-541de28de593 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:46.658850 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:46.676135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e03c3-b736-469e-98ce-a1cee7549478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:46.678587 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e03c3-b736-469e-98ce-a1cee7549478 None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:46.679301 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e03c3-b736-469e-98ce-a1cee7549478 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:46.680664 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e03c3-b736-469e-98ce-a1cee7549478 None admin] PATH_INFO: `/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8/users/f7866fe20c2a47c0ae84f39e8c1f1a35/roles/d11e68c76f6d4095a93949ee841afead` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:46.684829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e03c3-b736-469e-98ce-a1cee7549478 None admin] RBAC: Authorizing `identity:create_grant(project_id=11155a320d8a4d4bb8eebe5129dd9cf8, user_id=f7866fe20c2a47c0ae84f39e8c1f1a35, role_id=d11e68c76f6d4095a93949ee841afead)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:46.686687 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e03c3-b736-469e-98ce-a1cee7549478 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:46.710975 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 139/289] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 13 13:58:46 2022] PUT /identity/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8/users/f7866fe20c2a47c0ae84f39e8c1f1a35/roles/d11e68c76f6d4095a93949ee841afead => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 13:58:46.727803 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc030350-95ac-4a6e-8a05-def07402b294 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:46.792767 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b7127-a1ff-4735-b7cf-0529ea2ed7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:46.794098 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b7127-a1ff-4735-b7cf-0529ea2ed7ce None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:46.794707 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b7127-a1ff-4735-b7cf-0529ea2ed7ce None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:46.795405 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b7127-a1ff-4735-b7cf-0529ea2ed7ce None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:46.796603 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b7127-a1ff-4735-b7cf-0529ea2ed7ce None admin] RBAC: Adding query filter params (name=member) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:46.797311 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b7127-a1ff-4735-b7cf-0529ea2ed7ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:46.799686 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b7127-a1ff-4735-b7cf-0529ea2ed7ce None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:46.820477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 151/290] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 13 13:58:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:46.826273 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e03c3-b736-469e-98ce-a1cee7549478 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:46.997957 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e03c3-b736-469e-98ce-a1cee7549478 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:47.051993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65f6df-5d44-41e5-b8d4-7efc05c0534f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:47.053510 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f6df-5d44-41e5-b8d4-7efc05c0534f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:47.054142 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f6df-5d44-41e5-b8d4-7efc05c0534f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:47.054764 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f6df-5d44-41e5-b8d4-7efc05c0534f None admin] PATH_INFO: `/v3/users/49a01eede041408a9a2c1166eb93ab46` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:47.056599 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65f6df-5d44-41e5-b8d4-7efc05c0534f None admin] RBAC: Authorizing `identity:get_user(user_id=49a01eede041408a9a2c1166eb93ab46)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:47.059031 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65f6df-5d44-41e5-b8d4-7efc05c0534f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:47.061998 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 140/291] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:46 2022] GET /identity/v3/users/49a01eede041408a9a2c1166eb93ab46 => generated 297 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:47.070264 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b7127-a1ff-4735-b7cf-0529ea2ed7ce None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:47.106296 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:47.235113 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b7127-a1ff-4735-b7cf-0529ea2ed7ce None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:47.280740 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a5a0e-38fa-4b0f-9e40-a751e876e14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:47.281714 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a5a0e-38fa-4b0f-9e40-a751e876e14e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:47.282235 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a5a0e-38fa-4b0f-9e40-a751e876e14e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:47.282716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a5a0e-38fa-4b0f-9e40-a751e876e14e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:47.376479 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a5a0e-38fa-4b0f-9e40-a751e876e14e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:47.378317 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a5a0e-38fa-4b0f-9e40-a751e876e14e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:47.405231 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:47.538145 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 152/292] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:58:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:58:47.543770 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65f6df-5d44-41e5-b8d4-7efc05c0534f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:47.606750 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:47.684114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65f6df-5d44-41e5-b8d4-7efc05c0534f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:47.733223 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a1711-c4d4-49ce-ba3b-69a4f6b93929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:47.734145 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a1711-c4d4-49ce-ba3b-69a4f6b93929 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:47.734529 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a1711-c4d4-49ce-ba3b-69a4f6b93929 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:47.734898 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a1711-c4d4-49ce-ba3b-69a4f6b93929 None admin] PATH_INFO: `/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:47.736587 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a1711-c4d4-49ce-ba3b-69a4f6b93929 None admin] RBAC: Authorizing `identity:get_project(project_id=11155a320d8a4d4bb8eebe5129dd9cf8)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:47.738807 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a1711-c4d4-49ce-ba3b-69a4f6b93929 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:47.741261 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 141/293] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:47 2022] GET /identity/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:47.750216 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a5a0e-38fa-4b0f-9e40-a751e876e14e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:47.905987 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a5a0e-38fa-4b0f-9e40-a751e876e14e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:47.937953 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:47.975627 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe8fba-1276-4888-84df-259f1a385cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:47.976470 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe8fba-1276-4888-84df-259f1a385cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:47.976855 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe8fba-1276-4888-84df-259f1a385cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:47.977256 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe8fba-1276-4888-84df-259f1a385cb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:47.978314 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe8fba-1276-4888-84df-259f1a385cb1 None admin] RBAC: Adding query filter params (role.id=81a57b9863404b45acc1204670e387f2, scope.project.id=11155a320d8a4d4bb8eebe5129dd9cf8, user.id=49a01eede041408a9a2c1166eb93ab46) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:47.978746 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe8fba-1276-4888-84df-259f1a385cb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:47.980847 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe8fba-1276-4888-84df-259f1a385cb1 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:47.996090 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 153/294] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:58:47 2022] GET /identity/v3/role_assignments?user.id=49a01eede041408a9a2c1166eb93ab46&scope.project.id=11155a320d8a4d4bb8eebe5129dd9cf8&role.id=81a57b9863404b45acc1204670e387f2 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:48.190620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e327b9f-0eb5-4e1e-a103-f98bb4e79a91 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:48.190976 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e327b9f-0eb5-4e1e-a103-f98bb4e79a91 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:48.191364 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e327b9f-0eb5-4e1e-a103-f98bb4e79a91 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:48.193873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 142/295] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:48.199720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e737499-847c-4dbb-b1db-f0ac1d7aa216 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:48.200220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e737499-847c-4dbb-b1db-f0ac1d7aa216 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:48.200324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e737499-847c-4dbb-b1db-f0ac1d7aa216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:48.224414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e719236-9ebf-4ccf-88fa-d52865169757 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:48.224938 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e719236-9ebf-4ccf-88fa-d52865169757 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:48.225376 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e719236-9ebf-4ccf-88fa-d52865169757 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:48.226171 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5e737499-847c-4dbb-b1db-f0ac1d7aa216 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:48.227384 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5e737499-847c-4dbb-b1db-f0ac1d7aa216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:48.227588 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 143/296] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:48.242655 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e2a1a-9ede-4be4-9a12-d61ae9c21bba None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:48.243037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e2a1a-9ede-4be4-9a12-d61ae9c21bba None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:48.243408 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e2a1a-9ede-4be4-9a12-d61ae9c21bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:48.285903 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-fc1e2a1a-9ede-4be4-9a12-d61ae9c21bba None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:48.288351 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-fc1e2a1a-9ede-4be4-9a12-d61ae9c21bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:48.332266 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 154/297] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 13:58:48.416442 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 144/298] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:48.452138 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6167c-31d3-45f6-87fa-42263380b0ba None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:48.452459 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6167c-31d3-45f6-87fa-42263380b0ba None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:48.452690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6167c-31d3-45f6-87fa-42263380b0ba None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:48.454349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 155/299] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:48.459347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ab8fc-8bc7-4131-b1db-37768318ae03 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:48.459628 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ab8fc-8bc7-4131-b1db-37768318ae03 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:48.459901 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ab8fc-8bc7-4131-b1db-37768318ae03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:48.479811 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-248ab8fc-8bc7-4131-b1db-37768318ae03 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:48.481056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-248ab8fc-8bc7-4131-b1db-37768318ae03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:48.532506 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:48.578750 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 145/300] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 13:58:48.633010 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6167c-31d3-45f6-87fa-42263380b0ba None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:48.710665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ab8fc-8bc7-4131-b1db-37768318ae03 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:48.757441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6167c-31d3-45f6-87fa-42263380b0ba None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:48.769308 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:48.794267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b9353-f18e-469f-b29c-140498e2e502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:48.795180 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b9353-f18e-469f-b29c-140498e2e502 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:48.795670 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b9353-f18e-469f-b29c-140498e2e502 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:48.796126 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b9353-f18e-469f-b29c-140498e2e502 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:48.797508 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b9353-f18e-469f-b29c-140498e2e502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:48.799209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b9353-f18e-469f-b29c-140498e2e502 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:48.801291 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 156/301] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:58:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:48.813967 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b9353-f18e-469f-b29c-140498e2e502 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:48.830632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ab8fc-8bc7-4131-b1db-37768318ae03 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:48.871337 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5b5d9-9bfa-4098-9c2e-a4a63dc689f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:48.872176 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5b5d9-9bfa-4098-9c2e-a4a63dc689f9 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:48.872706 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5b5d9-9bfa-4098-9c2e-a4a63dc689f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:48.873180 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5b5d9-9bfa-4098-9c2e-a4a63dc689f9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:48.883648 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5b5d9-9bfa-4098-9c2e-a4a63dc689f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:48.888736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-b2f5b5d9-9bfa-4098-9c2e-a4a63dc689f9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 13:58:48.888736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:48.888736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:48.888736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:48.888736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:48.888736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:48.888736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:48.888736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:48.888736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:48.888736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:48.888736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:48.888736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:48.888736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:48.888736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:48.888736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:48.888736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:48.889616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:48.889616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:48.889616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:48.889616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:48.889616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:48.889616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:48.889616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:48.889616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:48.889616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:48.889616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:48.889616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:48.889616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:48.889616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:48.889616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:48.889616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:48.889616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:48.890374 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:48.890374 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:48.890374 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:48.890374 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:48.890374 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:48.890374 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:48.890374 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:48.890374 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:48.890374 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:48.890374 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:48.890374 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 13:58:48.890374 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:58:48.892708 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 146/302] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:58:48.898862 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5b5d9-9bfa-4098-9c2e-a4a63dc689f9 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:48.932956 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:48.937558 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b9353-f18e-469f-b29c-140498e2e502 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:48.973387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e89c00-2b66-40f6-bf54-025bb49f7b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:48.973921 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e89c00-2b66-40f6-bf54-025bb49f7b88 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:48.974544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e89c00-2b66-40f6-bf54-025bb49f7b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:48.974544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e89c00-2b66-40f6-bf54-025bb49f7b88 None admin] PATH_INFO: `/v3/groups` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:48.975095 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e89c00-2b66-40f6-bf54-025bb49f7b88 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:48.976524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e89c00-2b66-40f6-bf54-025bb49f7b88 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:48.993432 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 157/303] 10.222.0.26 () {60 vars in 1134 bytes} [Tue Sep 13 13:58:48 2022] POST /identity/v3/groups => generated 229 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 13:58:48.994542 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e89c00-2b66-40f6-bf54-025bb49f7b88 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:49.023147 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5b5d9-9bfa-4098-9c2e-a4a63dc689f9 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:49.051878 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:49.068402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aed41e-dbac-4c26-9241-90b354cd78af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:49.069908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aed41e-dbac-4c26-9241-90b354cd78af None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:49.070420 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aed41e-dbac-4c26-9241-90b354cd78af None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:49.070864 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aed41e-dbac-4c26-9241-90b354cd78af None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:49.071729 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aed41e-dbac-4c26-9241-90b354cd78af None admin] RBAC: Adding query filter params (name=reader) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:49.072249 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aed41e-dbac-4c26-9241-90b354cd78af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:49.074146 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aed41e-dbac-4c26-9241-90b354cd78af None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:49.085496 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 147/304] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 13 13:58:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:58:49.091632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aed41e-dbac-4c26-9241-90b354cd78af None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:49.136056 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e89c00-2b66-40f6-bf54-025bb49f7b88 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:49.176864 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c0147-57f3-4bf5-b9cc-d8d2396ff930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:49.178008 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c0147-57f3-4bf5-b9cc-d8d2396ff930 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:49.178553 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c0147-57f3-4bf5-b9cc-d8d2396ff930 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:49.179063 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c0147-57f3-4bf5-b9cc-d8d2396ff930 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:49.192214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c0147-57f3-4bf5-b9cc-d8d2396ff930 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:49.198534 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-402c0147-57f3-4bf5-b9cc-d8d2396ff930 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:58:49.198534 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:49.198534 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:49.198534 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:49.198534 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:49.198534 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:49.198534 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:49.198534 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:49.198534 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:49.198534 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:49.198534 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:49.198534 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:49.198534 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:49.198534 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:49.198534 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:49.198534 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:49.199480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:49.199480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:49.199480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:49.199480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:49.199480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:49.199480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:49.199480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:49.199480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:49.199480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:49.199480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:49.199480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:49.199480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:49.199480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:49.199480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:49.199480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:49.199480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:49.200676 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:49.200676 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:49.200676 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:49.200676 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:49.200676 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:49.200676 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:49.200676 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:49.200676 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:49.200676 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:49.200676 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:49.200676 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:58:49.200676 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:58:49.202764 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 158/305] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:49.208569 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c0147-57f3-4bf5-b9cc-d8d2396ff930 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:49.210338 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:49.218547 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aed41e-dbac-4c26-9241-90b354cd78af None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:49.268569 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28067d-3445-4875-a245-5c6e31fe065e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:49.268960 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28067d-3445-4875-a245-5c6e31fe065e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:49.269367 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28067d-3445-4875-a245-5c6e31fe065e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:49.269738 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28067d-3445-4875-a245-5c6e31fe065e None admin] PATH_INFO: `/v3/users/5f7da3eb52174b2d926a0611fe17102b` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:49.288274 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28067d-3445-4875-a245-5c6e31fe065e None admin] RBAC: Authorizing `identity:get_user(user_id=5f7da3eb52174b2d926a0611fe17102b)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:49.289937 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28067d-3445-4875-a245-5c6e31fe065e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:49.292095 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 148/306] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:49 2022] GET /identity/v3/users/5f7da3eb52174b2d926a0611fe17102b => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:49.299144 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28067d-3445-4875-a245-5c6e31fe065e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:49.344260 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:49.350148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c0147-57f3-4bf5-b9cc-d8d2396ff930 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:49.398921 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb30da-f13e-43d5-aab4-4e1b64a515a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:49.399881 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb30da-f13e-43d5-aab4-4e1b64a515a8 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:49.400415 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb30da-f13e-43d5-aab4-4e1b64a515a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:49.400863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb30da-f13e-43d5-aab4-4e1b64a515a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:49.401759 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb30da-f13e-43d5-aab4-4e1b64a515a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:49.402240 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb30da-f13e-43d5-aab4-4e1b64a515a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:49.403823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb30da-f13e-43d5-aab4-4e1b64a515a8 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:49.414916 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 159/307] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 13 13:58:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:58:49.420748 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb30da-f13e-43d5-aab4-4e1b64a515a8 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:49.452013 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28067d-3445-4875-a245-5c6e31fe065e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:49.491992 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9772f-ba30-4f78-a052-5fb7942eb20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:49.492974 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9772f-ba30-4f78-a052-5fb7942eb20c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:49.493502 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9772f-ba30-4f78-a052-5fb7942eb20c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:49.493979 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9772f-ba30-4f78-a052-5fb7942eb20c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:49.494959 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9772f-ba30-4f78-a052-5fb7942eb20c None admin] RBAC: Adding query filter params (role.id=d11e68c76f6d4095a93949ee841afead, user.id=5f7da3eb52174b2d926a0611fe17102b, scope.system=all) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:49.495480 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9772f-ba30-4f78-a052-5fb7942eb20c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:49.497324 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9772f-ba30-4f78-a052-5fb7942eb20c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:49.503391 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 149/308] 10.222.0.26 () {56 vars in 1308 bytes} [Tue Sep 13 13:58:49 2022] GET /identity/v3/role_assignments?user.id=5f7da3eb52174b2d926a0611fe17102b&scope.system=all&role.id=d11e68c76f6d4095a93949ee841afead => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:58:49.557624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb30da-f13e-43d5-aab4-4e1b64a515a8 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:49.600266 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f47105-4f60-4964-81cd-25dc7cf4155d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:49.600923 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f47105-4f60-4964-81cd-25dc7cf4155d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:49.601240 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f47105-4f60-4964-81cd-25dc7cf4155d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:49.601519 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f47105-4f60-4964-81cd-25dc7cf4155d None admin] PATH_INFO: `/v3/users/bb7eb88af4204fcdb934a3953cbb8de8` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:49.602758 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f47105-4f60-4964-81cd-25dc7cf4155d None admin] RBAC: Authorizing `identity:get_user(user_id=bb7eb88af4204fcdb934a3953cbb8de8)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:49.604290 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f47105-4f60-4964-81cd-25dc7cf4155d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:49.606230 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 160/309] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:49 2022] GET /identity/v3/users/bb7eb88af4204fcdb934a3953cbb8de8 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:49.611927 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9772f-ba30-4f78-a052-5fb7942eb20c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:49.633214 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:49.735655 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9772f-ba30-4f78-a052-5fb7942eb20c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:49.771052 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6b4f4-6edf-4827-9a26-bd33b17fcb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:49.772234 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6b4f4-6edf-4827-9a26-bd33b17fcb28 None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:49.772511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6b4f4-6edf-4827-9a26-bd33b17fcb28 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:49.772779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6b4f4-6edf-4827-9a26-bd33b17fcb28 None admin] PATH_INFO: `/v3/system/users/bb7eb88af4204fcdb934a3953cbb8de8/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:49.774260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6b4f4-6edf-4827-9a26-bd33b17fcb28 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bb7eb88af4204fcdb934a3953cbb8de8, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:49.775645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6b4f4-6edf-4827-9a26-bd33b17fcb28 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:49.777774 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d09bd-4e3c-4dda-a3c8-d517fef0d585 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:49.778058 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d09bd-4e3c-4dda-a3c8-d517fef0d585 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:49.778330 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d09bd-4e3c-4dda-a3c8-d517fef0d585 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:49.779812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 161/310] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 13:58:49.788774 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2933c-6440-4663-9bb8-dd470756bb2a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:49.789201 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2933c-6440-4663-9bb8-dd470756bb2a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:49.789492 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2933c-6440-4663-9bb8-dd470756bb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:49.791866 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 150/311] 10.222.0.26 () {58 vars in 1334 bytes} [Tue Sep 13 13:58:49 2022] PUT /identity/v3/system/users/bb7eb88af4204fcdb934a3953cbb8de8/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 13:58:49.826458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-3de2933c-6440-4663-9bb8-dd470756bb2a None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:49.827613 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3de2933c-6440-4663-9bb8-dd470756bb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:49.856512 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:49.910342 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 162/312] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:50.182706 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6b4f4-6edf-4827-9a26-bd33b17fcb28 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:50.269330 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:50.298190 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6b4f4-6edf-4827-9a26-bd33b17fcb28 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:50.338675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0190171-293b-4191-b334-6b02d3f37fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:50.339310 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0190171-293b-4191-b334-6b02d3f37fde None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:50.339581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0190171-293b-4191-b334-6b02d3f37fde None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:50.339845 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0190171-293b-4191-b334-6b02d3f37fde None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:50.351123 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0190171-293b-4191-b334-6b02d3f37fde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:50.356379 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-c0190171-293b-4191-b334-6b02d3f37fde None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 13:58:50.356379 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:50.356379 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:50.356379 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:50.356379 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:50.356379 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:50.356379 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:50.356379 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:50.356379 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:50.356379 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:50.356379 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:50.356379 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:50.356379 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:50.356379 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:50.356379 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:50.356379 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:50.357262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:50.357262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:50.357262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:50.357262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:50.357262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:50.357262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:50.357262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:50.357262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:50.357262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:50.357262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:50.357262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:50.357262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:50.357262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:50.357262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:50.357262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:50.357262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:50.358031 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:50.358031 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:50.358031 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:50.358031 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:50.358031 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:50.358031 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:50.358031 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:50.358031 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:50.358031 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:50.358031 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:50.358031 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 13:58:50.358031 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:58:50.358031 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 151/313] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:50.363271 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2933c-6440-4663-9bb8-dd470756bb2a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:50.474737 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2933c-6440-4663-9bb8-dd470756bb2a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:50.510247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f15bab-d620-4b24-8968-890f4624780c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:50.510858 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f15bab-d620-4b24-8968-890f4624780c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:50.511137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f15bab-d620-4b24-8968-890f4624780c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:50.511408 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f15bab-d620-4b24-8968-890f4624780c None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:50.512073 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f15bab-d620-4b24-8968-890f4624780c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:50.512375 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f15bab-d620-4b24-8968-890f4624780c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:50.513789 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f15bab-d620-4b24-8968-890f4624780c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:50.522842 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 163/314] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 13 13:58:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:50.528450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0190171-293b-4191-b334-6b02d3f37fde None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:50.640873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0190171-293b-4191-b334-6b02d3f37fde None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:50.676975 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a5dd7-4aed-48e3-aea9-7bcfe67212c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:50.678177 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a5dd7-4aed-48e3-aea9-7bcfe67212c9 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:50.678468 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a5dd7-4aed-48e3-aea9-7bcfe67212c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:50.678739 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a5dd7-4aed-48e3-aea9-7bcfe67212c9 None admin] PATH_INFO: `/v3/users/f7866fe20c2a47c0ae84f39e8c1f1a35` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:50.679905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a5dd7-4aed-48e3-aea9-7bcfe67212c9 None admin] RBAC: Authorizing `identity:get_user(user_id=f7866fe20c2a47c0ae84f39e8c1f1a35)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:50.681404 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a5dd7-4aed-48e3-aea9-7bcfe67212c9 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:50.683345 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 152/315] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:50 2022] GET /identity/v3/users/f7866fe20c2a47c0ae84f39e8c1f1a35 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:50.688829 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f15bab-d620-4b24-8968-890f4624780c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:50.711489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:50.797614 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f15bab-d620-4b24-8968-890f4624780c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:50.832984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668376eb-65a9-4054-9027-d3be69fb796c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:50.833644 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668376eb-65a9-4054-9027-d3be69fb796c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:50.833985 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668376eb-65a9-4054-9027-d3be69fb796c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:50.834261 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668376eb-65a9-4054-9027-d3be69fb796c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:50.904467 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668376eb-65a9-4054-9027-d3be69fb796c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:50.905974 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668376eb-65a9-4054-9027-d3be69fb796c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:50.929557 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:51.012834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 164/316] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:58:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:58:51.018527 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a5dd7-4aed-48e3-aea9-7bcfe67212c9 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:51.030704 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:51.127651 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a5dd7-4aed-48e3-aea9-7bcfe67212c9 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:51.167506 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19ab0e-d73c-4fbc-a734-e35014f84487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:51.168140 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19ab0e-d73c-4fbc-a734-e35014f84487 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:51.168422 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19ab0e-d73c-4fbc-a734-e35014f84487 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:51.168690 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19ab0e-d73c-4fbc-a734-e35014f84487 None admin] PATH_INFO: `/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:51.169857 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19ab0e-d73c-4fbc-a734-e35014f84487 None admin] RBAC: Authorizing `identity:get_project(project_id=11155a320d8a4d4bb8eebe5129dd9cf8)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:51.171302 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19ab0e-d73c-4fbc-a734-e35014f84487 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:51.173354 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 153/317] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:51 2022] GET /identity/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:51.179593 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668376eb-65a9-4054-9027-d3be69fb796c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:51.291664 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668376eb-65a9-4054-9027-d3be69fb796c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:51.315016 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:51.328718 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456bd4f-cecd-4c5d-b078-6985e6c2d957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:51.329470 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456bd4f-cecd-4c5d-b078-6985e6c2d957 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:51.329822 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456bd4f-cecd-4c5d-b078-6985e6c2d957 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:51.330160 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456bd4f-cecd-4c5d-b078-6985e6c2d957 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:51.330923 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456bd4f-cecd-4c5d-b078-6985e6c2d957 None admin] RBAC: Adding query filter params (role.id=d11e68c76f6d4095a93949ee841afead, scope.project.id=11155a320d8a4d4bb8eebe5129dd9cf8, user.id=f7866fe20c2a47c0ae84f39e8c1f1a35) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:51.331233 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456bd4f-cecd-4c5d-b078-6985e6c2d957 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:51.332786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456bd4f-cecd-4c5d-b078-6985e6c2d957 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:51.340343 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 165/318] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:58:51 2022] GET /identity/v3/role_assignments?user.id=f7866fe20c2a47c0ae84f39e8c1f1a35&scope.project.id=11155a320d8a4d4bb8eebe5129dd9cf8&role.id=d11e68c76f6d4095a93949ee841afead => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:51.358838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0836b1-57b3-4770-a84b-8631bf92d4c2 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:51.359148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0836b1-57b3-4770-a84b-8631bf92d4c2 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:51.359386 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0836b1-57b3-4770-a84b-8631bf92d4c2 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:51.360783 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 154/319] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:51.367296 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db16687-0354-4828-87db-5e069df57cdc None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:51.367922 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db16687-0354-4828-87db-5e069df57cdc None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:51.367922 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db16687-0354-4828-87db-5e069df57cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:51.389303 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-8db16687-0354-4828-87db-5e069df57cdc None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:51.390477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8db16687-0354-4828-87db-5e069df57cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:51.466757 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 166/320] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 13:58:51.740876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0836b1-57b3-4770-a84b-8631bf92d4c2 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:51.762476 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7c543-f0c1-4dfe-b3ae-ed5a68d0f80d None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:51.762781 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7c543-f0c1-4dfe-b3ae-ed5a68d0f80d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:51.763022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7c543-f0c1-4dfe-b3ae-ed5a68d0f80d None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:51.764507 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 167/321] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:51.769277 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c248f-3d4a-40ea-997b-fefecc4daadb None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:51.769556 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c248f-3d4a-40ea-997b-fefecc4daadb None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:51.769825 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c248f-3d4a-40ea-997b-fefecc4daadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:51.789003 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d70c248f-3d4a-40ea-997b-fefecc4daadb None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:51.790286 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d70c248f-3d4a-40ea-997b-fefecc4daadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:51.834613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:51.861486 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0836b1-57b3-4770-a84b-8631bf92d4c2 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:51.862205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 168/322] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 13:58:51.902154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfcbbb-ba03-46a5-b4c4-103f702b7cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:51.902771 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfcbbb-ba03-46a5-b4c4-103f702b7cba None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:51.903045 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfcbbb-ba03-46a5-b4c4-103f702b7cba None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:51.903314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfcbbb-ba03-46a5-b4c4-103f702b7cba None admin] PATH_INFO: `/v3/domains/default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:51.904426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cfcbbb-ba03-46a5-b4c4-103f702b7cba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:51.905894 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cfcbbb-ba03-46a5-b4c4-103f702b7cba None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:51.907617 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 155/323] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:58:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:51.913246 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c248f-3d4a-40ea-997b-fefecc4daadb None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:51.960537 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:52.020225 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c248f-3d4a-40ea-997b-fefecc4daadb None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:52.054975 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148da2a-7d04-4a23-adac-304c754f0d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:52.055577 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148da2a-7d04-4a23-adac-304c754f0d06 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:52.055853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148da2a-7d04-4a23-adac-304c754f0d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:52.056119 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148da2a-7d04-4a23-adac-304c754f0d06 None admin] PATH_INFO: `/v3/groups` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:52.056750 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148da2a-7d04-4a23-adac-304c754f0d06 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:52.058219 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148da2a-7d04-4a23-adac-304c754f0d06 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:52.072932 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 169/324] 10.222.0.26 () {60 vars in 1134 bytes} [Tue Sep 13 13:58:51 2022] POST /identity/v3/groups => generated 226 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 13:58:52.098326 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec44ba-c582-42d7-bfbd-2b504bf33885 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:52.098849 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec44ba-c582-42d7-bfbd-2b504bf33885 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:52.098849 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec44ba-c582-42d7-bfbd-2b504bf33885 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:52.101027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 156/325] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:52.107327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f20143-2367-45f7-b7fb-50a0f4532186 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:52.107672 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f20143-2367-45f7-b7fb-50a0f4532186 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:52.107886 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f20143-2367-45f7-b7fb-50a0f4532186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:52.127002 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-17f20143-2367-45f7-b7fb-50a0f4532186 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:52.128325 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-17f20143-2367-45f7-b7fb-50a0f4532186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:52.128836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec44ba-c582-42d7-bfbd-2b504bf33885 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:52.207304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 170/326] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 13:58:52.245820 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec44ba-c582-42d7-bfbd-2b504bf33885 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:52.289736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00df590-9cb9-47f6-a105-649b2906836a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:52.290291 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00df590-9cb9-47f6-a105-649b2906836a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:52.290565 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00df590-9cb9-47f6-a105-649b2906836a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:52.290829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00df590-9cb9-47f6-a105-649b2906836a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:52.305735 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00df590-9cb9-47f6-a105-649b2906836a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:52.312099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-c00df590-9cb9-47f6-a105-649b2906836a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 13:58:52.312099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:52.312099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:52.312099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:52.312099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:52.312099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:52.312099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:52.312099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:52.312099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:52.312099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:52.312099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:52.312099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:52.312099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:52.312099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:52.312099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:52.312099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:52.312967 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:52.312967 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:52.312967 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:52.312967 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:52.312967 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:52.312967 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:52.312967 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:52.312967 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:52.312967 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:52.312967 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:52.312967 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:52.312967 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:52.312967 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:52.312967 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:52.312967 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:52.312967 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:52.313980 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:52.313980 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:52.313980 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:52.313980 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:52.313980 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:52.313980 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:52.313980 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:52.313980 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:52.313980 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:52.313980 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:52.313980 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 13:58:52.313980 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:58:52.318540 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 157/327] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:58:52.319856 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f20143-2367-45f7-b7fb-50a0f4532186 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:52.357823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:52.430799 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f20143-2367-45f7-b7fb-50a0f4532186 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:52.466919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbf6b3-a1ba-40f5-99d1-907bd60c7fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:52.467536 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbf6b3-a1ba-40f5-99d1-907bd60c7fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:52.467811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbf6b3-a1ba-40f5-99d1-907bd60c7fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:52.468141 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbf6b3-a1ba-40f5-99d1-907bd60c7fc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:52.468801 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbf6b3-a1ba-40f5-99d1-907bd60c7fc7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:52.469155 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbf6b3-a1ba-40f5-99d1-907bd60c7fc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:52.470542 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbf6b3-a1ba-40f5-99d1-907bd60c7fc7 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:52.481016 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 171/328] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 13 13:58:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:52.482583 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00df590-9cb9-47f6-a105-649b2906836a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:52.486463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbf6b3-a1ba-40f5-99d1-907bd60c7fc7 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:52.486598 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:52.618729 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:52.626930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00df590-9cb9-47f6-a105-649b2906836a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:52.629769 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbf6b3-a1ba-40f5-99d1-907bd60c7fc7 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:52.669640 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677762e-9b80-403d-a803-98641dbde303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:52.670298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677762e-9b80-403d-a803-98641dbde303 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:52.670574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677762e-9b80-403d-a803-98641dbde303 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:52.670842 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677762e-9b80-403d-a803-98641dbde303 None admin] PATH_INFO: `/v3/users/5f7da3eb52174b2d926a0611fe17102b` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:52.671948 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677762e-9b80-403d-a803-98641dbde303 None admin] RBAC: Authorizing `identity:get_user(user_id=5f7da3eb52174b2d926a0611fe17102b)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:52.673432 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677762e-9b80-403d-a803-98641dbde303 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:52.675159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 172/329] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:52 2022] GET /identity/v3/users/5f7da3eb52174b2d926a0611fe17102b => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:52.676513 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa6b9f-2273-4a57-af1a-3b34ba3fbf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:52.677241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa6b9f-2273-4a57-af1a-3b34ba3fbf55 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:52.678125 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa6b9f-2273-4a57-af1a-3b34ba3fbf55 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:52.678458 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa6b9f-2273-4a57-af1a-3b34ba3fbf55 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:52.681602 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677762e-9b80-403d-a803-98641dbde303 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:52.706017 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa6b9f-2273-4a57-af1a-3b34ba3fbf55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:52.712018 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-05fa6b9f-2273-4a57-af1a-3b34ba3fbf55 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:58:52.712018 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:52.712018 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:52.712018 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:52.712018 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:52.712018 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:52.712018 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:52.712018 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:52.712018 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:52.712018 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:52.712018 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:52.712018 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:52.712018 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:52.712018 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:52.712018 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:52.712018 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:52.713075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:52.713075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:52.713075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:52.713075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:52.713075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:52.713075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:52.713075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:52.713075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:52.713075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:52.713075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:52.713075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:52.713075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:52.713075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:52.713075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:52.713075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:52.713075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:52.713913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:52.713913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:52.713913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:52.713913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:52.713913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:52.713913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:52.713913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:52.713913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:52.713913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:52.713913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:52.713913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:58:52.713913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:58:52.713913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 158/330] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:52.719148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa6b9f-2273-4a57-af1a-3b34ba3fbf55 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:52.803344 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:52.809370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677762e-9b80-403d-a803-98641dbde303 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:52.856957 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf714b80-d5c5-47c7-9451-c04d409190b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:52.857791 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa6b9f-2273-4a57-af1a-3b34ba3fbf55 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:52.858050 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf714b80-d5c5-47c7-9451-c04d409190b7 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:52.858463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf714b80-d5c5-47c7-9451-c04d409190b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:52.858894 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf714b80-d5c5-47c7-9451-c04d409190b7 None admin] PATH_INFO: `/v3/system/users/5f7da3eb52174b2d926a0611fe17102b/roles/d11e68c76f6d4095a93949ee841afead` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:52.861487 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf714b80-d5c5-47c7-9451-c04d409190b7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5f7da3eb52174b2d926a0611fe17102b, role_id=d11e68c76f6d4095a93949ee841afead)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:52.863057 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf714b80-d5c5-47c7-9451-c04d409190b7 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:52.878158 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 173/331] 10.222.0.26 () {58 vars in 1334 bytes} [Tue Sep 13 13:58:52 2022] PUT /identity/v3/system/users/5f7da3eb52174b2d926a0611fe17102b/roles/d11e68c76f6d4095a93949ee841afead => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 13:58:52.905464 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22229781-50c0-461b-9cc9-5aaad5eec258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:52.906085 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22229781-50c0-461b-9cc9-5aaad5eec258 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:52.906358 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22229781-50c0-461b-9cc9-5aaad5eec258 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:52.906624 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22229781-50c0-461b-9cc9-5aaad5eec258 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:52.907313 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22229781-50c0-461b-9cc9-5aaad5eec258 None admin] RBAC: Adding query filter params (name=member) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:52.907613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22229781-50c0-461b-9cc9-5aaad5eec258 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:52.909654 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22229781-50c0-461b-9cc9-5aaad5eec258 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:52.920210 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 159/332] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 13 13:58:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:58:52.926265 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf714b80-d5c5-47c7-9451-c04d409190b7 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:52.962297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:53.049199 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf714b80-d5c5-47c7-9451-c04d409190b7 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:53.089650 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e598af-b6ea-4af9-8630-889747b9a81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:53.090285 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e598af-b6ea-4af9-8630-889747b9a81f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:53.090563 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e598af-b6ea-4af9-8630-889747b9a81f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:53.090829 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e598af-b6ea-4af9-8630-889747b9a81f None admin] PATH_INFO: `/v3/users/bb7eb88af4204fcdb934a3953cbb8de8` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:53.092039 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e598af-b6ea-4af9-8630-889747b9a81f None admin] RBAC: Authorizing `identity:get_user(user_id=bb7eb88af4204fcdb934a3953cbb8de8)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:53.093545 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e598af-b6ea-4af9-8630-889747b9a81f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:53.097701 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 174/333] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:52 2022] GET /identity/v3/users/bb7eb88af4204fcdb934a3953cbb8de8 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:53.102176 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22229781-50c0-461b-9cc9-5aaad5eec258 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:53.210975 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22229781-50c0-461b-9cc9-5aaad5eec258 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:53.237297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:53.246511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8526c3-c14f-450f-9d80-f4937491bad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:53.247583 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8526c3-c14f-450f-9d80-f4937491bad5 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:53.247854 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8526c3-c14f-450f-9d80-f4937491bad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:53.248117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8526c3-c14f-450f-9d80-f4937491bad5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:53.248844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8526c3-c14f-450f-9d80-f4937491bad5 None admin] RBAC: Adding query filter params (role.id=81a57b9863404b45acc1204670e387f2, user.id=bb7eb88af4204fcdb934a3953cbb8de8, scope.system=all) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:53.249168 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8526c3-c14f-450f-9d80-f4937491bad5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:53.250598 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8526c3-c14f-450f-9d80-f4937491bad5 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:53.263461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 160/334] 10.222.0.26 () {56 vars in 1308 bytes} [Tue Sep 13 13:58:53 2022] GET /identity/v3/role_assignments?user.id=bb7eb88af4204fcdb934a3953cbb8de8&scope.system=all&role.id=81a57b9863404b45acc1204670e387f2 => generated 510 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:54.679098 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f850c6-7557-4467-8bf6-6df4b9de4f7e None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:54.680055 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f850c6-7557-4467-8bf6-6df4b9de4f7e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:54.680524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f850c6-7557-4467-8bf6-6df4b9de4f7e None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:54.682401 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 175/335] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:54.687432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2860d-748e-4dd1-bc25-782d16afae4b None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:54.688235 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2860d-748e-4dd1-bc25-782d16afae4b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:54.688723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2860d-748e-4dd1-bc25-782d16afae4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:54.708450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-0fc2860d-748e-4dd1-bc25-782d16afae4b None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:54.710553 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0fc2860d-748e-4dd1-bc25-782d16afae4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:54.791244 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 161/336] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:55.153695 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f850c6-7557-4467-8bf6-6df4b9de4f7e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:55.310620 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:55.320929 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f850c6-7557-4467-8bf6-6df4b9de4f7e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:55.369439 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d58a40-1bd7-4199-9550-7cef24645bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:55.370083 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d58a40-1bd7-4199-9550-7cef24645bef None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:55.370355 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d58a40-1bd7-4199-9550-7cef24645bef None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:55.370621 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d58a40-1bd7-4199-9550-7cef24645bef None admin] PATH_INFO: `/v3/roles/member` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:55.383500 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d58a40-1bd7-4199-9550-7cef24645bef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:55.388554 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-a9d58a40-1bd7-4199-9550-7cef24645bef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:58:55.388554 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:55.388554 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:55.388554 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:55.388554 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:55.388554 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:55.388554 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:55.388554 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:55.388554 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:55.388554 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:55.388554 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:55.388554 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:55.388554 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:55.388554 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:55.388554 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:55.388554 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:55.389445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:55.389445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:55.389445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:55.389445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:55.389445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:55.389445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:55.389445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:55.389445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:55.389445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:55.389445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:55.389445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:55.389445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:55.389445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:55.389445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:55.389445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:55.389445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:55.390233 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:55.390233 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:55.390233 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:55.390233 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:55.390233 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:55.390233 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:55.390233 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:55.390233 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:55.390233 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:55.390233 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:55.390233 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:58:55.390233 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:58:55.390233 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 176/337] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:55.395776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2860d-748e-4dd1-bc25-782d16afae4b None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:55.503922 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2860d-748e-4dd1-bc25-782d16afae4b None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:55.518917 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:55.545907 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b866e5-eeae-4bc8-94ed-3a1730047af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:55.546570 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b866e5-eeae-4bc8-94ed-3a1730047af2 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:55.546846 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b866e5-eeae-4bc8-94ed-3a1730047af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:55.547108 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b866e5-eeae-4bc8-94ed-3a1730047af2 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:55.547768 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b866e5-eeae-4bc8-94ed-3a1730047af2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:55.548060 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b866e5-eeae-4bc8-94ed-3a1730047af2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:55.549464 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b866e5-eeae-4bc8-94ed-3a1730047af2 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:55.559102 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 162/338] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 13 13:58:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:55.564533 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d58a40-1bd7-4199-9550-7cef24645bef None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:55.583135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d719c34-dd73-4d1a-9389-9f6c6a77a572 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:55.583426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d719c34-dd73-4d1a-9389-9f6c6a77a572 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:55.584211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d719c34-dd73-4d1a-9389-9f6c6a77a572 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:55.586126 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 163/339] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:55.591548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0004bf1-95f7-4a5c-ba6e-82036588a75c None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:55.591821 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0004bf1-95f7-4a5c-ba6e-82036588a75c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:55.592088 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0004bf1-95f7-4a5c-ba6e-82036588a75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:55.634137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-a0004bf1-95f7-4a5c-ba6e-82036588a75c None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:55.635385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a0004bf1-95f7-4a5c-ba6e-82036588a75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:55.756893 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 164/340] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:55.787619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73790c44-1d91-47cb-b5de-d9debf86bf54 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:55.787922 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73790c44-1d91-47cb-b5de-d9debf86bf54 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:55.788162 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73790c44-1d91-47cb-b5de-d9debf86bf54 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:55.789923 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 165/341] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 13:58:55.793342 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d58a40-1bd7-4199-9550-7cef24645bef None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:55.795037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93619bed-bf5c-4cdc-96e9-8e87f2b80372 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:55.795320 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93619bed-bf5c-4cdc-96e9-8e87f2b80372 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:55.795591 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93619bed-bf5c-4cdc-96e9-8e87f2b80372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:55.830189 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-93619bed-bf5c-4cdc-96e9-8e87f2b80372 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:55.833175 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-93619bed-bf5c-4cdc-96e9-8e87f2b80372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:55.878324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7e838-0a24-4470-b43f-bfb12783e5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:55.878951 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7e838-0a24-4470-b43f-bfb12783e5fb None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:55.879262 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7e838-0a24-4470-b43f-bfb12783e5fb None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:55.879530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7e838-0a24-4470-b43f-bfb12783e5fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:55.931768 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:55.979954 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 166/342] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:55.986007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68e723-e772-4c26-858d-5555c54d2606 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:55.986519 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68e723-e772-4c26-858d-5555c54d2606 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:55.987011 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68e723-e772-4c26-858d-5555c54d2606 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:55.988488 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 167/343] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:55.996822 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0005ae-adc6-4486-807f-f6635f8249c6 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:55.997378 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0005ae-adc6-4486-807f-f6635f8249c6 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:55.997844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0005ae-adc6-4486-807f-f6635f8249c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:56.036237 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-9b0005ae-adc6-4486-807f-f6635f8249c6 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:56.038429 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-9b0005ae-adc6-4486-807f-f6635f8249c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:56.039343 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7e838-0a24-4470-b43f-bfb12783e5fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:56.041009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7e838-0a24-4470-b43f-bfb12783e5fb None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:56.113453 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:56.203700 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 168/344] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 13:58:56.223264 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 177/345] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:58:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:58:56.229505 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0005ae-adc6-4486-807f-f6635f8249c6 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:56.281219 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7e838-0a24-4470-b43f-bfb12783e5fb None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:56.357728 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:56.386061 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0005ae-adc6-4486-807f-f6635f8249c6 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:56.451021 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7e838-0a24-4470-b43f-bfb12783e5fb None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:56.458512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc7778-af34-440b-a8fc-0c58b289d5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:56.461548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc7778-af34-440b-a8fc-0c58b289d5b2 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:56.462056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc7778-af34-440b-a8fc-0c58b289d5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:56.462529 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc7778-af34-440b-a8fc-0c58b289d5b2 None admin] PATH_INFO: `/v3/projects/1aeb29de324e4f558c8157b5cd66f520` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:56.466729 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc7778-af34-440b-a8fc-0c58b289d5b2 None admin] RBAC: Authorizing `identity:get_project(project_id=1aeb29de324e4f558c8157b5cd66f520)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:56.468420 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc7778-af34-440b-a8fc-0c58b289d5b2 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:56.472982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 169/346] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:56 2022] GET /identity/v3/projects/1aeb29de324e4f558c8157b5cd66f520 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:56.474114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc7778-af34-440b-a8fc-0c58b289d5b2 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:56.522231 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43b570-e6a0-416c-8820-eea3f420c15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:56.523970 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43b570-e6a0-416c-8820-eea3f420c15a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:56.525123 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43b570-e6a0-416c-8820-eea3f420c15a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:56.525638 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43b570-e6a0-416c-8820-eea3f420c15a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:56.540660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:56.551598 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43b570-e6a0-416c-8820-eea3f420c15a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:56.557443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-6d43b570-e6a0-416c-8820-eea3f420c15a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 13:58:56.557443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:56.557443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:56.557443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:56.557443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:56.557443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:56.557443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:56.557443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:56.557443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:56.557443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:56.557443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:56.557443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:56.557443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:56.557443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:56.557443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:56.557443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:56.558313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:56.558313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:56.558313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:56.558313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:56.558313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:56.558313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:56.558313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:56.558313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:56.558313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:56.558313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:56.558313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:56.558313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:56.558313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:56.558313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:56.558313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:56.558313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:56.559088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:56.559088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:56.559088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:56.559088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:56.559088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:56.559088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:56.559088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:56.559088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:56.559088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:56.559088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:56.559088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 13:58:56.559088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:58:56.562957 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 178/347] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 13 13:58:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:58:56.563726 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43b570-e6a0-416c-8820-eea3f420c15a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:56.670407 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc7778-af34-440b-a8fc-0c58b289d5b2 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:56.715567 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fb2c3-b356-4c80-bddc-72550157fc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:56.716566 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fb2c3-b356-4c80-bddc-72550157fc50 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:56.716674 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43b570-e6a0-416c-8820-eea3f420c15a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:56.717205 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fb2c3-b356-4c80-bddc-72550157fc50 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:56.717693 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fb2c3-b356-4c80-bddc-72550157fc50 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:56.732829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233fb2c3-b356-4c80-bddc-72550157fc50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:56.737090 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:56.741154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-233fb2c3-b356-4c80-bddc-72550157fc50 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 13:58:56.741154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:56.741154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:56.741154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:56.741154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:56.741154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:56.741154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:56.741154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:56.741154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:56.741154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:56.741154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:56.741154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:56.741154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:56.741154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:56.741154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:56.741154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:56.742113 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:56.742113 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:56.742113 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:56.742113 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:56.742113 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:56.742113 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:56.742113 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:56.742113 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:56.742113 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:56.742113 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:56.742113 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:56.742113 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:56.742113 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:56.742113 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:56.742113 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:56.742113 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:56.742913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:56.742913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:56.742913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:56.742913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:56.742913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:56.742913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:56.742913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:56.742913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:56.742913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:56.742913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:56.742913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 13:58:56.742913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:58:56.746248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 170/348] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:56.747556 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fb2c3-b356-4c80-bddc-72550157fc50 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:56.761080 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb436d-484d-48fe-8ac9-a6a2027b5bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:56.762209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb436d-484d-48fe-8ac9-a6a2027b5bba None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:56.762499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb436d-484d-48fe-8ac9-a6a2027b5bba None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:56.762767 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb436d-484d-48fe-8ac9-a6a2027b5bba None admin] PATH_INFO: `/v3/groups/93f67a46fc8347c1915edc63ff6e57bd` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:56.769938 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb436d-484d-48fe-8ac9-a6a2027b5bba None admin] RBAC: Authorizing `identity:get_group(group_id=93f67a46fc8347c1915edc63ff6e57bd)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:56.772926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb436d-484d-48fe-8ac9-a6a2027b5bba None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:56.774916 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 179/349] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 13 13:58:56 2022] GET /identity/v3/groups/93f67a46fc8347c1915edc63ff6e57bd => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:56.780916 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb436d-484d-48fe-8ac9-a6a2027b5bba None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:56.884944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:56.898286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fb2c3-b356-4c80-bddc-72550157fc50 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:56.931137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb436d-484d-48fe-8ac9-a6a2027b5bba None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:56.947235 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3e70d-a74a-4c71-a793-feda30080d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:56.948230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3e70d-a74a-4c71-a793-feda30080d67 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:56.948713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3e70d-a74a-4c71-a793-feda30080d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:56.949290 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3e70d-a74a-4c71-a793-feda30080d67 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:56.950272 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3e70d-a74a-4c71-a793-feda30080d67 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:56.950753 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3e70d-a74a-4c71-a793-feda30080d67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:56.952311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3e70d-a74a-4c71-a793-feda30080d67 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:56.963681 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 171/350] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:58:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:56.964778 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3e70d-a74a-4c71-a793-feda30080d67 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:56.983665 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176fb22-ba0d-4b6e-ad0f-227495b89bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:56.984449 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176fb22-ba0d-4b6e-ad0f-227495b89bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:56.984743 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176fb22-ba0d-4b6e-ad0f-227495b89bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:56.985081 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176fb22-ba0d-4b6e-ad0f-227495b89bb3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:57.000389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176fb22-ba0d-4b6e-ad0f-227495b89bb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:57.006688 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-f176fb22-ba0d-4b6e-ad0f-227495b89bb3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:58:57.006688 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:57.006688 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:57.006688 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:57.006688 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:57.006688 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:57.006688 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:57.006688 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:57.006688 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:57.006688 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:57.006688 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:57.006688 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:57.006688 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:57.006688 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:57.006688 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:57.006688 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:57.007597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:57.007597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:57.007597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:57.007597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:57.007597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:57.007597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:57.007597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:57.007597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:57.007597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:57.007597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:57.007597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:57.007597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:57.007597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:57.007597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:57.007597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:57.007597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:57.008389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:57.008389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:57.008389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:57.008389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:57.008389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:57.008389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:57.008389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:57.008389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:57.008389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:57.008389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:57.008389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:58:57.008389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:58:57.008389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 180/351] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:57.013335 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176fb22-ba0d-4b6e-ad0f-227495b89bb3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:57.068739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:57.092318 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3e70d-a74a-4c71-a793-feda30080d67 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:57.142735 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d1262-91f2-4a08-91e8-1d6229850722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:57.143266 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d1262-91f2-4a08-91e8-1d6229850722 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:57.143549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d1262-91f2-4a08-91e8-1d6229850722 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:57.143817 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d1262-91f2-4a08-91e8-1d6229850722 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:57.144484 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d1262-91f2-4a08-91e8-1d6229850722 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:57.144791 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d1262-91f2-4a08-91e8-1d6229850722 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:57.146799 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d1262-91f2-4a08-91e8-1d6229850722 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:57.149828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176fb22-ba0d-4b6e-ad0f-227495b89bb3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:57.157024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 172/352] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 13 13:58:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:57.158784 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d1262-91f2-4a08-91e8-1d6229850722 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:57.189814 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:57.196671 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f317d-c6e1-4f00-b813-625680cb18cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:57.197328 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f317d-c6e1-4f00-b813-625680cb18cd None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:57.197609 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f317d-c6e1-4f00-b813-625680cb18cd None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:57.197883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f317d-c6e1-4f00-b813-625680cb18cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:57.198733 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f317d-c6e1-4f00-b813-625680cb18cd None admin] RBAC: Adding query filter params (group.id=93f67a46fc8347c1915edc63ff6e57bd, role.id=81a57b9863404b45acc1204670e387f2, scope.project.id=1aeb29de324e4f558c8157b5cd66f520) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:57.199047 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f317d-c6e1-4f00-b813-625680cb18cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:57.200634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f317d-c6e1-4f00-b813-625680cb18cd None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:57.206988 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 181/353] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Sep 13 13:58:57 2022] GET /identity/v3/role_assignments?group.id=93f67a46fc8347c1915edc63ff6e57bd&scope.project.id=1aeb29de324e4f558c8157b5cd66f520&role.id=81a57b9863404b45acc1204670e387f2 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:57.207735 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f317d-c6e1-4f00-b813-625680cb18cd None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:57.306674 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d1262-91f2-4a08-91e8-1d6229850722 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:57.347716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89190794-6a53-4f86-a002-1d089d3944b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:57.348321 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89190794-6a53-4f86-a002-1d089d3944b5 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:57.348599 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89190794-6a53-4f86-a002-1d089d3944b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:57.348886 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89190794-6a53-4f86-a002-1d089d3944b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:57.363259 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f317d-c6e1-4f00-b813-625680cb18cd None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:57.367710 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:57.424037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883139dc-8117-43ba-8334-e26857a69598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:57.424977 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883139dc-8117-43ba-8334-e26857a69598 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:57.425426 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883139dc-8117-43ba-8334-e26857a69598 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:57.425898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883139dc-8117-43ba-8334-e26857a69598 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:57.427494 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883139dc-8117-43ba-8334-e26857a69598 None admin] RBAC: Adding query filter params (name=member) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:57.427494 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883139dc-8117-43ba-8334-e26857a69598 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:57.428888 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883139dc-8117-43ba-8334-e26857a69598 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:57.442573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 182/354] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 13 13:58:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:57.444202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901aa09-7a9a-48ab-8da0-8c61ef2967c6 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:57.444489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901aa09-7a9a-48ab-8da0-8c61ef2967c6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:57.444762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901aa09-7a9a-48ab-8da0-8c61ef2967c6 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:57.446216 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 183/355] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:57.446789 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901aa09-7a9a-48ab-8da0-8c61ef2967c6 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:57.449986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89190794-6a53-4f86-a002-1d089d3944b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:57.451642 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89190794-6a53-4f86-a002-1d089d3944b5 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:57.473754 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:57.579208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901aa09-7a9a-48ab-8da0-8c61ef2967c6 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:57.582235 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 173/356] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:58:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:58:57.583551 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bec1f-1b06-486f-9ef7-63ba380dafab None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:57.585688 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bec1f-1b06-486f-9ef7-63ba380dafab None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:57.586063 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bec1f-1b06-486f-9ef7-63ba380dafab None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:57.587748 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 174/357] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:57.588479 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bec1f-1b06-486f-9ef7-63ba380dafab None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:57.627528 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40e315-72d5-4e1b-b0c7-b6e77c0cbccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:57.628156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40e315-72d5-4e1b-b0c7-b6e77c0cbccd None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:57.628429 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40e315-72d5-4e1b-b0c7-b6e77c0cbccd None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:57.628692 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40e315-72d5-4e1b-b0c7-b6e77c0cbccd None admin] PATH_INFO: `/v3/users/5f7da3eb52174b2d926a0611fe17102b` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:57.629839 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40e315-72d5-4e1b-b0c7-b6e77c0cbccd None admin] RBAC: Authorizing `identity:get_user(user_id=5f7da3eb52174b2d926a0611fe17102b)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:57.631820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40e315-72d5-4e1b-b0c7-b6e77c0cbccd None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:57.635984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 184/358] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 13:58:57 2022] GET /identity/v3/users/5f7da3eb52174b2d926a0611fe17102b => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:57.636531 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cabf2-c41f-454a-8b97-1d3e313ac914 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:57.636812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cabf2-c41f-454a-8b97-1d3e313ac914 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:57.638998 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cabf2-c41f-454a-8b97-1d3e313ac914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:57.655750 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-545cabf2-c41f-454a-8b97-1d3e313ac914 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:57.656941 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-545cabf2-c41f-454a-8b97-1d3e313ac914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:57.699265 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:57.734709 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bec1f-1b06-486f-9ef7-63ba380dafab None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:57.754808 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 185/359] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:57.755542 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545cabf2-c41f-454a-8b97-1d3e313ac914 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:57.763976 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:57.788082 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3436db-b190-422e-ab20-7ef7e3c47d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:57.788993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3436db-b190-422e-ab20-7ef7e3c47d5a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:57.790184 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3436db-b190-422e-ab20-7ef7e3c47d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:57.790455 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3436db-b190-422e-ab20-7ef7e3c47d5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:57.872090 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545cabf2-c41f-454a-8b97-1d3e313ac914 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:57.873845 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3436db-b190-422e-ab20-7ef7e3c47d5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:57.876207 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3436db-b190-422e-ab20-7ef7e3c47d5a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:57.912873 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c61d09-0101-411b-a58c-ff5f1dc9f5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:57.913549 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c61d09-0101-411b-a58c-ff5f1dc9f5ce None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:57.913832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c61d09-0101-411b-a58c-ff5f1dc9f5ce None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:57.914103 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c61d09-0101-411b-a58c-ff5f1dc9f5ce None admin] PATH_INFO: `/v3/projects/1aeb29de324e4f558c8157b5cd66f520` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:57.915224 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c61d09-0101-411b-a58c-ff5f1dc9f5ce None admin] RBAC: Authorizing `identity:get_project(project_id=1aeb29de324e4f558c8157b5cd66f520)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:57.916885 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c61d09-0101-411b-a58c-ff5f1dc9f5ce None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:57.919154 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 186/360] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:57 2022] GET /identity/v3/projects/1aeb29de324e4f558c8157b5cd66f520 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:57.919700 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ae3fa-db74-4dcc-a677-bc27affb38fb None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:57.919984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ae3fa-db74-4dcc-a677-bc27affb38fb None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:57.920252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ae3fa-db74-4dcc-a677-bc27affb38fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:57.943356 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f93ae3fa-db74-4dcc-a677-bc27affb38fb None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:57.944687 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f93ae3fa-db74-4dcc-a677-bc27affb38fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:57.973944 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:57.997597 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 175/361] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:58:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:58:57.999752 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3436db-b190-422e-ab20-7ef7e3c47d5a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:58.028192 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:58.038718 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 187/362] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:58.040167 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ae3fa-db74-4dcc-a677-bc27affb38fb None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:58.151101 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3436db-b190-422e-ab20-7ef7e3c47d5a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:58.188169 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ae3fa-db74-4dcc-a677-bc27affb38fb None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:58.192306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71692c66-68a6-4769-b4ef-ad952f7f21b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:58.193727 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71692c66-68a6-4769-b4ef-ad952f7f21b2 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:58.194197 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71692c66-68a6-4769-b4ef-ad952f7f21b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:58.194651 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71692c66-68a6-4769-b4ef-ad952f7f21b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:58.195560 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71692c66-68a6-4769-b4ef-ad952f7f21b2 None admin] RBAC: Adding query filter params (role.id=d11e68c76f6d4095a93949ee841afead, user.id=5f7da3eb52174b2d926a0611fe17102b, scope.system=all) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:58.196055 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71692c66-68a6-4769-b4ef-ad952f7f21b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:58.198172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71692c66-68a6-4769-b4ef-ad952f7f21b2 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:58.213013 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 176/363] 10.222.0.26 () {56 vars in 1308 bytes} [Tue Sep 13 13:58:57 2022] GET /identity/v3/role_assignments?user.id=5f7da3eb52174b2d926a0611fe17102b&scope.system=all&role.id=d11e68c76f6d4095a93949ee841afead => generated 510 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:58.214174 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71692c66-68a6-4769-b4ef-ad952f7f21b2 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:58.242509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c13ed-233d-4eb0-a001-3049185a4a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:58.243140 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c13ed-233d-4eb0-a001-3049185a4a7a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:58.243423 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c13ed-233d-4eb0-a001-3049185a4a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:58.243694 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c13ed-233d-4eb0-a001-3049185a4a7a None admin] PATH_INFO: `/v3/groups/93f67a46fc8347c1915edc63ff6e57bd` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:58.245005 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c13ed-233d-4eb0-a001-3049185a4a7a None admin] RBAC: Authorizing `identity:get_group(group_id=93f67a46fc8347c1915edc63ff6e57bd)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:58.246604 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c13ed-233d-4eb0-a001-3049185a4a7a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:58.248576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 188/364] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 13 13:58:58 2022] GET /identity/v3/groups/93f67a46fc8347c1915edc63ff6e57bd => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:58.249329 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c13ed-233d-4eb0-a001-3049185a4a7a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:58.304547 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:58.343023 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:58.386305 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71692c66-68a6-4769-b4ef-ad952f7f21b2 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:58.418337 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c13ed-233d-4eb0-a001-3049185a4a7a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:58.432490 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e42c9-40dd-4bf1-9d49-f9b73ff3c56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:58.433593 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e42c9-40dd-4bf1-9d49-f9b73ff3c56a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:58.434386 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e42c9-40dd-4bf1-9d49-f9b73ff3c56a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:58.434730 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e42c9-40dd-4bf1-9d49-f9b73ff3c56a None admin] PATH_INFO: `/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:58.436265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e42c9-40dd-4bf1-9d49-f9b73ff3c56a None admin] RBAC: Authorizing `identity:get_project(project_id=11155a320d8a4d4bb8eebe5129dd9cf8)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:58.437995 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e42c9-40dd-4bf1-9d49-f9b73ff3c56a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:58.440242 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 177/365] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:58 2022] GET /identity/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:58.441192 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e42c9-40dd-4bf1-9d49-f9b73ff3c56a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:58.458254 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7957de-2ed3-49de-8197-ca7d3061a87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:58.458961 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7957de-2ed3-49de-8197-ca7d3061a87c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:58.459237 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7957de-2ed3-49de-8197-ca7d3061a87c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:58.459502 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7957de-2ed3-49de-8197-ca7d3061a87c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:58.475813 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7957de-2ed3-49de-8197-ca7d3061a87c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:58.483771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-9e7957de-2ed3-49de-8197-ca7d3061a87c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 13:58:58.483771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:58.483771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:58.483771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:58.483771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:58.483771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:58.483771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:58.483771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:58.483771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:58.483771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:58.483771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:58.483771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:58.483771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:58.483771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:58.483771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:58.483771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:58.484730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:58.484730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:58.484730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:58.484730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:58.484730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:58.484730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:58.484730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:58.484730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:58.484730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:58.484730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:58.484730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:58.484730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:58.484730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:58.484730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:58.484730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:58.484730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:58.485611 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:58.485611 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:58.485611 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:58.485611 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:58.485611 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:58.485611 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:58.485611 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:58.485611 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:58.485611 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:58.485611 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:58.485611 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 13:58:58.485611 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:58:58.485611 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 189/366] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 13 13:58:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:58.486269 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7957de-2ed3-49de-8197-ca7d3061a87c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:58.586254 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e42c9-40dd-4bf1-9d49-f9b73ff3c56a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:58.601730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:58.618942 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7957de-2ed3-49de-8197-ca7d3061a87c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:58.639563 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732e392-b0b4-403a-acfa-9f36faea19b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:58.640169 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732e392-b0b4-403a-acfa-9f36faea19b9 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:58.640443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732e392-b0b4-403a-acfa-9f36faea19b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:58.640709 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732e392-b0b4-403a-acfa-9f36faea19b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:58.641471 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732e392-b0b4-403a-acfa-9f36faea19b9 None admin] RBAC: Adding query filter params (group.id=93f67a46fc8347c1915edc63ff6e57bd, role.id=cf8554dac8d343549802afd60c56c0d6, scope.project.id=1aeb29de324e4f558c8157b5cd66f520) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:58.641899 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732e392-b0b4-403a-acfa-9f36faea19b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:58.643336 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732e392-b0b4-403a-acfa-9f36faea19b9 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:58.652852 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 178/367] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Sep 13 13:58:58 2022] GET /identity/v3/role_assignments?group.id=93f67a46fc8347c1915edc63ff6e57bd&scope.project.id=1aeb29de324e4f558c8157b5cd66f520&role.id=cf8554dac8d343549802afd60c56c0d6 => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:58.654014 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732e392-b0b4-403a-acfa-9f36faea19b9 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:58.663864 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeaa2ff-f821-4829-a3a7-3bbdaedfeed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:58.664515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeaa2ff-f821-4829-a3a7-3bbdaedfeed4 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:58.664790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeaa2ff-f821-4829-a3a7-3bbdaedfeed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:58.665058 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeaa2ff-f821-4829-a3a7-3bbdaedfeed4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:58.669501 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:58.681387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeaa2ff-f821-4829-a3a7-3bbdaedfeed4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:58:58.688633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-4eeaa2ff-f821-4829-a3a7-3bbdaedfeed4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:58:58.688633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:58:58.688633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:58:58.688633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:58:58.688633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:58:58.688633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:58:58.688633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:58:58.688633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:58:58.688633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:58:58.688633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:58:58.688633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:58:58.688633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:58:58.688633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:58:58.688633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:58:58.688633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:58:58.688633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:58:58.689699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:58:58.689699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:58:58.689699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:58:58.689699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:58:58.689699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:58:58.689699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:58:58.689699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:58:58.689699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:58:58.689699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:58:58.689699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:58:58.689699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:58:58.689699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:58:58.689699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:58:58.689699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:58:58.689699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:58:58.689699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:58:58.690524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:58:58.690524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:58:58.690524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:58:58.690524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:58:58.690524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:58:58.690524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:58:58.690524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:58:58.690524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:58:58.690524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:58:58.690524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:58:58.690524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:58:58.690524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:58:58.690524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 190/368] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 13:58:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:58:58.691200 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeaa2ff-f821-4829-a3a7-3bbdaedfeed4 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:58.817071 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732e392-b0b4-403a-acfa-9f36faea19b9 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:58.842004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeaa2ff-f821-4829-a3a7-3bbdaedfeed4 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:58.862645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a038ae-12f3-4d00-895b-45450af23461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:58.863684 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a038ae-12f3-4d00-895b-45450af23461 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:58.863961 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a038ae-12f3-4d00-895b-45450af23461 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:58.864230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a038ae-12f3-4d00-895b-45450af23461 None admin] PATH_INFO: `/v3/groups/93f67a46fc8347c1915edc63ff6e57bd` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:58.868697 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a038ae-12f3-4d00-895b-45450af23461 None admin] RBAC: Authorizing `identity:get_group(group_id=93f67a46fc8347c1915edc63ff6e57bd)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:58.870486 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a038ae-12f3-4d00-895b-45450af23461 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:58.872538 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 179/369] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 13 13:58:58 2022] GET /identity/v3/groups/93f67a46fc8347c1915edc63ff6e57bd => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:58.873552 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a038ae-12f3-4d00-895b-45450af23461 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:58.884578 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fde33e-19c0-4a0d-887e-fb6e0054521f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:58.885542 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fde33e-19c0-4a0d-887e-fb6e0054521f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:58.886033 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fde33e-19c0-4a0d-887e-fb6e0054521f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:58.886505 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fde33e-19c0-4a0d-887e-fb6e0054521f None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:58.887374 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fde33e-19c0-4a0d-887e-fb6e0054521f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:58.887890 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fde33e-19c0-4a0d-887e-fb6e0054521f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:58.889574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fde33e-19c0-4a0d-887e-fb6e0054521f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:58.898608 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 191/370] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:58:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:58.899741 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fde33e-19c0-4a0d-887e-fb6e0054521f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:58.916859 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:58.964863 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:58.993315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a038ae-12f3-4d00-895b-45450af23461 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:59.017911 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fde33e-19c0-4a0d-887e-fb6e0054521f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:59.034779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92e134-db5b-443e-9a11-e39da414b404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:59.035430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92e134-db5b-443e-9a11-e39da414b404 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:59.035710 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92e134-db5b-443e-9a11-e39da414b404 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:59.036010 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92e134-db5b-443e-9a11-e39da414b404 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:59.037321 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92e134-db5b-443e-9a11-e39da414b404 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:59.037623 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92e134-db5b-443e-9a11-e39da414b404 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:59.039007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92e134-db5b-443e-9a11-e39da414b404 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:59.049899 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 180/371] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:58:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:59.050814 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92e134-db5b-443e-9a11-e39da414b404 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:59.060330 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a4fbf-2c56-4561-a891-1081c90e7c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:59.061409 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a4fbf-2c56-4561-a891-1081c90e7c1f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:59.061891 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a4fbf-2c56-4561-a891-1081c90e7c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:59.063061 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a4fbf-2c56-4561-a891-1081c90e7c1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:59.064081 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a4fbf-2c56-4561-a891-1081c90e7c1f None admin] RBAC: Adding query filter params (group.id=93f67a46fc8347c1915edc63ff6e57bd, role.id=81a57b9863404b45acc1204670e387f2, scope.project.id=11155a320d8a4d4bb8eebe5129dd9cf8) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:58:59.064598 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a4fbf-2c56-4561-a891-1081c90e7c1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:59.066322 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a4fbf-2c56-4561-a891-1081c90e7c1f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:59.073294 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 192/372] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Sep 13 13:58:58 2022] GET /identity/v3/role_assignments?group.id=93f67a46fc8347c1915edc63ff6e57bd&scope.project.id=11155a320d8a4d4bb8eebe5129dd9cf8&role.id=81a57b9863404b45acc1204670e387f2 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:59.074366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a4fbf-2c56-4561-a891-1081c90e7c1f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:59.206663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92e134-db5b-443e-9a11-e39da414b404 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:59.236862 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:59.272436 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a4fbf-2c56-4561-a891-1081c90e7c1f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:59.287440 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69b4b6-8429-4477-9f97-4b5613a0f37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:59.288440 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69b4b6-8429-4477-9f97-4b5613a0f37b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:59.288936 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69b4b6-8429-4477-9f97-4b5613a0f37b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:59.289423 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69b4b6-8429-4477-9f97-4b5613a0f37b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:59.302852 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:59.356495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db52091-cb6a-4c17-bbdb-f8d5f9dc594d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:59.357636 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db52091-cb6a-4c17-bbdb-f8d5f9dc594d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:59.358140 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db52091-cb6a-4c17-bbdb-f8d5f9dc594d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:59.358703 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db52091-cb6a-4c17-bbdb-f8d5f9dc594d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:59.375702 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69b4b6-8429-4477-9f97-4b5613a0f37b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:59.377217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69b4b6-8429-4477-9f97-4b5613a0f37b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:59.453934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db52091-cb6a-4c17-bbdb-f8d5f9dc594d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:59.455766 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db52091-cb6a-4c17-bbdb-f8d5f9dc594d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:59.499887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 181/373] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:58:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:58:59.504958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69b4b6-8429-4477-9f97-4b5613a0f37b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:59.543443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:59.558662 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:59.574248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 193/374] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:58:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:58:59.580125 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db52091-cb6a-4c17-bbdb-f8d5f9dc594d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:59.663914 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69b4b6-8429-4477-9f97-4b5613a0f37b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:59.694763 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db52091-cb6a-4c17-bbdb-f8d5f9dc594d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:59.716542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78a3d9-7bd2-4111-b99f-a368be14fbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:59.717466 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78a3d9-7bd2-4111-b99f-a368be14fbc0 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:59.717909 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78a3d9-7bd2-4111-b99f-a368be14fbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:59.718328 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78a3d9-7bd2-4111-b99f-a368be14fbc0 None admin] PATH_INFO: `/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:59.722234 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78a3d9-7bd2-4111-b99f-a368be14fbc0 None admin] RBAC: Authorizing `identity:get_project(project_id=11155a320d8a4d4bb8eebe5129dd9cf8)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:59.724512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78a3d9-7bd2-4111-b99f-a368be14fbc0 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:59.726925 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 182/375] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:59 2022] GET /identity/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:58:59.728300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dae4ef-8a8e-4ca1-bb62-32f03bec7ad9 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:59.728865 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dae4ef-8a8e-4ca1-bb62-32f03bec7ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:59.729347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dae4ef-8a8e-4ca1-bb62-32f03bec7ad9 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:59.731209 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 183/376] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:58:59.732171 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dae4ef-8a8e-4ca1-bb62-32f03bec7ad9 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:59.734732 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a5570-8efe-4dc8-b4ac-b2406e4ca729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:59.735532 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a5570-8efe-4dc8-b4ac-b2406e4ca729 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:59.735940 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a5570-8efe-4dc8-b4ac-b2406e4ca729 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:59.736337 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a5570-8efe-4dc8-b4ac-b2406e4ca729 None admin] PATH_INFO: `/v3/projects/b2ed08b3b52d45f68ee1e0b8c4e4ceb4` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:59.737792 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a5570-8efe-4dc8-b4ac-b2406e4ca729 None admin] RBAC: Authorizing `identity:get_project(project_id=b2ed08b3b52d45f68ee1e0b8c4e4ceb4)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:59.739236 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a5570-8efe-4dc8-b4ac-b2406e4ca729 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:59.741261 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 194/377] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:58:59 2022] GET /identity/v3/projects/b2ed08b3b52d45f68ee1e0b8c4e4ceb4 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:58:59.742190 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0333e-b688-4a57-aef1-68b691996bf8 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:59.742465 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0333e-b688-4a57-aef1-68b691996bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:59.742730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0333e-b688-4a57-aef1-68b691996bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:59.767899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-6ca0333e-b688-4a57-aef1-68b691996bf8 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:58:59.769034 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6ca0333e-b688-4a57-aef1-68b691996bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:58:59.819938 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:59.856995 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 195/378] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:58:59.857700 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0333e-b688-4a57-aef1-68b691996bf8 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:59.883743 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dae4ef-8a8e-4ca1-bb62-32f03bec7ad9 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:58:59.895908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:58:59.930873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4e809-136b-42b0-86a1-eaa8a833f78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:58:59.931539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4e809-136b-42b0-86a1-eaa8a833f78b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:58:59.931815 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4e809-136b-42b0-86a1-eaa8a833f78b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:58:59.932085 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4e809-136b-42b0-86a1-eaa8a833f78b None admin] PATH_INFO: `/v3/groups/93f67a46fc8347c1915edc63ff6e57bd` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:58:59.933405 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc4e809-136b-42b0-86a1-eaa8a833f78b None admin] RBAC: Authorizing `identity:get_group(group_id=93f67a46fc8347c1915edc63ff6e57bd)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:58:59.934860 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc4e809-136b-42b0-86a1-eaa8a833f78b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:58:59.936622 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 184/379] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 13 13:58:59 2022] GET /identity/v3/groups/93f67a46fc8347c1915edc63ff6e57bd => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:58:59.943841 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4e809-136b-42b0-86a1-eaa8a833f78b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:58:59.997214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0333e-b688-4a57-aef1-68b691996bf8 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:00.038359 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b59eeb-e070-464d-95d3-94f2c7b0fec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:00.038969 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b59eeb-e070-464d-95d3-94f2c7b0fec1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:00.039336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b59eeb-e070-464d-95d3-94f2c7b0fec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:00.039672 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b59eeb-e070-464d-95d3-94f2c7b0fec1 None admin] PATH_INFO: `/v3/groups/6ddf8af8c52d4c1b810bfa6fa316c44c` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:00.045056 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b59eeb-e070-464d-95d3-94f2c7b0fec1 None admin] RBAC: Authorizing `identity:get_group(group_id=6ddf8af8c52d4c1b810bfa6fa316c44c)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:00.046844 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b59eeb-e070-464d-95d3-94f2c7b0fec1 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:00.048703 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 196/380] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 13 13:58:59 2022] GET /identity/v3/groups/6ddf8af8c52d4c1b810bfa6fa316c44c => generated 229 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:00.070642 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b59eeb-e070-464d-95d3-94f2c7b0fec1 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:00.075960 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4e809-136b-42b0-86a1-eaa8a833f78b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:00.115475 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c606815-4f62-45a6-9ca1-4b22e76121d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:00.116466 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c606815-4f62-45a6-9ca1-4b22e76121d2 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:00.116913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c606815-4f62-45a6-9ca1-4b22e76121d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:00.117360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c606815-4f62-45a6-9ca1-4b22e76121d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:00.118413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c606815-4f62-45a6-9ca1-4b22e76121d2 None admin] RBAC: Adding query filter params (group.id=93f67a46fc8347c1915edc63ff6e57bd, role.id=cf8554dac8d343549802afd60c56c0d6, scope.project.id=11155a320d8a4d4bb8eebe5129dd9cf8) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:00.118859 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c606815-4f62-45a6-9ca1-4b22e76121d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:00.121004 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c606815-4f62-45a6-9ca1-4b22e76121d2 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:00.128216 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 185/381] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Sep 13 13:58:59 2022] GET /identity/v3/role_assignments?group.id=93f67a46fc8347c1915edc63ff6e57bd&scope.project.id=11155a320d8a4d4bb8eebe5129dd9cf8&role.id=cf8554dac8d343549802afd60c56c0d6 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:00.149530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:00.201211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c606815-4f62-45a6-9ca1-4b22e76121d2 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:00.248188 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:00.255492 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b59eeb-e070-464d-95d3-94f2c7b0fec1 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:00.331026 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c606815-4f62-45a6-9ca1-4b22e76121d2 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:00.335555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d9be8-6ebd-4bed-8d18-cc7bc2770ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:00.336174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d9be8-6ebd-4bed-8d18-cc7bc2770ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:00.336447 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d9be8-6ebd-4bed-8d18-cc7bc2770ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:00.336709 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d9be8-6ebd-4bed-8d18-cc7bc2770ad2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:00.341303 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d9be8-6ebd-4bed-8d18-cc7bc2770ad2 None admin] RBAC: Adding query filter params (group.id=6ddf8af8c52d4c1b810bfa6fa316c44c, role.id=6dcc8495d2b24b3eab63dd656eb4eb6d, scope.project.id=b2ed08b3b52d45f68ee1e0b8c4e4ceb4) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:00.341303 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d9be8-6ebd-4bed-8d18-cc7bc2770ad2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:00.341303 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d9be8-6ebd-4bed-8d18-cc7bc2770ad2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:00.346127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 197/382] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Sep 13 13:59:00 2022] GET /identity/v3/role_assignments?group.id=6ddf8af8c52d4c1b810bfa6fa316c44c&scope.project.id=b2ed08b3b52d45f68ee1e0b8c4e4ceb4&role.id=6dcc8495d2b24b3eab63dd656eb4eb6d => generated 260 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:00.400825 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da6e93-7657-45be-8b6b-7b580b82ba40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:00.401504 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da6e93-7657-45be-8b6b-7b580b82ba40 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:00.401784 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da6e93-7657-45be-8b6b-7b580b82ba40 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:00.402058 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da6e93-7657-45be-8b6b-7b580b82ba40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:00.415037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da6e93-7657-45be-8b6b-7b580b82ba40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:00.420721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-b8da6e93-7657-45be-8b6b-7b580b82ba40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:59:00.420721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:00.420721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:00.420721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:00.420721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:00.420721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:00.420721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:00.420721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:00.420721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:00.420721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:00.420721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:00.420721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:00.420721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:00.420721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:00.420721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:00.420721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:00.421690 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:00.421690 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:00.421690 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:00.421690 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:00.421690 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:00.421690 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:00.421690 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:00.421690 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:00.421690 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:00.421690 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:00.421690 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:00.421690 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:00.421690 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:00.421690 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:00.421690 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:00.421690 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:00.422467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:00.422467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:00.422467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:00.422467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:00.422467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:00.422467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:00.422467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:00.422467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:00.422467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:00.422467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:00.422467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:59:00.422467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:00.426670 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 186/383] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:59:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:59:00.434886 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d9be8-6ebd-4bed-8d18-cc7bc2770ad2 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:00.563431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d9be8-6ebd-4bed-8d18-cc7bc2770ad2 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:00.565325 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:00.602984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df6a8e-34d4-48b8-9447-982f20cec36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:00.603894 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df6a8e-34d4-48b8-9447-982f20cec36f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:00.604369 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df6a8e-34d4-48b8-9447-982f20cec36f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:00.604821 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df6a8e-34d4-48b8-9447-982f20cec36f None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:00.605698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df6a8e-34d4-48b8-9447-982f20cec36f None admin] RBAC: Adding query filter params (name=member) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:00.606180 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df6a8e-34d4-48b8-9447-982f20cec36f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:00.607885 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df6a8e-34d4-48b8-9447-982f20cec36f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:00.618422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 198/384] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 13 13:59:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:00.624140 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da6e93-7657-45be-8b6b-7b580b82ba40 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:00.729464 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:00.733950 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da6e93-7657-45be-8b6b-7b580b82ba40 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:00.772589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b461e-ef98-4a7f-8b18-13cd1e249d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:00.773279 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b461e-ef98-4a7f-8b18-13cd1e249d67 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:00.773559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b461e-ef98-4a7f-8b18-13cd1e249d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:00.773830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b461e-ef98-4a7f-8b18-13cd1e249d67 None admin] PATH_INFO: `/v3/groups/93f67a46fc8347c1915edc63ff6e57bd` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:00.774983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b461e-ef98-4a7f-8b18-13cd1e249d67 None admin] RBAC: Authorizing `identity:get_group(group_id=93f67a46fc8347c1915edc63ff6e57bd)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:00.776453 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b461e-ef98-4a7f-8b18-13cd1e249d67 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:00.778408 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 187/385] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 13 13:59:00 2022] GET /identity/v3/groups/93f67a46fc8347c1915edc63ff6e57bd => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:00.784372 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df6a8e-34d4-48b8-9447-982f20cec36f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:00.919850 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df6a8e-34d4-48b8-9447-982f20cec36f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:00.962680 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05aa84f-f551-4c41-b5ac-de2823dbb5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:00.963657 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05aa84f-f551-4c41-b5ac-de2823dbb5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:00.964143 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05aa84f-f551-4c41-b5ac-de2823dbb5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:00.964609 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05aa84f-f551-4c41-b5ac-de2823dbb5e8 None admin] PATH_INFO: `/v3/projects/1aeb29de324e4f558c8157b5cd66f520` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:00.965943 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05aa84f-f551-4c41-b5ac-de2823dbb5e8 None admin] RBAC: Authorizing `identity:get_project(project_id=1aeb29de324e4f558c8157b5cd66f520)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:00.967660 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05aa84f-f551-4c41-b5ac-de2823dbb5e8 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:00.969890 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 199/386] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:59:00 2022] GET /identity/v3/projects/1aeb29de324e4f558c8157b5cd66f520 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:00.975292 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b461e-ef98-4a7f-8b18-13cd1e249d67 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:01.108591 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b461e-ef98-4a7f-8b18-13cd1e249d67 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:01.148593 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe0aa0-9110-4e25-9167-2454c9351f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:01.149667 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe0aa0-9110-4e25-9167-2454c9351f55 None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:01.150146 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe0aa0-9110-4e25-9167-2454c9351f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:01.150628 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe0aa0-9110-4e25-9167-2454c9351f55 None admin] PATH_INFO: `/v3/projects/1aeb29de324e4f558c8157b5cd66f520/groups/93f67a46fc8347c1915edc63ff6e57bd/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:01.152751 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe0aa0-9110-4e25-9167-2454c9351f55 None admin] RBAC: Authorizing `identity:create_grant(project_id=1aeb29de324e4f558c8157b5cd66f520, group_id=93f67a46fc8347c1915edc63ff6e57bd, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:01.154435 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe0aa0-9110-4e25-9167-2454c9351f55 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:01.177141 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 188/387] 10.222.0.26 () {58 vars in 1442 bytes} [Tue Sep 13 13:59:00 2022] PUT /identity/v3/projects/1aeb29de324e4f558c8157b5cd66f520/groups/93f67a46fc8347c1915edc63ff6e57bd/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 13:59:01.724985 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfaf22-1935-4cba-abe1-a86a2241b134 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:01.726031 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfaf22-1935-4cba-abe1-a86a2241b134 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:01.726506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfaf22-1935-4cba-abe1-a86a2241b134 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:01.728331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 200/388] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:01.733826 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d2fbe-7fa2-4717-b4e7-53f5d4e65534 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:01.734326 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d2fbe-7fa2-4717-b4e7-53f5d4e65534 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:01.734803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d2fbe-7fa2-4717-b4e7-53f5d4e65534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:01.754904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-a78d2fbe-7fa2-4717-b4e7-53f5d4e65534 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:01.756626 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a78d2fbe-7fa2-4717-b4e7-53f5d4e65534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:01.777776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:01.838774 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 189/389] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:02.095624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329f65c-2389-444c-9d5b-5ca830a6e906 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:02.095900 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329f65c-2389-444c-9d5b-5ca830a6e906 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:02.096352 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329f65c-2389-444c-9d5b-5ca830a6e906 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:02.098106 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 201/390] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:02.104100 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d24e5-605a-4bb8-9143-b22317323cc4 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:02.104630 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d24e5-605a-4bb8-9143-b22317323cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:02.105123 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d24e5-605a-4bb8-9143-b22317323cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:02.123645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-550d24e5-605a-4bb8-9143-b22317323cc4 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:02.125635 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-550d24e5-605a-4bb8-9143-b22317323cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:02.207662 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 190/391] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 13:59:02.388189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329f65c-2389-444c-9d5b-5ca830a6e906 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:02.431468 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:02.531301 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329f65c-2389-444c-9d5b-5ca830a6e906 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:02.572739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69559b2d-c0a3-4b35-8cbb-873b19edc1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:02.573396 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69559b2d-c0a3-4b35-8cbb-873b19edc1e3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:02.573668 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69559b2d-c0a3-4b35-8cbb-873b19edc1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:02.573936 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69559b2d-c0a3-4b35-8cbb-873b19edc1e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:02.589360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69559b2d-c0a3-4b35-8cbb-873b19edc1e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:02.594283 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-69559b2d-c0a3-4b35-8cbb-873b19edc1e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 13:59:02.594283 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:02.594283 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:02.594283 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:02.594283 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:02.594283 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:02.594283 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:02.594283 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:02.594283 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:02.594283 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:02.594283 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:02.594283 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:02.594283 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:02.594283 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:02.594283 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:02.594283 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:02.595136 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:02.595136 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:02.595136 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:02.595136 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:02.595136 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:02.595136 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:02.595136 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:02.595136 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:02.595136 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:02.595136 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:02.595136 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:02.595136 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:02.595136 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:02.595136 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:02.595136 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:02.595136 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:02.595913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:02.595913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:02.595913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:02.595913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:02.595913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:02.595913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:02.595913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:02.595913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:02.595913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:02.595913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:02.595913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 13:59:02.595913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:02.598005 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 202/392] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 13 13:59:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:02.602981 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d24e5-605a-4bb8-9143-b22317323cc4 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:02.705662 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69559b2d-c0a3-4b35-8cbb-873b19edc1e3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:02.755658 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:02.775268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d24e5-605a-4bb8-9143-b22317323cc4 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:02.845760 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e7cbe-6458-4113-afb0-248baf9c954d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:02.846367 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e7cbe-6458-4113-afb0-248baf9c954d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:02.846641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e7cbe-6458-4113-afb0-248baf9c954d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:02.846908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e7cbe-6458-4113-afb0-248baf9c954d None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:02.847822 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e7cbe-6458-4113-afb0-248baf9c954d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:02.848121 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e7cbe-6458-4113-afb0-248baf9c954d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:02.850049 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e7cbe-6458-4113-afb0-248baf9c954d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:02.870172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 191/393] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:02.870434 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:02.876618 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e7cbe-6458-4113-afb0-248baf9c954d None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:02.890134 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69559b2d-c0a3-4b35-8cbb-873b19edc1e3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:02.930297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce6416-315d-4dae-b103-c294ab61b2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:02.930965 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce6416-315d-4dae-b103-c294ab61b2fd None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:02.931312 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce6416-315d-4dae-b103-c294ab61b2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:02.931585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce6416-315d-4dae-b103-c294ab61b2fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:02.943785 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce6416-315d-4dae-b103-c294ab61b2fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:02.949366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-6cce6416-315d-4dae-b103-c294ab61b2fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:59:02.949366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:02.949366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:02.949366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:02.949366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:02.949366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:02.949366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:02.949366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:02.949366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:02.949366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:02.949366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:02.949366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:02.949366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:02.949366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:02.949366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:02.949366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:02.950422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:02.950422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:02.950422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:02.950422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:02.950422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:02.950422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:02.950422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:02.950422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:02.950422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:02.950422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:02.950422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:02.950422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:02.950422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:02.950422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:02.950422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:02.950422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:02.951570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:02.951570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:02.951570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:02.951570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:02.951570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:02.951570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:02.951570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:02.951570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:02.951570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:02.951570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:02.951570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:59:02.951570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:02.954023 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 203/394] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:59:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:59:02.955436 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fde7d8-0c6f-4f74-ab2c-25f3094900dc None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:02.955916 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fde7d8-0c6f-4f74-ab2c-25f3094900dc None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:02.956328 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fde7d8-0c6f-4f74-ab2c-25f3094900dc None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:02.958121 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 204/395] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:02.963047 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fde7d8-0c6f-4f74-ab2c-25f3094900dc None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:02.990067 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e7cbe-6458-4113-afb0-248baf9c954d None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:03.024846 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231e6c9-3c16-4c87-82ba-c9a884f371ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:03.025825 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231e6c9-3c16-4c87-82ba-c9a884f371ff None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:03.026244 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231e6c9-3c16-4c87-82ba-c9a884f371ff None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:03.026765 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231e6c9-3c16-4c87-82ba-c9a884f371ff None admin] PATH_INFO: `/v3/groups/93f67a46fc8347c1915edc63ff6e57bd` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:03.028063 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231e6c9-3c16-4c87-82ba-c9a884f371ff None admin] RBAC: Authorizing `identity:get_group(group_id=93f67a46fc8347c1915edc63ff6e57bd)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:03.029689 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231e6c9-3c16-4c87-82ba-c9a884f371ff None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:03.035917 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 192/396] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 13 13:59:02 2022] GET /identity/v3/groups/93f67a46fc8347c1915edc63ff6e57bd => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:03.035917 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1572db9-d7c1-4057-8e87-94b5effb12bb None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:03.035917 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1572db9-d7c1-4057-8e87-94b5effb12bb None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:03.035917 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1572db9-d7c1-4057-8e87-94b5effb12bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:03.051015 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e1572db9-d7c1-4057-8e87-94b5effb12bb None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:03.052694 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e1572db9-d7c1-4057-8e87-94b5effb12bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:03.063678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:03.081832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fde7d8-0c6f-4f74-ab2c-25f3094900dc None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:03.117820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd5f68-39f7-4f30-b7d1-4a3188255701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:03.118422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd5f68-39f7-4f30-b7d1-4a3188255701 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:03.118700 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd5f68-39f7-4f30-b7d1-4a3188255701 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:03.119199 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd5f68-39f7-4f30-b7d1-4a3188255701 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:03.119626 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd5f68-39f7-4f30-b7d1-4a3188255701 None admin] RBAC: Adding query filter params (name=member) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:03.119926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd5f68-39f7-4f30-b7d1-4a3188255701 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:03.121368 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd5f68-39f7-4f30-b7d1-4a3188255701 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:03.129291 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 193/397] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:03.129291 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c4b0c-9085-40d4-9de8-d982d5431b6a None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:03.129291 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c4b0c-9085-40d4-9de8-d982d5431b6a None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:03.129291 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c4b0c-9085-40d4-9de8-d982d5431b6a None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:03.129940 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 194/398] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:03.130289 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 205/399] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 13 13:59:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:03.130685 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c4b0c-9085-40d4-9de8-d982d5431b6a None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:03.137558 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd5f68-39f7-4f30-b7d1-4a3188255701 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:03.160883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:03.246175 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd5f68-39f7-4f30-b7d1-4a3188255701 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:03.269175 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c4b0c-9085-40d4-9de8-d982d5431b6a None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:03.285278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ae67a-5130-405e-afba-3a335141e1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:03.286114 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ae67a-5130-405e-afba-3a335141e1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:03.286604 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ae67a-5130-405e-afba-3a335141e1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:03.287082 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ae67a-5130-405e-afba-3a335141e1f0 None admin] PATH_INFO: `/v3/groups/93f67a46fc8347c1915edc63ff6e57bd` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:03.288473 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ae67a-5130-405e-afba-3a335141e1f0 None admin] RBAC: Authorizing `identity:get_group(group_id=93f67a46fc8347c1915edc63ff6e57bd)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:03.290310 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ae67a-5130-405e-afba-3a335141e1f0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:03.296850 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 206/400] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 13 13:59:03 2022] GET /identity/v3/groups/93f67a46fc8347c1915edc63ff6e57bd => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:03.298383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4051b8c-c230-475c-b243-f6b476bc345f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:03.298945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4051b8c-c230-475c-b243-f6b476bc345f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:03.299418 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4051b8c-c230-475c-b243-f6b476bc345f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:03.311566 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88d607-3da3-4c9b-afeb-c521f86b3fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:03.312381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88d607-3da3-4c9b-afeb-c521f86b3fdf None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:03.312819 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88d607-3da3-4c9b-afeb-c521f86b3fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:03.313275 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88d607-3da3-4c9b-afeb-c521f86b3fdf None admin] PATH_INFO: `/v3/projects/1aeb29de324e4f558c8157b5cd66f520` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:03.314552 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88d607-3da3-4c9b-afeb-c521f86b3fdf None admin] RBAC: Authorizing `identity:get_project(project_id=1aeb29de324e4f558c8157b5cd66f520)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:03.316926 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88d607-3da3-4c9b-afeb-c521f86b3fdf None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:03.318878 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 195/401] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:59:03 2022] GET /identity/v3/projects/1aeb29de324e4f558c8157b5cd66f520 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:03.319822 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88d607-3da3-4c9b-afeb-c521f86b3fdf None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:03.321310 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e4051b8c-c230-475c-b243-f6b476bc345f None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:03.322588 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e4051b8c-c230-475c-b243-f6b476bc345f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:03.340763 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:03.411134 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 207/402] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:03.412936 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4051b8c-c230-475c-b243-f6b476bc345f None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:03.428280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:03.445641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88d607-3da3-4c9b-afeb-c521f86b3fdf None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:03.484039 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80fca0-b2c3-425c-a22b-6c5d14e4e538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:03.484670 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80fca0-b2c3-425c-a22b-6c5d14e4e538 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:03.484944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80fca0-b2c3-425c-a22b-6c5d14e4e538 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:03.485263 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80fca0-b2c3-425c-a22b-6c5d14e4e538 None admin] PATH_INFO: `/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:03.486441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80fca0-b2c3-425c-a22b-6c5d14e4e538 None admin] RBAC: Authorizing `identity:get_project(project_id=11155a320d8a4d4bb8eebe5129dd9cf8)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:03.487791 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80fca0-b2c3-425c-a22b-6c5d14e4e538 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:03.490483 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 196/403] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:59:03 2022] GET /identity/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:03.491647 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80fca0-b2c3-425c-a22b-6c5d14e4e538 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:03.531180 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4051b8c-c230-475c-b243-f6b476bc345f None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:03.568216 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d8c79-37a5-4af3-9a8d-a50d4ddc9c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:03.569251 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d8c79-37a5-4af3-9a8d-a50d4ddc9c15 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:03.569751 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d8c79-37a5-4af3-9a8d-a50d4ddc9c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:03.570223 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d8c79-37a5-4af3-9a8d-a50d4ddc9c15 None admin] PATH_INFO: `/v3/projects/1aeb29de324e4f558c8157b5cd66f520/groups/93f67a46fc8347c1915edc63ff6e57bd/roles/cf8554dac8d343549802afd60c56c0d6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:03.573739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d8c79-37a5-4af3-9a8d-a50d4ddc9c15 None admin] RBAC: Authorizing `identity:create_grant(project_id=1aeb29de324e4f558c8157b5cd66f520, group_id=93f67a46fc8347c1915edc63ff6e57bd, role_id=cf8554dac8d343549802afd60c56c0d6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:03.576106 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d8c79-37a5-4af3-9a8d-a50d4ddc9c15 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:03.578867 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:03.595886 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 208/404] 10.222.0.26 () {58 vars in 1442 bytes} [Tue Sep 13 13:59:03 2022] PUT /identity/v3/projects/1aeb29de324e4f558c8157b5cd66f520/groups/93f67a46fc8347c1915edc63ff6e57bd/roles/cf8554dac8d343549802afd60c56c0d6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 13:59:03.597013 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d8c79-37a5-4af3-9a8d-a50d4ddc9c15 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:03.613832 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80fca0-b2c3-425c-a22b-6c5d14e4e538 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:03.697554 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:03.734639 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d8c79-37a5-4af3-9a8d-a50d4ddc9c15 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:03.736621 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dab279-280f-44c6-b472-997cbd971173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:03.738616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dab279-280f-44c6-b472-997cbd971173 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:03.739159 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dab279-280f-44c6-b472-997cbd971173 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:03.739692 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dab279-280f-44c6-b472-997cbd971173 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:03.753658 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dab279-280f-44c6-b472-997cbd971173 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:03.760672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-08dab279-280f-44c6-b472-997cbd971173 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 13:59:03.760672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:03.760672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:03.760672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:03.760672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:03.760672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:03.760672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:03.760672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:03.760672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:03.760672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:03.760672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:03.760672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:03.760672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:03.760672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:03.760672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:03.760672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:03.761663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:03.761663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:03.761663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:03.761663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:03.761663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:03.761663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:03.761663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:03.761663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:03.761663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:03.761663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:03.761663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:03.761663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:03.761663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:03.761663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:03.761663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:03.761663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:03.762533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:03.762533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:03.762533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:03.762533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:03.762533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:03.762533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:03.762533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:03.762533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:03.762533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:03.762533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:03.762533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 13:59:03.762533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:03.765262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 197/405] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 13 13:59:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:03.766733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dab279-280f-44c6-b472-997cbd971173 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:03.777716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846c62c-b263-48c0-8b8b-3863658261ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:03.778527 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846c62c-b263-48c0-8b8b-3863658261ff None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:03.778905 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846c62c-b263-48c0-8b8b-3863658261ff None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:03.779349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846c62c-b263-48c0-8b8b-3863658261ff None admin] PATH_INFO: `/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8/groups/93f67a46fc8347c1915edc63ff6e57bd/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:03.782346 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e846c62c-b263-48c0-8b8b-3863658261ff None admin] RBAC: Authorizing `identity:create_grant(project_id=11155a320d8a4d4bb8eebe5129dd9cf8, group_id=93f67a46fc8347c1915edc63ff6e57bd, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:03.784455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e846c62c-b263-48c0-8b8b-3863658261ff None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:03.806918 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 209/406] 10.222.0.26 () {58 vars in 1442 bytes} [Tue Sep 13 13:59:03 2022] PUT /identity/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8/groups/93f67a46fc8347c1915edc63ff6e57bd/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 13:59:03.807656 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846c62c-b263-48c0-8b8b-3863658261ff None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:03.900898 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dab279-280f-44c6-b472-997cbd971173 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:03.943575 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85562c78-9875-4d48-9ea9-903ac62f0d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:03.944469 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85562c78-9875-4d48-9ea9-903ac62f0d0c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:03.944578 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85562c78-9875-4d48-9ea9-903ac62f0d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:03.944854 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85562c78-9875-4d48-9ea9-903ac62f0d0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:03.956924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85562c78-9875-4d48-9ea9-903ac62f0d0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:03.963548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-85562c78-9875-4d48-9ea9-903ac62f0d0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:59:03.963548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:03.963548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:03.963548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:03.963548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:03.963548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:03.963548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:03.963548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:03.963548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:03.963548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:03.963548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:03.963548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:03.963548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:03.963548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:03.963548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:03.963548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:03.964477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:03.964477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:03.964477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:03.964477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:03.964477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:03.964477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:03.964477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:03.964477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:03.964477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:03.964477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:03.964477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:03.964477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:03.964477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:03.964477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:03.964477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:03.964477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:03.965723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:03.965723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:03.965723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:03.965723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:03.965723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:03.965723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:03.965723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:03.965723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:03.965723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:03.965723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:03.965723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:59:03.965723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:03.965723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 198/407] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 13:59:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:03.971041 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85562c78-9875-4d48-9ea9-903ac62f0d0c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:03.975427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:03.992183 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846c62c-b263-48c0-8b8b-3863658261ff None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:04.052452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:04.059388 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237be80-571e-4d75-bb0d-b8cf02a854ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:04.061809 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237be80-571e-4d75-bb0d-b8cf02a854ce None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:04.062882 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237be80-571e-4d75-bb0d-b8cf02a854ce None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:04.063457 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237be80-571e-4d75-bb0d-b8cf02a854ce None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:04.064267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237be80-571e-4d75-bb0d-b8cf02a854ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:04.064709 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237be80-571e-4d75-bb0d-b8cf02a854ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:04.066325 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237be80-571e-4d75-bb0d-b8cf02a854ce None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:04.077609 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 210/408] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:04.083300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237be80-571e-4d75-bb0d-b8cf02a854ce None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:04.101020 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85562c78-9875-4d48-9ea9-903ac62f0d0c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:04.150750 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f80ac2-7d11-40d3-af2e-bea97137c281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:04.151507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f80ac2-7d11-40d3-af2e-bea97137c281 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:04.154156 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f80ac2-7d11-40d3-af2e-bea97137c281 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:04.154156 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f80ac2-7d11-40d3-af2e-bea97137c281 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:04.154156 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f80ac2-7d11-40d3-af2e-bea97137c281 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:04.154156 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f80ac2-7d11-40d3-af2e-bea97137c281 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:04.156109 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f80ac2-7d11-40d3-af2e-bea97137c281 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:04.168403 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 199/409] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:59:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:04.173830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd140b-d86a-4455-ab62-a01f1fd891a6 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:04.174112 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd140b-d86a-4455-ab62-a01f1fd891a6 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:04.174384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd140b-d86a-4455-ab62-a01f1fd891a6 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:04.175787 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 200/410] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:04.176363 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd140b-d86a-4455-ab62-a01f1fd891a6 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:04.216253 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237be80-571e-4d75-bb0d-b8cf02a854ce None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:04.258558 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd827e91-051c-4a8b-8eb2-396f1ee35b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:04.260138 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd827e91-051c-4a8b-8eb2-396f1ee35b67 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:04.260697 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd827e91-051c-4a8b-8eb2-396f1ee35b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:04.261178 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd827e91-051c-4a8b-8eb2-396f1ee35b67 None admin] PATH_INFO: `/v3/groups/93f67a46fc8347c1915edc63ff6e57bd` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:04.263229 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd827e91-051c-4a8b-8eb2-396f1ee35b67 None admin] RBAC: Authorizing `identity:get_group(group_id=93f67a46fc8347c1915edc63ff6e57bd)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:04.265459 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd827e91-051c-4a8b-8eb2-396f1ee35b67 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:04.266296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:04.269246 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 211/411] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 13 13:59:04 2022] GET /identity/v3/groups/93f67a46fc8347c1915edc63ff6e57bd => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:04.270635 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb693fb-a322-44f4-ac98-df4e4057f0ff None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:04.271191 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb693fb-a322-44f4-ac98-df4e4057f0ff None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:04.271661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb693fb-a322-44f4-ac98-df4e4057f0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:04.297481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-4bb693fb-a322-44f4-ac98-df4e4057f0ff None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:04.299797 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4bb693fb-a322-44f4-ac98-df4e4057f0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:04.329625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd140b-d86a-4455-ab62-a01f1fd891a6 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:04.368342 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:04.371482 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed06520-0a0e-40fd-82c6-7435fa3dc697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:04.372397 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed06520-0a0e-40fd-82c6-7435fa3dc697 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:04.372907 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed06520-0a0e-40fd-82c6-7435fa3dc697 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:04.373369 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed06520-0a0e-40fd-82c6-7435fa3dc697 None admin] PATH_INFO: `/v3/groups/6ddf8af8c52d4c1b810bfa6fa316c44c` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:04.374649 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed06520-0a0e-40fd-82c6-7435fa3dc697 None admin] RBAC: Authorizing `identity:get_group(group_id=6ddf8af8c52d4c1b810bfa6fa316c44c)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:04.377348 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed06520-0a0e-40fd-82c6-7435fa3dc697 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:04.380619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 201/412] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 13 13:59:04 2022] GET /identity/v3/groups/6ddf8af8c52d4c1b810bfa6fa316c44c => generated 229 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:04.381655 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed06520-0a0e-40fd-82c6-7435fa3dc697 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:04.382317 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 212/413] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:04.390795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb693fb-a322-44f4-ac98-df4e4057f0ff None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:04.526962 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed06520-0a0e-40fd-82c6-7435fa3dc697 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:04.533513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb693fb-a322-44f4-ac98-df4e4057f0ff None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:04.559122 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:04.565141 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b82f8d-c593-4fa9-a2e2-d18804078a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:04.565976 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b82f8d-c593-4fa9-a2e2-d18804078a08 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:04.567175 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b82f8d-c593-4fa9-a2e2-d18804078a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:04.567771 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b82f8d-c593-4fa9-a2e2-d18804078a08 None admin] PATH_INFO: `/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:04.569111 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b82f8d-c593-4fa9-a2e2-d18804078a08 None admin] RBAC: Authorizing `identity:get_project(project_id=11155a320d8a4d4bb8eebe5129dd9cf8)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:04.570849 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b82f8d-c593-4fa9-a2e2-d18804078a08 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:04.573136 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 202/414] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:59:04 2022] GET /identity/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:04.578743 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b82f8d-c593-4fa9-a2e2-d18804078a08 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:04.591072 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797044d-e732-4db6-94a3-9c544e16c4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:04.591634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797044d-e732-4db6-94a3-9c544e16c4b6 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:04.591959 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797044d-e732-4db6-94a3-9c544e16c4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:04.592241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797044d-e732-4db6-94a3-9c544e16c4b6 None admin] PATH_INFO: `/v3/projects/b2ed08b3b52d45f68ee1e0b8c4e4ceb4` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:04.593489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797044d-e732-4db6-94a3-9c544e16c4b6 None admin] RBAC: Authorizing `identity:get_project(project_id=b2ed08b3b52d45f68ee1e0b8c4e4ceb4)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:04.597131 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797044d-e732-4db6-94a3-9c544e16c4b6 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:04.597527 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 213/415] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:59:04 2022] GET /identity/v3/projects/b2ed08b3b52d45f68ee1e0b8c4e4ceb4 => generated 344 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:04.603268 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797044d-e732-4db6-94a3-9c544e16c4b6 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:04.745550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:04.766836 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797044d-e732-4db6-94a3-9c544e16c4b6 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:04.785016 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b82f8d-c593-4fa9-a2e2-d18804078a08 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:04.819940 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f882ab9-a3b1-42c7-9a15-0214895853ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:04.821039 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f882ab9-a3b1-42c7-9a15-0214895853ef None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:04.821689 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f882ab9-a3b1-42c7-9a15-0214895853ef None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:04.822228 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f882ab9-a3b1-42c7-9a15-0214895853ef None admin] PATH_INFO: `/v3/projects/b2ed08b3b52d45f68ee1e0b8c4e4ceb4/groups/6ddf8af8c52d4c1b810bfa6fa316c44c/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:04.822891 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f235306-0f1b-4c3a-89c8-09e8ce7b254f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:04.823619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f235306-0f1b-4c3a-89c8-09e8ce7b254f None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:04.824032 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f235306-0f1b-4c3a-89c8-09e8ce7b254f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:04.824383 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f235306-0f1b-4c3a-89c8-09e8ce7b254f None admin] PATH_INFO: `/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8/groups/93f67a46fc8347c1915edc63ff6e57bd/roles/cf8554dac8d343549802afd60c56c0d6` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:04.825224 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f882ab9-a3b1-42c7-9a15-0214895853ef None admin] RBAC: Authorizing `identity:create_grant(project_id=b2ed08b3b52d45f68ee1e0b8c4e4ceb4, group_id=6ddf8af8c52d4c1b810bfa6fa316c44c, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:04.826749 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f235306-0f1b-4c3a-89c8-09e8ce7b254f None admin] RBAC: Authorizing `identity:create_grant(project_id=11155a320d8a4d4bb8eebe5129dd9cf8, group_id=93f67a46fc8347c1915edc63ff6e57bd, role_id=cf8554dac8d343549802afd60c56c0d6)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:04.827247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f882ab9-a3b1-42c7-9a15-0214895853ef None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:04.828308 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f235306-0f1b-4c3a-89c8-09e8ce7b254f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:04.844640 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 214/416] 10.222.0.26 () {58 vars in 1442 bytes} [Tue Sep 13 13:59:04 2022] PUT /identity/v3/projects/b2ed08b3b52d45f68ee1e0b8c4e4ceb4/groups/6ddf8af8c52d4c1b810bfa6fa316c44c/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 13:59:04.845805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f882ab9-a3b1-42c7-9a15-0214895853ef None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:04.846903 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 203/417] 10.222.0.26 () {58 vars in 1442 bytes} [Tue Sep 13 13:59:04 2022] PUT /identity/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8/groups/93f67a46fc8347c1915edc63ff6e57bd/roles/cf8554dac8d343549802afd60c56c0d6 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 13:59:04.971951 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f882ab9-a3b1-42c7-9a15-0214895853ef None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:04.995706 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:05.019147 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15c5c5-7177-4dd4-a9c9-dc6976ca57a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:05.020083 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15c5c5-7177-4dd4-a9c9-dc6976ca57a7 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:05.020506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15c5c5-7177-4dd4-a9c9-dc6976ca57a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:05.020991 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15c5c5-7177-4dd4-a9c9-dc6976ca57a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:05.043376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15c5c5-7177-4dd4-a9c9-dc6976ca57a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:05.049333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-0e15c5c5-7177-4dd4-a9c9-dc6976ca57a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:59:05.049333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:05.049333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:05.049333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:05.049333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:05.049333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:05.049333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:05.049333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:05.049333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:05.049333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:05.049333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:05.049333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:05.049333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:05.049333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:05.049333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:05.049333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:05.050524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:05.050524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:05.050524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:05.050524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:05.050524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:05.050524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:05.050524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:05.050524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:05.050524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:05.050524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:05.050524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:05.050524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:05.050524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:05.050524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:05.050524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:05.050524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:05.051495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:05.051495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:05.051495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:05.051495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:05.051495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:05.051495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:05.051495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:05.051495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:05.051495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:05.051495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:05.051495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:59:05.051495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:05.057829 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 215/418] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:59:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:05.064606 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f235306-0f1b-4c3a-89c8-09e8ce7b254f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:05.147901 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:05.194305 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f235306-0f1b-4c3a-89c8-09e8ce7b254f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:05.240671 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8237c11-37bc-45b1-a374-24d69b9dfe5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:05.241690 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8237c11-37bc-45b1-a374-24d69b9dfe5a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:05.242175 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8237c11-37bc-45b1-a374-24d69b9dfe5a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:05.242646 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8237c11-37bc-45b1-a374-24d69b9dfe5a None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:05.243515 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8237c11-37bc-45b1-a374-24d69b9dfe5a None admin] RBAC: Adding query filter params (name=member) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:05.244030 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8237c11-37bc-45b1-a374-24d69b9dfe5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:05.245646 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8237c11-37bc-45b1-a374-24d69b9dfe5a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:05.254920 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 204/419] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 13 13:59:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:05.261300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15c5c5-7177-4dd4-a9c9-dc6976ca57a7 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:05.383298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15c5c5-7177-4dd4-a9c9-dc6976ca57a7 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:05.432630 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee238c95-e9bd-4286-97cc-342a98804223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:05.433627 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee238c95-e9bd-4286-97cc-342a98804223 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:05.434110 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee238c95-e9bd-4286-97cc-342a98804223 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:05.434576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee238c95-e9bd-4286-97cc-342a98804223 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:05.494837 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:05.518536 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee238c95-e9bd-4286-97cc-342a98804223 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:05.526373 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee238c95-e9bd-4286-97cc-342a98804223 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:05.655758 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 216/420] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:59:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 13:59:05.661956 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8237c11-37bc-45b1-a374-24d69b9dfe5a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:05.802032 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8237c11-37bc-45b1-a374-24d69b9dfe5a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:05.843876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:05.856938 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcae784-4669-46db-b2ec-ddb8b3b2bc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:05.857599 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcae784-4669-46db-b2ec-ddb8b3b2bc37 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:05.857874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcae784-4669-46db-b2ec-ddb8b3b2bc37 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:05.858139 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcae784-4669-46db-b2ec-ddb8b3b2bc37 None admin] PATH_INFO: `/v3/projects/1aeb29de324e4f558c8157b5cd66f520` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:05.861791 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcae784-4669-46db-b2ec-ddb8b3b2bc37 None admin] RBAC: Authorizing `identity:get_project(project_id=1aeb29de324e4f558c8157b5cd66f520)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:05.863238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcae784-4669-46db-b2ec-ddb8b3b2bc37 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:05.864939 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 205/421] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:59:05 2022] GET /identity/v3/projects/1aeb29de324e4f558c8157b5cd66f520 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:05.870582 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee238c95-e9bd-4286-97cc-342a98804223 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:05.981217 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:06.006766 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee238c95-e9bd-4286-97cc-342a98804223 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:06.038631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2f5d7-d912-4532-b1ef-cb93424f954e None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:06.039135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2f5d7-d912-4532-b1ef-cb93424f954e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:06.039581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2f5d7-d912-4532-b1ef-cb93424f954e None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:06.041440 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 206/422] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:06.054599 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cecc1-fb9b-4a16-8532-3bf739adfefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:06.055005 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13b27f-9b9a-4107-95ca-79bf97ea8026 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:06.055126 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cecc1-fb9b-4a16-8532-3bf739adfefe None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:06.055407 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cecc1-fb9b-4a16-8532-3bf739adfefe None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:06.055676 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cecc1-fb9b-4a16-8532-3bf739adfefe None admin] PATH_INFO: `/v3/groups/93f67a46fc8347c1915edc63ff6e57bd` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:06.055926 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13b27f-9b9a-4107-95ca-79bf97ea8026 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:06.056374 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13b27f-9b9a-4107-95ca-79bf97ea8026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:06.056846 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31cecc1-fb9b-4a16-8532-3bf739adfefe None admin] RBAC: Authorizing `identity:get_group(group_id=93f67a46fc8347c1915edc63ff6e57bd)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:06.058350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31cecc1-fb9b-4a16-8532-3bf739adfefe None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:06.060313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 217/423] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 13 13:59:05 2022] GET /identity/v3/groups/93f67a46fc8347c1915edc63ff6e57bd => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:06.069128 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cecc1-fb9b-4a16-8532-3bf739adfefe None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:06.093201 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-5b13b27f-9b9a-4107-95ca-79bf97ea8026 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:06.094635 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5b13b27f-9b9a-4107-95ca-79bf97ea8026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:06.210636 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 207/424] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:06.245780 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cecc1-fb9b-4a16-8532-3bf739adfefe None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:06.299730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c661ac-95bd-4c40-a337-f5457caa2610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:06.300649 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c661ac-95bd-4c40-a337-f5457caa2610 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:06.301071 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c661ac-95bd-4c40-a337-f5457caa2610 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:06.301504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c661ac-95bd-4c40-a337-f5457caa2610 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:06.302971 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c661ac-95bd-4c40-a337-f5457caa2610 None admin] RBAC: Adding query filter params (group.id=93f67a46fc8347c1915edc63ff6e57bd, role.id=81a57b9863404b45acc1204670e387f2, scope.project.id=1aeb29de324e4f558c8157b5cd66f520) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:06.303440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c661ac-95bd-4c40-a337-f5457caa2610 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:06.305226 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c661ac-95bd-4c40-a337-f5457caa2610 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:06.318997 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 218/425] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Sep 13 13:59:06 2022] GET /identity/v3/role_assignments?group.id=93f67a46fc8347c1915edc63ff6e57bd&scope.project.id=1aeb29de324e4f558c8157b5cd66f520&role.id=81a57b9863404b45acc1204670e387f2 => generated 611 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:06.454894 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92ca50-fcb3-445a-aa3a-58012aa63419 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:06.455454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92ca50-fcb3-445a-aa3a-58012aa63419 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:06.455904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92ca50-fcb3-445a-aa3a-58012aa63419 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:06.457726 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 208/426] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:06.475514 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a33ce-5bf2-4b77-a0be-2823ee6840fa None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:06.476121 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a33ce-5bf2-4b77-a0be-2823ee6840fa None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:06.476580 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a33ce-5bf2-4b77-a0be-2823ee6840fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:06.498727 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-4b0a33ce-5bf2-4b77-a0be-2823ee6840fa None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:06.500319 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4b0a33ce-5bf2-4b77-a0be-2823ee6840fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:06.514422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:06.583744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 219/427] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:06.622236 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92ca50-fcb3-445a-aa3a-58012aa63419 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:06.734910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92ca50-fcb3-445a-aa3a-58012aa63419 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:06.756514 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:06.773441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f4255-6657-476b-b995-a2664526189f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:06.774209 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f4255-6657-476b-b995-a2664526189f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:06.774479 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f4255-6657-476b-b995-a2664526189f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:06.774740 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f4255-6657-476b-b995-a2664526189f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:06.785524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f4255-6657-476b-b995-a2664526189f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:06.790385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-f51f4255-6657-476b-b995-a2664526189f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 13:59:06.790385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:06.790385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:06.790385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:06.790385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:06.790385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:06.790385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:06.790385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:06.790385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:06.790385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:06.790385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:06.790385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:06.790385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:06.790385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:06.790385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:06.790385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:06.791316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:06.791316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:06.791316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:06.791316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:06.791316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:06.791316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:06.791316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:06.791316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:06.791316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:06.791316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:06.791316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:06.791316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:06.791316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:06.791316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:06.791316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:06.791316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:06.792118 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:06.792118 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:06.792118 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:06.792118 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:06.792118 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:06.792118 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:06.792118 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:06.792118 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:06.792118 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:06.792118 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:06.792118 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 13:59:06.792118 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:06.792118 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 209/428] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 13 13:59:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:06.799533 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a33ce-5bf2-4b77-a0be-2823ee6840fa None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:06.879056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f4255-6657-476b-b995-a2664526189f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:06.925755 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a33ce-5bf2-4b77-a0be-2823ee6840fa None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:06.969497 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e957d7-00a8-4557-b920-0d6965da709d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:06.970099 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e957d7-00a8-4557-b920-0d6965da709d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:06.970477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e957d7-00a8-4557-b920-0d6965da709d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:06.970750 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e957d7-00a8-4557-b920-0d6965da709d None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:06.971518 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e957d7-00a8-4557-b920-0d6965da709d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:06.971819 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e957d7-00a8-4557-b920-0d6965da709d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:06.973212 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e957d7-00a8-4557-b920-0d6965da709d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:06.982180 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 220/429] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:06.987655 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e957d7-00a8-4557-b920-0d6965da709d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:06.993035 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:07.012315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f4255-6657-476b-b995-a2664526189f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:07.059923 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393fd5b-53e4-45fb-9bf8-9981b121667f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:07.060575 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393fd5b-53e4-45fb-9bf8-9981b121667f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:07.060847 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393fd5b-53e4-45fb-9bf8-9981b121667f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:07.061389 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393fd5b-53e4-45fb-9bf8-9981b121667f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:07.082510 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393fd5b-53e4-45fb-9bf8-9981b121667f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:07.091252 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-3393fd5b-53e4-45fb-9bf8-9981b121667f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:59:07.091252 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:07.091252 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:07.091252 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:07.091252 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:07.091252 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:07.091252 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:07.091252 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:07.091252 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:07.091252 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:07.091252 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:07.091252 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:07.091252 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:07.091252 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:07.091252 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:07.091252 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:07.092183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:07.092183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:07.092183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:07.092183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:07.092183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:07.092183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:07.092183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:07.092183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:07.092183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:07.092183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:07.092183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:07.092183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:07.092183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:07.092183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:07.092183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:07.092183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:07.092970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:07.092970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:07.092970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:07.092970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:07.092970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:07.092970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:07.092970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:07.092970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:07.092970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:07.092970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:07.092970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 13:59:07.092970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:07.092970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 210/430] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:59:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:07.098604 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393fd5b-53e4-45fb-9bf8-9981b121667f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:07.133048 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e957d7-00a8-4557-b920-0d6965da709d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:07.170681 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608720c8-aa77-47cf-b920-7b00dfec08b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:07.171844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:07.172197 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608720c8-aa77-47cf-b920-7b00dfec08b0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:07.172702 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608720c8-aa77-47cf-b920-7b00dfec08b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:07.173212 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608720c8-aa77-47cf-b920-7b00dfec08b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:07.245037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393fd5b-53e4-45fb-9bf8-9981b121667f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:07.257040 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608720c8-aa77-47cf-b920-7b00dfec08b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:07.258790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608720c8-aa77-47cf-b920-7b00dfec08b0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:07.263199 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:07.292159 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5460f7-2d5e-4fad-a0b0-57675d02fb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:07.293472 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5460f7-2d5e-4fad-a0b0-57675d02fb89 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:07.294167 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5460f7-2d5e-4fad-a0b0-57675d02fb89 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:07.294584 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5460f7-2d5e-4fad-a0b0-57675d02fb89 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:07.295489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5460f7-2d5e-4fad-a0b0-57675d02fb89 None admin] RBAC: Adding query filter params (name=member) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:07.296121 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5460f7-2d5e-4fad-a0b0-57675d02fb89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:07.297750 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5460f7-2d5e-4fad-a0b0-57675d02fb89 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:07.309606 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 211/431] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 13 13:59:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:07.315082 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5460f7-2d5e-4fad-a0b0-57675d02fb89 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:07.377237 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 221/432] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:59:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:59:07.383835 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608720c8-aa77-47cf-b920-7b00dfec08b0 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:07.447968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5460f7-2d5e-4fad-a0b0-57675d02fb89 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:07.449843 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:07.489325 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0e79d-dbbc-4dab-a618-0ecaeff8261d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:07.490129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0e79d-dbbc-4dab-a618-0ecaeff8261d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:07.490525 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0e79d-dbbc-4dab-a618-0ecaeff8261d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:07.491122 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0e79d-dbbc-4dab-a618-0ecaeff8261d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:07.521622 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608720c8-aa77-47cf-b920-7b00dfec08b0 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:07.525588 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:07.560741 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14138cd4-682a-4241-88f3-52a83a0ee100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:07.561396 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14138cd4-682a-4241-88f3-52a83a0ee100 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:07.561676 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14138cd4-682a-4241-88f3-52a83a0ee100 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:07.561944 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14138cd4-682a-4241-88f3-52a83a0ee100 None admin] PATH_INFO: `/v3/projects/1aeb29de324e4f558c8157b5cd66f520` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:07.563076 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14138cd4-682a-4241-88f3-52a83a0ee100 None admin] RBAC: Authorizing `identity:get_project(project_id=1aeb29de324e4f558c8157b5cd66f520)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:07.564520 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14138cd4-682a-4241-88f3-52a83a0ee100 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:07.566165 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 222/433] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:59:07 2022] GET /identity/v3/projects/1aeb29de324e4f558c8157b5cd66f520 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:07.567272 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1bbed-26dd-43aa-ba5b-849460579873 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:07.568115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1bbed-26dd-43aa-ba5b-849460579873 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:07.568381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1bbed-26dd-43aa-ba5b-849460579873 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:07.569778 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 223/434] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:07.573897 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1bbed-26dd-43aa-ba5b-849460579873 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:07.587604 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0e79d-dbbc-4dab-a618-0ecaeff8261d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:07.590156 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0e79d-dbbc-4dab-a618-0ecaeff8261d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:07.692234 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1bbed-26dd-43aa-ba5b-849460579873 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:07.710415 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 212/435] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:59:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:59:07.710415 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cf7c6-09e4-416a-a21e-9f53df694c7f None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:07.710415 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cf7c6-09e4-416a-a21e-9f53df694c7f None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:07.710415 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cf7c6-09e4-416a-a21e-9f53df694c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:07.714756 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:07.728163 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-5d4cf7c6-09e4-416a-a21e-9f53df694c7f None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:07.729367 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5d4cf7c6-09e4-416a-a21e-9f53df694c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:07.734307 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d686fc7-acf1-4617-8cb9-69af7603a828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:07.734932 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d686fc7-acf1-4617-8cb9-69af7603a828 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:07.735210 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d686fc7-acf1-4617-8cb9-69af7603a828 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:07.735479 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d686fc7-acf1-4617-8cb9-69af7603a828 None admin] PATH_INFO: `/v3/groups/93f67a46fc8347c1915edc63ff6e57bd` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:07.736591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d686fc7-acf1-4617-8cb9-69af7603a828 None admin] RBAC: Authorizing `identity:get_group(group_id=93f67a46fc8347c1915edc63ff6e57bd)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:07.738471 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d686fc7-acf1-4617-8cb9-69af7603a828 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:07.741478 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 224/436] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 13 13:59:07 2022] GET /identity/v3/groups/93f67a46fc8347c1915edc63ff6e57bd => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:07.742076 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d686fc7-acf1-4617-8cb9-69af7603a828 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:07.784662 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:07.805774 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 213/437] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:07.806612 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4cf7c6-09e4-416a-a21e-9f53df694c7f None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:07.850438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d686fc7-acf1-4617-8cb9-69af7603a828 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:07.885000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7dad3-f5e9-4113-b4ed-cee82cb60c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:07.885655 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7dad3-f5e9-4113-b4ed-cee82cb60c05 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:07.885935 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7dad3-f5e9-4113-b4ed-cee82cb60c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:07.886206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7dad3-f5e9-4113-b4ed-cee82cb60c05 None admin] PATH_INFO: `/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:07.887318 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7dad3-f5e9-4113-b4ed-cee82cb60c05 None admin] RBAC: Authorizing `identity:get_project(project_id=11155a320d8a4d4bb8eebe5129dd9cf8)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:07.888772 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7dad3-f5e9-4113-b4ed-cee82cb60c05 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:07.894908 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 225/438] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:59:07 2022] GET /identity/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:07.894908 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcadd3-e88c-44b3-ba41-2ed63fd8f574 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:07.894908 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcadd3-e88c-44b3-ba41-2ed63fd8f574 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:07.894908 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcadd3-e88c-44b3-ba41-2ed63fd8f574 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:07.894908 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 226/439] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:07.899009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fcadd3-e88c-44b3-ba41-2ed63fd8f574 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:07.915515 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4cf7c6-09e4-416a-a21e-9f53df694c7f None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:07.945576 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:07.951955 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1e3ca-f69b-492b-b4ab-045596cec18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:07.952545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1e3ca-f69b-492b-b4ab-045596cec18d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:07.952817 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1e3ca-f69b-492b-b4ab-045596cec18d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:07.953080 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1e3ca-f69b-492b-b4ab-045596cec18d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:07.953826 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1e3ca-f69b-492b-b4ab-045596cec18d None admin] RBAC: Adding query filter params (group.id=93f67a46fc8347c1915edc63ff6e57bd, role.id=cf8554dac8d343549802afd60c56c0d6, scope.project.id=1aeb29de324e4f558c8157b5cd66f520) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:07.954125 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1e3ca-f69b-492b-b4ab-045596cec18d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:07.955528 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1e3ca-f69b-492b-b4ab-045596cec18d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:07.968927 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 214/440] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Sep 13 13:59:07 2022] GET /identity/v3/role_assignments?group.id=93f67a46fc8347c1915edc63ff6e57bd&scope.project.id=1aeb29de324e4f558c8157b5cd66f520&role.id=cf8554dac8d343549802afd60c56c0d6 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:07.968927 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ef752-fce3-4e76-aa8b-d800b909b57d None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:07.968927 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ef752-fce3-4e76-aa8b-d800b909b57d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:07.968927 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ef752-fce3-4e76-aa8b-d800b909b57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:07.983957 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-ef9ef752-fce3-4e76-aa8b-d800b909b57d None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:07.985534 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ef9ef752-fce3-4e76-aa8b-d800b909b57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:08.019189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fcadd3-e88c-44b3-ba41-2ed63fd8f574 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:08.039290 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:08.070251 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 215/441] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:08.077212 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25af792-2256-49e5-9bad-c28456e970dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:08.077921 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25af792-2256-49e5-9bad-c28456e970dd None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:08.078908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ef752-fce3-4e76-aa8b-d800b909b57d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:08.079773 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25af792-2256-49e5-9bad-c28456e970dd None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:08.080042 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25af792-2256-49e5-9bad-c28456e970dd None admin] PATH_INFO: `/v3/groups/93f67a46fc8347c1915edc63ff6e57bd` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:08.081264 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25af792-2256-49e5-9bad-c28456e970dd None admin] RBAC: Authorizing `identity:get_group(group_id=93f67a46fc8347c1915edc63ff6e57bd)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:08.082729 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25af792-2256-49e5-9bad-c28456e970dd None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:08.084864 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 227/442] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 13 13:59:07 2022] GET /identity/v3/groups/93f67a46fc8347c1915edc63ff6e57bd => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:08.090468 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25af792-2256-49e5-9bad-c28456e970dd None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:08.207696 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ef752-fce3-4e76-aa8b-d800b909b57d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:08.227008 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25af792-2256-49e5-9bad-c28456e970dd None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:08.242657 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:08.258349 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4038c-7baf-420e-a98b-44d456337ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:08.259163 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4038c-7baf-420e-a98b-44d456337ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:08.259444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4038c-7baf-420e-a98b-44d456337ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:08.259714 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4038c-7baf-420e-a98b-44d456337ba8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:08.270171 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a7d1d-cc18-4717-8275-58889b982568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:08.271591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a7d1d-cc18-4717-8275-58889b982568 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:08.272064 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a7d1d-cc18-4717-8275-58889b982568 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:08.272545 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a7d1d-cc18-4717-8275-58889b982568 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:08.273504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a7d1d-cc18-4717-8275-58889b982568 None admin] RBAC: Adding query filter params (group.id=93f67a46fc8347c1915edc63ff6e57bd, role.id=81a57b9863404b45acc1204670e387f2, scope.project.id=11155a320d8a4d4bb8eebe5129dd9cf8) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:08.273994 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a7d1d-cc18-4717-8275-58889b982568 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:08.275149 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4038c-7baf-420e-a98b-44d456337ba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:08.275431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a7d1d-cc18-4717-8275-58889b982568 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:08.280972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-1cb4038c-7baf-420e-a98b-44d456337ba8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 13:59:08.280972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:08.280972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:08.280972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:08.280972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:08.280972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:08.280972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:08.280972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:08.280972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:08.280972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:08.280972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:08.280972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:08.280972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:08.280972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:08.280972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:08.280972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:08.281924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:08.281924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:08.281924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:08.281924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:08.281924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:08.281924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:08.281924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:08.281924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:08.281924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:08.281924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:08.281924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:08.281924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:08.281924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:08.281924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:08.281924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:08.281924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:08.283114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:08.283114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:08.283114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:08.283114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:08.283114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:08.283114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:08.283114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:08.283114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:08.283114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:08.283114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:08.283114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 13:59:08.283114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:08.284259 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 228/443] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Sep 13 13:59:08 2022] GET /identity/v3/role_assignments?group.id=93f67a46fc8347c1915edc63ff6e57bd&scope.project.id=11155a320d8a4d4bb8eebe5129dd9cf8&role.id=81a57b9863404b45acc1204670e387f2 => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:08.286361 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 216/444] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 13 13:59:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:08.292344 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a7d1d-cc18-4717-8275-58889b982568 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:08.342843 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:08.370102 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4038c-7baf-420e-a98b-44d456337ba8 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:08.420824 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a7d1d-cc18-4717-8275-58889b982568 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:08.462667 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba3b1d-93ae-4725-8ba1-91e0e85c8855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:08.463669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba3b1d-93ae-4725-8ba1-91e0e85c8855 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:08.463947 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba3b1d-93ae-4725-8ba1-91e0e85c8855 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:08.464214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba3b1d-93ae-4725-8ba1-91e0e85c8855 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:08.464961 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba3b1d-93ae-4725-8ba1-91e0e85c8855 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:08.465262 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba3b1d-93ae-4725-8ba1-91e0e85c8855 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:08.467145 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba3b1d-93ae-4725-8ba1-91e0e85c8855 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:08.477824 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 229/445] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:08.483898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba3b1d-93ae-4725-8ba1-91e0e85c8855 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:08.506983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4038c-7baf-420e-a98b-44d456337ba8 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:08.548907 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603b0f5-de46-467b-b5e0-c047e439eb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:08.549588 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603b0f5-de46-467b-b5e0-c047e439eb45 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:08.550674 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603b0f5-de46-467b-b5e0-c047e439eb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:08.550674 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603b0f5-de46-467b-b5e0-c047e439eb45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:08.564627 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603b0f5-de46-467b-b5e0-c047e439eb45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:08.570461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-c603b0f5-de46-467b-b5e0-c047e439eb45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:59:08.570461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:08.570461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:08.570461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:08.570461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:08.570461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:08.570461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:08.570461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:08.570461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:08.570461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:08.570461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:08.570461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:08.570461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:08.570461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:08.570461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:08.570461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:08.571355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:08.571355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:08.571355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:08.571355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:08.571355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:08.571355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:08.571355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:08.571355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:08.571355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:08.571355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:08.571355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:08.571355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:08.571355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:08.571355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:08.571355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:08.571355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:08.572126 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:08.572126 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:08.572126 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:08.572126 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:08.572126 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:08.572126 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:08.572126 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:08.572126 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:08.572126 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:08.572126 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:08.572126 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:59:08.572126 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:08.572126 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 217/446] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 13:59:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:59:08.578035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603b0f5-de46-467b-b5e0-c047e439eb45 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:08.605817 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba3b1d-93ae-4725-8ba1-91e0e85c8855 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:08.607701 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:08.635886 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:08.652987 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38662e-fbff-4244-8ad3-968733e79d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:08.653959 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38662e-fbff-4244-8ad3-968733e79d65 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:08.653959 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38662e-fbff-4244-8ad3-968733e79d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:08.654220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38662e-fbff-4244-8ad3-968733e79d65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:08.703599 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603b0f5-de46-467b-b5e0-c047e439eb45 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:08.726893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38662e-fbff-4244-8ad3-968733e79d65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:08.728275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38662e-fbff-4244-8ad3-968733e79d65 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:08.740299 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ca911-2731-45da-a4b9-9f46cb05e396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:08.740905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ca911-2731-45da-a4b9-9f46cb05e396 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:08.741210 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ca911-2731-45da-a4b9-9f46cb05e396 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:08.741479 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ca911-2731-45da-a4b9-9f46cb05e396 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:08.742133 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ca911-2731-45da-a4b9-9f46cb05e396 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:08.742425 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ca911-2731-45da-a4b9-9f46cb05e396 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:08.743766 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ca911-2731-45da-a4b9-9f46cb05e396 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:08.751497 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 218/447] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:59:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:08.757393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ca911-2731-45da-a4b9-9f46cb05e396 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:08.825409 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 230/448] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:59:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 13:59:08.830905 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38662e-fbff-4244-8ad3-968733e79d65 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:08.832744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:08.854848 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ca911-2731-45da-a4b9-9f46cb05e396 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:08.864045 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:08.889019 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673d2b0-18b0-491c-a1a6-85f3ad848553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:08.889635 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673d2b0-18b0-491c-a1a6-85f3ad848553 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:08.889908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673d2b0-18b0-491c-a1a6-85f3ad848553 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:08.890180 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673d2b0-18b0-491c-a1a6-85f3ad848553 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:08.928831 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38662e-fbff-4244-8ad3-968733e79d65 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:08.955450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673d2b0-18b0-491c-a1a6-85f3ad848553 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:08.956892 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673d2b0-18b0-491c-a1a6-85f3ad848553 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:08.962869 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4c418-9110-4b29-b78b-5acfe7515ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:08.963483 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4c418-9110-4b29-b78b-5acfe7515ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:08.963756 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4c418-9110-4b29-b78b-5acfe7515ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:08.964021 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4c418-9110-4b29-b78b-5acfe7515ab9 None admin] PATH_INFO: `/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:08.965548 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4c418-9110-4b29-b78b-5acfe7515ab9 None admin] RBAC: Authorizing `identity:get_project(project_id=11155a320d8a4d4bb8eebe5129dd9cf8)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:08.967321 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4c418-9110-4b29-b78b-5acfe7515ab9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:08.969247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 231/449] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:59:08 2022] GET /identity/v3/projects/11155a320d8a4d4bb8eebe5129dd9cf8 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:08.975064 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4c418-9110-4b29-b78b-5acfe7515ab9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:09.041955 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:09.053141 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 219/450] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:59:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:59:09.058641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673d2b0-18b0-491c-a1a6-85f3ad848553 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:09.067772 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:09.074284 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4c418-9110-4b29-b78b-5acfe7515ab9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:09.107687 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d15a5-2f06-4fd9-bbba-3affa15ff34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:09.108374 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d15a5-2f06-4fd9-bbba-3affa15ff34f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:09.108647 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d15a5-2f06-4fd9-bbba-3affa15ff34f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:09.108913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d15a5-2f06-4fd9-bbba-3affa15ff34f None admin] PATH_INFO: `/v3/groups/93f67a46fc8347c1915edc63ff6e57bd` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:09.110440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d15a5-2f06-4fd9-bbba-3affa15ff34f None admin] RBAC: Authorizing `identity:get_group(group_id=93f67a46fc8347c1915edc63ff6e57bd)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:09.111885 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d15a5-2f06-4fd9-bbba-3affa15ff34f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:09.113467 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 232/451] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 13 13:59:08 2022] GET /identity/v3/groups/93f67a46fc8347c1915edc63ff6e57bd => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:09.119534 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d15a5-2f06-4fd9-bbba-3affa15ff34f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:09.155045 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673d2b0-18b0-491c-a1a6-85f3ad848553 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:09.190187 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc92b3c-11de-4cd0-981c-6cc7615b2d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:09.190822 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc92b3c-11de-4cd0-981c-6cc7615b2d78 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:09.191103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc92b3c-11de-4cd0-981c-6cc7615b2d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:09.191376 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc92b3c-11de-4cd0-981c-6cc7615b2d78 None admin] PATH_INFO: `/v3/projects/b2ed08b3b52d45f68ee1e0b8c4e4ceb4` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:09.193081 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc92b3c-11de-4cd0-981c-6cc7615b2d78 None admin] RBAC: Authorizing `identity:get_project(project_id=b2ed08b3b52d45f68ee1e0b8c4e4ceb4)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:09.194950 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc92b3c-11de-4cd0-981c-6cc7615b2d78 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:09.196961 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 220/452] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 13:59:09 2022] GET /identity/v3/projects/b2ed08b3b52d45f68ee1e0b8c4e4ceb4 => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:09.202313 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc92b3c-11de-4cd0-981c-6cc7615b2d78 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:09.219178 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d15a5-2f06-4fd9-bbba-3affa15ff34f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:09.252661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60af96-2ccf-4102-ab53-4afbae670c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:09.253280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60af96-2ccf-4102-ab53-4afbae670c5c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:09.253559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60af96-2ccf-4102-ab53-4afbae670c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:09.253884 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60af96-2ccf-4102-ab53-4afbae670c5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:09.254603 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60af96-2ccf-4102-ab53-4afbae670c5c None admin] RBAC: Adding query filter params (group.id=93f67a46fc8347c1915edc63ff6e57bd, role.id=cf8554dac8d343549802afd60c56c0d6, scope.project.id=11155a320d8a4d4bb8eebe5129dd9cf8) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:09.255011 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60af96-2ccf-4102-ab53-4afbae670c5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:09.256434 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60af96-2ccf-4102-ab53-4afbae670c5c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:09.262097 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 233/453] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Sep 13 13:59:09 2022] GET /identity/v3/role_assignments?group.id=93f67a46fc8347c1915edc63ff6e57bd&scope.project.id=11155a320d8a4d4bb8eebe5129dd9cf8&role.id=cf8554dac8d343549802afd60c56c0d6 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:09.279441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:09.306241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc92b3c-11de-4cd0-981c-6cc7615b2d78 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:09.343884 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe418e-f5ab-4ded-93da-86dde1004cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:09.344518 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe418e-f5ab-4ded-93da-86dde1004cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:09.344797 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe418e-f5ab-4ded-93da-86dde1004cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:09.345067 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe418e-f5ab-4ded-93da-86dde1004cd8 None admin] PATH_INFO: `/v3/groups/6ddf8af8c52d4c1b810bfa6fa316c44c` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:09.346267 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe418e-f5ab-4ded-93da-86dde1004cd8 None admin] RBAC: Authorizing `identity:get_group(group_id=6ddf8af8c52d4c1b810bfa6fa316c44c)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:09.347752 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe418e-f5ab-4ded-93da-86dde1004cd8 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:09.349969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 221/454] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Sep 13 13:59:09 2022] GET /identity/v3/groups/6ddf8af8c52d4c1b810bfa6fa316c44c => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:09.355966 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60af96-2ccf-4102-ab53-4afbae670c5c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:09.358924 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:09.461508 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60af96-2ccf-4102-ab53-4afbae670c5c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:09.494814 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bcd32-dc9d-453e-acbc-80cadac7c2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:09.495416 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bcd32-dc9d-453e-acbc-80cadac7c2c7 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:09.495695 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bcd32-dc9d-453e-acbc-80cadac7c2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:09.495969 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bcd32-dc9d-453e-acbc-80cadac7c2c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:09.496702 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bcd32-dc9d-453e-acbc-80cadac7c2c7 None admin] RBAC: Adding query filter params (group.id=6ddf8af8c52d4c1b810bfa6fa316c44c, role.id=6dcc8495d2b24b3eab63dd656eb4eb6d, scope.project.id=b2ed08b3b52d45f68ee1e0b8c4e4ceb4) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:09.497033 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bcd32-dc9d-453e-acbc-80cadac7c2c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:09.498504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bcd32-dc9d-453e-acbc-80cadac7c2c7 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:09.504435 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 234/455] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Sep 13 13:59:09 2022] GET /identity/v3/role_assignments?group.id=6ddf8af8c52d4c1b810bfa6fa316c44c&scope.project.id=b2ed08b3b52d45f68ee1e0b8c4e4ceb4&role.id=6dcc8495d2b24b3eab63dd656eb4eb6d => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:12.102165 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9dc14-f59c-4e04-a586-85b48ac6058c None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:12.103065 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9dc14-f59c-4e04-a586-85b48ac6058c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:12.103541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9dc14-f59c-4e04-a586-85b48ac6058c None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:12.105350 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 222/456] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:12.111209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb0b43-f93a-4324-834b-c2e8890d44f6 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:12.112008 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb0b43-f93a-4324-834b-c2e8890d44f6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:12.112465 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb0b43-f93a-4324-834b-c2e8890d44f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:12.142468 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ddcb0b43-f93a-4324-834b-c2e8890d44f6 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:12.143948 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ddcb0b43-f93a-4324-834b-c2e8890d44f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:12.234248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:12.247296 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 235/457] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:12.493301 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a38f8-a79a-44ea-8153-8689e76c0782 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:12.493575 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a38f8-a79a-44ea-8153-8689e76c0782 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:12.493844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a38f8-a79a-44ea-8153-8689e76c0782 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:12.495563 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 223/458] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:12.501546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e3e20-a8ad-4fea-8b41-a83b4d21bc2f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:12.501827 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e3e20-a8ad-4fea-8b41-a83b4d21bc2f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:12.502102 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e3e20-a8ad-4fea-8b41-a83b4d21bc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:12.530224 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c73e3e20-a8ad-4fea-8b41-a83b4d21bc2f None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:12.531450 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c73e3e20-a8ad-4fea-8b41-a83b4d21bc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:12.599766 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a38f8-a79a-44ea-8153-8689e76c0782 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:12.628005 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 236/459] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:12.637413 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7048e19-d3bb-4a7d-99ac-77fb2ae13646 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:12.637710 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7048e19-d3bb-4a7d-99ac-77fb2ae13646 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:12.637966 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7048e19-d3bb-4a7d-99ac-77fb2ae13646 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:12.639427 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 237/460] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 13:59:12.644662 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d684a27-a253-41a7-94e6-bfaca2d53af6 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:12.644952 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d684a27-a253-41a7-94e6-bfaca2d53af6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:12.645261 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d684a27-a253-41a7-94e6-bfaca2d53af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:12.689459 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-7d684a27-a253-41a7-94e6-bfaca2d53af6 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:12.690960 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7d684a27-a253-41a7-94e6-bfaca2d53af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:12.756020 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a38f8-a79a-44ea-8153-8689e76c0782 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:12.821716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 238/461] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 13:59:12.829116 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5b17a-0dc3-4e14-8874-3041d6b05232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:12.829116 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5b17a-0dc3-4e14-8874-3041d6b05232 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:12.829116 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5b17a-0dc3-4e14-8874-3041d6b05232 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:12.829116 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5b17a-0dc3-4e14-8874-3041d6b05232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:12.848795 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5b17a-0dc3-4e14-8874-3041d6b05232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:12.850310 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5b17a-0dc3-4e14-8874-3041d6b05232 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:12.865419 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:12.881248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-cce5b17a-0dc3-4e14-8874-3041d6b05232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:12.881248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:12.881248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:12.881248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:12.881248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:12.881248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:12.881248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:12.881248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:12.881248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:12.881248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:12.881248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:12.881248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:12.881248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:12.881248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:12.881248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:12.881248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:12.882195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:12.882195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:12.882195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:12.882195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:12.882195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:12.882195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:12.882195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:12.882195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:12.882195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:12.882195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:12.882195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:12.882195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:12.882195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:12.882195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:12.882195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:12.882195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:12.882195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:12.883027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:12.883027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:12.883027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:12.886367 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 224/462] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:12.892394 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d684a27-a253-41a7-94e6-bfaca2d53af6 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:12.907328 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5b17a-0dc3-4e14-8874-3041d6b05232 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:12.979213 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:13.029174 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5b17a-0dc3-4e14-8874-3041d6b05232 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:13.057776 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d684a27-a253-41a7-94e6-bfaca2d53af6 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:13.065030 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99002f-b8c0-4594-ba71-61c7f87187f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:13.065955 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99002f-b8c0-4594-ba71-61c7f87187f2 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:13.066424 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99002f-b8c0-4594-ba71-61c7f87187f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:13.066905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99002f-b8c0-4594-ba71-61c7f87187f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:13.078245 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99002f-b8c0-4594-ba71-61c7f87187f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:13.080056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99002f-b8c0-4594-ba71-61c7f87187f2 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:13.095117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-8a99002f-b8c0-4594-ba71-61c7f87187f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:13.095117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:13.095117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:13.095117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:13.095117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:13.095117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:13.095117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:13.095117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:13.095117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:13.095117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:13.095117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:13.095117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:13.095117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:13.095117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:13.095117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:13.095117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:13.096104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:13.096104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:13.096104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:13.096104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:13.096104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:13.096104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:13.096104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:13.096104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:13.096104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:13.096104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:13.096104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:13.096104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:13.096104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:13.096104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:13.096104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:13.096104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:13.096104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:13.096926 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:13.096926 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:13.096926 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:13.099027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 225/463] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:59:13.106145 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99002f-b8c0-4594-ba71-61c7f87187f2 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:13.143881 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d7168-15f9-41c3-84a9-f99598fd5949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:13.145442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d7168-15f9-41c3-84a9-f99598fd5949 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:13.145867 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d7168-15f9-41c3-84a9-f99598fd5949 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:13.146304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d7168-15f9-41c3-84a9-f99598fd5949 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:13.147131 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d7168-15f9-41c3-84a9-f99598fd5949 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:13.147880 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d7168-15f9-41c3-84a9-f99598fd5949 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:13.150621 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d7168-15f9-41c3-84a9-f99598fd5949 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:13.165730 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:13.169529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 239/464] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:13.171045 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d7168-15f9-41c3-84a9-f99598fd5949 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:13.227680 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99002f-b8c0-4594-ba71-61c7f87187f2 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:13.266696 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f2af2-3bc3-4c65-96e7-ba4f290b46ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:13.267294 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f2af2-3bc3-4c65-96e7-ba4f290b46ea None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:13.267569 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f2af2-3bc3-4c65-96e7-ba4f290b46ea None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:13.267833 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f2af2-3bc3-4c65-96e7-ba4f290b46ea None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:13.268472 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f2af2-3bc3-4c65-96e7-ba4f290b46ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:13.268769 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f2af2-3bc3-4c65-96e7-ba4f290b46ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:13.270165 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f2af2-3bc3-4c65-96e7-ba4f290b46ea None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:13.282232 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 226/465] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:13.288693 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f2af2-3bc3-4c65-96e7-ba4f290b46ea None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:13.299398 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d7168-15f9-41c3-84a9-f99598fd5949 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:13.316785 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:13.336245 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265e02a-6fe3-4611-85b2-bf4d23859ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:13.336869 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265e02a-6fe3-4611-85b2-bf4d23859ebd None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:13.337169 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265e02a-6fe3-4611-85b2-bf4d23859ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:13.337441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265e02a-6fe3-4611-85b2-bf4d23859ebd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:13.348230 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265e02a-6fe3-4611-85b2-bf4d23859ebd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:13.350258 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265e02a-6fe3-4611-85b2-bf4d23859ebd None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:13.366145 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-a265e02a-6fe3-4611-85b2-bf4d23859ebd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:13.366145 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:13.366145 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:13.366145 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:13.366145 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:13.366145 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:13.366145 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:13.366145 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:13.366145 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:13.366145 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:13.366145 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:13.366145 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:13.366145 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:13.366145 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:13.366145 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:13.366145 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:13.367018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:13.367018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:13.367018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:13.367018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:13.367018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:13.367018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:13.367018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:13.367018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:13.367018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:13.367018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:13.367018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:13.367018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:13.367018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:13.367018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:13.367018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:13.367018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:13.367018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:13.367869 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:13.367869 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:13.367869 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:13.367869 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 240/466] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:13.368917 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81f771-4c5e-4fbb-af00-e2fad66d8b34 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:13.368917 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81f771-4c5e-4fbb-af00-e2fad66d8b34 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:13.368917 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81f771-4c5e-4fbb-af00-e2fad66d8b34 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:13.370315 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 241/467] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:13.370838 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81f771-4c5e-4fbb-af00-e2fad66d8b34 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:13.408595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f2af2-3bc3-4c65-96e7-ba4f290b46ea None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:13.420142 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:13.449311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb12998-aa33-4fdc-9019-3333a06e605c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:13.449910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb12998-aa33-4fdc-9019-3333a06e605c None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:13.450184 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb12998-aa33-4fdc-9019-3333a06e605c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:13.450455 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb12998-aa33-4fdc-9019-3333a06e605c None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:13.451095 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb12998-aa33-4fdc-9019-3333a06e605c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:13.452535 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb12998-aa33-4fdc-9019-3333a06e605c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:13.479948 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81f771-4c5e-4fbb-af00-e2fad66d8b34 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:13.485117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 227/468] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 13 13:59:13 2022] POST /identity/v3/users => generated 246 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 13:59:13.486032 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb12998-aa33-4fdc-9019-3333a06e605c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:13.528317 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314e63a-6be7-497c-9607-bced6a2158b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:13.528964 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314e63a-6be7-497c-9607-bced6a2158b6 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:13.529296 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314e63a-6be7-497c-9607-bced6a2158b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:13.529574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314e63a-6be7-497c-9607-bced6a2158b6 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:13.530419 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314e63a-6be7-497c-9607-bced6a2158b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:13.532107 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314e63a-6be7-497c-9607-bced6a2158b6 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:13.560437 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 242/469] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 13 13:59:13 2022] POST /identity/v3/users => generated 248 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 13:59:13.562429 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf7e25-a39e-42e0-b56a-98e0253762f3 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:13.562719 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf7e25-a39e-42e0-b56a-98e0253762f3 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:13.562993 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf7e25-a39e-42e0-b56a-98e0253762f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:13.589972 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-91bf7e25-a39e-42e0-b56a-98e0253762f3 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:13.591577 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-91bf7e25-a39e-42e0-b56a-98e0253762f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:13.619398 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:13.641312 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb12998-aa33-4fdc-9019-3333a06e605c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:13.689165 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 243/470] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:13.689165 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1935a-f32b-493a-ad15-c0a629abe74d None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:13.689165 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1935a-f32b-493a-ad15-c0a629abe74d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:13.689543 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1935a-f32b-493a-ad15-c0a629abe74d None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:13.691358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 244/471] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:13.696871 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad79d2-226d-486d-be1c-364d60c4ddcf None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:13.697312 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad79d2-226d-486d-be1c-364d60c4ddcf None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:13.697597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad79d2-226d-486d-be1c-364d60c4ddcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:13.702059 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f515bd-839b-421c-a839-eaf1bcf0f6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:13.702059 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f515bd-839b-421c-a839-eaf1bcf0f6f9 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:13.702321 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f515bd-839b-421c-a839-eaf1bcf0f6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:13.702519 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f515bd-839b-421c-a839-eaf1bcf0f6f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:13.704801 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f515bd-839b-421c-a839-eaf1bcf0f6f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:13.704801 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f515bd-839b-421c-a839-eaf1bcf0f6f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:13.704977 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f515bd-839b-421c-a839-eaf1bcf0f6f9 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:13.726351 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 228/472] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:13.730488 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f515bd-839b-421c-a839-eaf1bcf0f6f9 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:13.735976 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-2dad79d2-226d-486d-be1c-364d60c4ddcf None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:13.737740 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2dad79d2-226d-486d-be1c-364d60c4ddcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:13.763216 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:13.828905 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 245/473] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:13.862325 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f515bd-839b-421c-a839-eaf1bcf0f6f9 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:13.905256 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a4c1a-083f-4ef6-aa96-0fc9796c323a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:13.905866 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a4c1a-083f-4ef6-aa96-0fc9796c323a None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:13.906139 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a4c1a-083f-4ef6-aa96-0fc9796c323a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:13.906400 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a4c1a-083f-4ef6-aa96-0fc9796c323a None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:13.907061 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a4c1a-083f-4ef6-aa96-0fc9796c323a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:13.908772 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a4c1a-083f-4ef6-aa96-0fc9796c323a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:13.937257 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 229/474] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 13 13:59:13 2022] POST /identity/v3/users => generated 248 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 13:59:14.077764 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad79d2-226d-486d-be1c-364d60c4ddcf None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:14.148127 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a4c1a-083f-4ef6-aa96-0fc9796c323a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:14.204838 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:14.235888 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad79d2-226d-486d-be1c-364d60c4ddcf None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:14.251424 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:14.277265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a4c1a-083f-4ef6-aa96-0fc9796c323a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:14.287213 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931f71e-a8a5-46dd-a248-5dff07fca369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:14.287854 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931f71e-a8a5-46dd-a248-5dff07fca369 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:14.288129 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931f71e-a8a5-46dd-a248-5dff07fca369 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:14.288399 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931f71e-a8a5-46dd-a248-5dff07fca369 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:14.303111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931f71e-a8a5-46dd-a248-5dff07fca369 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:14.304597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931f71e-a8a5-46dd-a248-5dff07fca369 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:14.318248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00c697-a423-4305-ae42-5528b6fb0c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:14.318852 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00c697-a423-4305-ae42-5528b6fb0c7c None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:14.319124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00c697-a423-4305-ae42-5528b6fb0c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:14.319390 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00c697-a423-4305-ae42-5528b6fb0c7c None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:14.320068 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00c697-a423-4305-ae42-5528b6fb0c7c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:14.321475 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00c697-a423-4305-ae42-5528b6fb0c7c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:14.323156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-9931f71e-a8a5-46dd-a248-5dff07fca369 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:14.323156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:14.323156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:14.323156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:14.323156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:14.323156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:14.323156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:14.323156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:14.323156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:14.323156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:14.323156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:14.323156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:14.323156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:14.323156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:14.323156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:14.323156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:14.323984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:14.323984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:14.323984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:14.323984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:14.323984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:14.323984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:14.323984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:14.323984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:14.323984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:14.323984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:14.323984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:14.323984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:14.323984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:14.323984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:14.323984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:14.323984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:14.323984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:14.324984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:14.324984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:14.324984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:14.324984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 246/475] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:14.329551 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.sql.core [None req-3d00c697-a423-4305-ae42-5528b6fb0c7c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 13:59:14.329551 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 13 13:59:14.329551 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [parameters: {'id': 'a8d3e7e817854b9891cc007a69699516', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 13 13:59:14.329551 dv-cinder-857434-1-smb devstack@keystone.service[81625]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81625) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 13:59:14.333421 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931f71e-a8a5-46dd-a248-5dff07fca369 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:14.348036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-3d00c697-a423-4305-ae42-5528b6fb0c7c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 13 13:59:14.348036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:14.348036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 13:59:14.348036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 13:59:14.348036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 13:59:14.348036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 13:59:14.348036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 13:59:14.348036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 13:59:14.348036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 13:59:14.348036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application conn.query(q) Sep 13 13:59:14.348036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 13:59:14.348036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 13:59:14.348036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 13:59:14.348036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application result.read() Sep 13 13:59:14.348036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 13:59:14.349087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 13:59:14.349087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 13:59:14.349087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 13:59:14.349087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 13:59:14.349087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 13:59:14.349087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 13:59:14.349087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 13:59:14.349087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 13:59:14.349087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:14.349087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 13:59:14.349087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:14.349087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:14.349087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 13:59:14.349087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 13:59:14.349087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 13 13:59:14.349087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return ref.to_dict() Sep 13 13:59:14.349087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 13:59:14.349087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application next(self.gen) Sep 13 13:59:14.351104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 13:59:14.351104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application yield resource Sep 13 13:59:14.351104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 13:59:14.351104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application next(self.gen) Sep 13 13:59:14.351104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 13:59:14.351104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 13:59:14.351104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 13:59:14.351104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 13:59:14.351104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 13:59:14.351104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise self.value Sep 13 13:59:14.351104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 13:59:14.351104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 13:59:14.351104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 13:59:14.351104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application session.commit() Sep 13 13:59:14.351104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 13:59:14.351104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 13:59:14.351104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 13:59:14.351930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 13:59:14.351930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 13:59:14.351930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self.session.flush() Sep 13 13:59:14.351930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 13:59:14.351930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 13:59:14.351930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 13:59:14.351930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 13:59:14.351930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 13:59:14.351930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application compat.raise_( Sep 13 13:59:14.351930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 13:59:14.351930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception Sep 13 13:59:14.351930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 13:59:14.351930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 13:59:14.351930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 13:59:14.351930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 13:59:14.351930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 13:59:14.351930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 13:59:14.352829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 13:59:14.352829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 13:59:14.352829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 13 13:59:14.352829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 13 13:59:14.352829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 13:59:14.352829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 13:59:14.352829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 13:59:14.352829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 13:59:14.352829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 13:59:14.352829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 13:59:14.352829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 13:59:14.352829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 13:59:14.352829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 13:59:14.352829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 13:59:14.352829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 13:59:14.352829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception Sep 13 13:59:14.353654 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 13:59:14.353654 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 13:59:14.353654 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 13:59:14.353654 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 13:59:14.353654 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 13:59:14.353654 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 13:59:14.353654 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 13:59:14.353654 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application conn.query(q) Sep 13 13:59:14.353654 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 13:59:14.353654 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 13:59:14.353654 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 13:59:14.353654 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application result.read() Sep 13 13:59:14.353654 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 13:59:14.353654 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 13:59:14.353654 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 13:59:14.353654 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 13:59:14.355625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 13:59:14.355625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 13:59:14.355625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 13:59:14.355625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 13:59:14.355625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 13:59:14.355625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 13 13:59:14.355625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [parameters: {'id': 'a8d3e7e817854b9891cc007a69699516', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 13 13:59:14.355625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 13:59:14.355625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:14.355625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 13:59:14.355625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:14.355625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:14.355625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:14.355625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:14.355625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:14.355625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:14.356828 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:14.356828 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:14.356828 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:14.356828 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:14.356828 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:14.356828 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:14.356828 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 13 13:59:14.356828 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 13 13:59:14.356828 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:14.356828 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:14.356828 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 13 13:59:14.356828 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 13 13:59:14.356828 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 13:59:14.356828 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 13:59:14.356828 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 13 13:59:14.356828 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:14.358621 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 230/476] 10.222.0.26 () {60 vars in 1131 bytes} [Tue Sep 13 13:59:14 2022] POST /identity/v3/roles => generated 144 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:59:14.358621 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00c697-a423-4305-ae42-5528b6fb0c7c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:14.467913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931f71e-a8a5-46dd-a248-5dff07fca369 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:14.481180 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00c697-a423-4305-ae42-5528b6fb0c7c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:14.504836 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c717816-1d13-443a-abf3-c1b8dbb480c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:14.505939 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c717816-1d13-443a-abf3-c1b8dbb480c2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:14.506421 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c717816-1d13-443a-abf3-c1b8dbb480c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:14.506908 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c717816-1d13-443a-abf3-c1b8dbb480c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:14.507803 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c717816-1d13-443a-abf3-c1b8dbb480c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:14.508343 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c717816-1d13-443a-abf3-c1b8dbb480c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:14.510047 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c717816-1d13-443a-abf3-c1b8dbb480c2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:14.521986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e0159-5670-4669-8c40-8e31c9a5b0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:14.522610 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e0159-5670-4669-8c40-8e31c9a5b0c3 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:14.522894 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e0159-5670-4669-8c40-8e31c9a5b0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:14.523155 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e0159-5670-4669-8c40-8e31c9a5b0c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:14.524680 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 247/477] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:14.529238 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:14.530736 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c717816-1d13-443a-abf3-c1b8dbb480c2 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:14.537472 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e0159-5670-4669-8c40-8e31c9a5b0c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:14.543929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-204e0159-5670-4669-8c40-8e31c9a5b0c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 13:59:14.543929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:14.543929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:14.543929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:14.543929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:14.543929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:14.543929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:14.543929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:14.543929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:14.543929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:14.543929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:14.543929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:14.543929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:14.543929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:14.543929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:14.543929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:14.544887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:14.544887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:14.544887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:14.544887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:14.544887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:14.544887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:14.544887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:14.544887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:14.544887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:14.544887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:14.544887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:14.544887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:14.544887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:14.544887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:14.544887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:14.544887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:14.545713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:14.545713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:14.545713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:14.545713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:14.545713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:14.545713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:14.545713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:14.545713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:14.545713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:14.545713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:14.545713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 13:59:14.545713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:14.549165 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 231/478] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 13 13:59:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:59:14.552373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e0159-5670-4669-8c40-8e31c9a5b0c3 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:14.556870 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:14.716516 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c717816-1d13-443a-abf3-c1b8dbb480c2 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:14.768347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da156ee7-8ef2-4771-b91c-010a890d7418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:14.769412 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da156ee7-8ef2-4771-b91c-010a890d7418 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:14.769895 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da156ee7-8ef2-4771-b91c-010a890d7418 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:14.770438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da156ee7-8ef2-4771-b91c-010a890d7418 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:14.771349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da156ee7-8ef2-4771-b91c-010a890d7418 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:14.771453 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e0159-5670-4669-8c40-8e31c9a5b0c3 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:14.773330 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da156ee7-8ef2-4771-b91c-010a890d7418 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:14.808834 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4b91b-d23b-4288-8c1d-1d3254ccf24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:14.809584 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4b91b-d23b-4288-8c1d-1d3254ccf24b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:14.809825 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4b91b-d23b-4288-8c1d-1d3254ccf24b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:14.810152 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4b91b-d23b-4288-8c1d-1d3254ccf24b None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:14.810853 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4b91b-d23b-4288-8c1d-1d3254ccf24b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:14.811220 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4b91b-d23b-4288-8c1d-1d3254ccf24b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:14.812721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4b91b-d23b-4288-8c1d-1d3254ccf24b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:14.822037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 248/479] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 13 13:59:14 2022] POST /identity/v3/users => generated 249 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 13:59:14.822232 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 232/480] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:16.368660 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905d2bd-0065-4ad5-bb7b-74fd656b0c2b None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:16.369191 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905d2bd-0065-4ad5-bb7b-74fd656b0c2b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:16.369300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905d2bd-0065-4ad5-bb7b-74fd656b0c2b None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:16.370840 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 249/481] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:16.375813 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a55220-211b-42b8-9c8c-8d59bf4d038c None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:16.376203 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a55220-211b-42b8-9c8c-8d59bf4d038c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:16.376368 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a55220-211b-42b8-9c8c-8d59bf4d038c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:16.394959 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-f3a55220-211b-42b8-9c8c-8d59bf4d038c None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:16.396717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f3a55220-211b-42b8-9c8c-8d59bf4d038c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:16.425417 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edae782-12ee-44ad-8c56-08bb50a5f68d None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:16.425691 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edae782-12ee-44ad-8c56-08bb50a5f68d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:16.425957 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edae782-12ee-44ad-8c56-08bb50a5f68d None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:16.427565 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 250/482] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 13:59:16.433199 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19afca7-c16b-4783-a5cd-248193e13b0e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:16.433486 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19afca7-c16b-4783-a5cd-248193e13b0e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:16.433759 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19afca7-c16b-4783-a5cd-248193e13b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:16.454035 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c19afca7-c16b-4783-a5cd-248193e13b0e None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:16.455378 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c19afca7-c16b-4783-a5cd-248193e13b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:16.480357 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:16.489959 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 233/483] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:16.513179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:16.546517 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 251/484] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 13:59:16.626276 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe326489-fb28-47b9-8e50-2d65cda6a3fc None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:16.626521 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe326489-fb28-47b9-8e50-2d65cda6a3fc None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:16.626760 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe326489-fb28-47b9-8e50-2d65cda6a3fc None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:16.628363 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 234/485] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:16.634191 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2684025-bf3d-4cdb-818a-f8ced6f880c2 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:16.634473 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2684025-bf3d-4cdb-818a-f8ced6f880c2 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:16.634742 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2684025-bf3d-4cdb-818a-f8ced6f880c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:16.653109 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a2684025-bf3d-4cdb-818a-f8ced6f880c2 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:16.654312 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a2684025-bf3d-4cdb-818a-f8ced6f880c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:16.747457 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 252/486] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:16.881850 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe326489-fb28-47b9-8e50-2d65cda6a3fc None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:16.979586 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2684025-bf3d-4cdb-818a-f8ced6f880c2 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:16.991655 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe326489-fb28-47b9-8e50-2d65cda6a3fc None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:17.028895 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9faf656-861a-4b39-a1ac-8996d19ba281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:17.029554 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9faf656-861a-4b39-a1ac-8996d19ba281 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:17.029829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9faf656-861a-4b39-a1ac-8996d19ba281 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:17.030096 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9faf656-861a-4b39-a1ac-8996d19ba281 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:17.042087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9faf656-861a-4b39-a1ac-8996d19ba281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:17.048309 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-e9faf656-861a-4b39-a1ac-8996d19ba281 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:17.048309 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:17.048309 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:17.048309 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:17.048309 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:17.048309 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:17.048309 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:17.048309 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:17.048309 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:17.048309 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:17.048309 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:17.048309 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:17.048309 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:17.048309 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:17.048309 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:17.048309 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:17.049222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:17.049222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:17.049222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:17.049222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:17.049222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:17.049222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:17.049222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:17.049222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:17.049222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:17.049222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:17.049222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:17.049222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:17.049222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:17.049222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:17.049222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:17.049222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:17.050237 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:17.050237 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:17.050237 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:17.050237 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:17.050237 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:17.050237 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:17.050237 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:17.050237 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:17.050237 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:17.050237 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:17.050237 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:17.050237 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:17.050237 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 235/487] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 13 13:59:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:17.058038 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9faf656-861a-4b39-a1ac-8996d19ba281 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:17.127808 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2684025-bf3d-4cdb-818a-f8ced6f880c2 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:17.142442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:17.168228 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5428c9-d6c5-475f-b214-275e3aec71ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:17.169263 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5428c9-d6c5-475f-b214-275e3aec71ae None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:17.169710 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5428c9-d6c5-475f-b214-275e3aec71ae None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:17.170173 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:17.170537 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5428c9-d6c5-475f-b214-275e3aec71ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:17.185619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9faf656-861a-4b39-a1ac-8996d19ba281 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:17.186720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5428c9-d6c5-475f-b214-275e3aec71ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:17.194022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-9e5428c9-d6c5-475f-b214-275e3aec71ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:17.194022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:17.194022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:17.194022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:17.194022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:17.194022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:17.194022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:17.194022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:17.194022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:17.194022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:17.194022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:17.194022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:17.194022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:17.194022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:17.194022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:17.194022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:17.195078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:17.195078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:17.195078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:17.195078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:17.195078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:17.195078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:17.195078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:17.195078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:17.195078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:17.195078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:17.195078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:17.195078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:17.195078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:17.195078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:17.195078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:17.195078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:17.195904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:17.195904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:17.195904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:17.195904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:17.195904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:17.195904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:17.195904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:17.195904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:17.195904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:17.195904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:17.195904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:17.195904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:17.198900 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 253/488] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 13 13:59:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:17.199943 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5428c9-d6c5-475f-b214-275e3aec71ae None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:17.232829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42178e-7f05-4ed4-b4ab-88b34747c3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:17.233455 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42178e-7f05-4ed4-b4ab-88b34747c3f8 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:17.233731 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42178e-7f05-4ed4-b4ab-88b34747c3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:17.234000 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42178e-7f05-4ed4-b4ab-88b34747c3f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:17.234664 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42178e-7f05-4ed4-b4ab-88b34747c3f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:17.234962 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42178e-7f05-4ed4-b4ab-88b34747c3f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:17.236526 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42178e-7f05-4ed4-b4ab-88b34747c3f8 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:17.247082 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 236/489] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 13 13:59:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:17.248023 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42178e-7f05-4ed4-b4ab-88b34747c3f8 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:17.332809 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5428c9-d6c5-475f-b214-275e3aec71ae None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:17.371775 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42178e-7f05-4ed4-b4ab-88b34747c3f8 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:17.378923 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f84e1-f79a-4a4d-b40a-1e701bb859ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:17.381205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f84e1-f79a-4a4d-b40a-1e701bb859ed None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:17.381720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f84e1-f79a-4a4d-b40a-1e701bb859ed None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:17.382629 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f84e1-f79a-4a4d-b40a-1e701bb859ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:17.391285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:17.399124 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f84e1-f79a-4a4d-b40a-1e701bb859ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:17.407106 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-0e8f84e1-f79a-4a4d-b40a-1e701bb859ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:17.407106 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:17.407106 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:17.407106 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:17.407106 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:17.407106 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:17.407106 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:17.407106 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:17.407106 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:17.407106 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:17.407106 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:17.407106 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:17.407106 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:17.407106 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:17.407106 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:17.407106 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:17.408430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:17.408430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:17.408430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:17.408430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:17.408430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:17.408430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:17.408430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:17.408430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:17.408430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:17.408430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:17.408430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:17.408430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:17.408430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:17.408430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:17.408430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:17.408430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:17.409396 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:17.409396 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:17.409396 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:17.409396 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:17.409396 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:17.409396 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:17.409396 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:17.409396 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:17.409396 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:17.409396 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:17.409396 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:17.409396 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:17.411595 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 254/490] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 13 13:59:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:17.412666 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f84e1-f79a-4a4d-b40a-1e701bb859ed None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:17.413929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62348a-4ddc-4e18-90b8-d1760cfffcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:17.414692 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62348a-4ddc-4e18-90b8-d1760cfffcf2 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:17.415094 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62348a-4ddc-4e18-90b8-d1760cfffcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:17.415475 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62348a-4ddc-4e18-90b8-d1760cfffcf2 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:17.416538 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62348a-4ddc-4e18-90b8-d1760cfffcf2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:17.417002 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62348a-4ddc-4e18-90b8-d1760cfffcf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:17.418816 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62348a-4ddc-4e18-90b8-d1760cfffcf2 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:17.435635 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 237/491] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 13 13:59:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:17.436634 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62348a-4ddc-4e18-90b8-d1760cfffcf2 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:17.454998 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:17.535429 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f84e1-f79a-4a4d-b40a-1e701bb859ed None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:17.552717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62348a-4ddc-4e18-90b8-d1760cfffcf2 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:17.575487 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a83f7-2708-4010-884c-561f56b13b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:17.576380 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a83f7-2708-4010-884c-561f56b13b60 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:17.576869 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a83f7-2708-4010-884c-561f56b13b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:17.577362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a83f7-2708-4010-884c-561f56b13b60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:17.589765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a83f7-2708-4010-884c-561f56b13b60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:17.591546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a83f7-2708-4010-884c-561f56b13b60 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:17.595023 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b2443-21c0-468d-92e8-bf6ca8843a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:17.595640 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b2443-21c0-468d-92e8-bf6ca8843a1d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:17.596035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b2443-21c0-468d-92e8-bf6ca8843a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:17.596452 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b2443-21c0-468d-92e8-bf6ca8843a1d None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:17.597265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b2443-21c0-468d-92e8-bf6ca8843a1d None admin] RBAC: Adding query filter params (name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:17.597670 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b2443-21c0-468d-92e8-bf6ca8843a1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:17.599191 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b2443-21c0-468d-92e8-bf6ca8843a1d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:17.608819 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-809a83f7-2708-4010-884c-561f56b13b60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:17.608819 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:17.608819 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:17.608819 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:17.608819 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:17.608819 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:17.608819 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:17.608819 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:17.608819 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:17.608819 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:17.608819 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:17.608819 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:17.608819 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:17.608819 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:17.608819 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:17.608819 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:17.609849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:17.609849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:17.609849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:17.609849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:17.609849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:17.609849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:17.609849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:17.609849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:17.609849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:17.609849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:17.609849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:17.609849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:17.609849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:17.609849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:17.609849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:17.609849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:17.609849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:17.610760 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:17.610760 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:17.610760 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:17.610918 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 238/492] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 13 13:59:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:17.610918 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b2443-21c0-468d-92e8-bf6ca8843a1d None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:17.612520 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 255/493] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:17.614542 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a783d49-cde5-4bc0-a427-0f76112f7326 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:17.615029 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a783d49-cde5-4bc0-a427-0f76112f7326 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:17.615491 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a783d49-cde5-4bc0-a427-0f76112f7326 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:17.617249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 256/494] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:17.619091 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a783d49-cde5-4bc0-a427-0f76112f7326 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:17.660295 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:17.707090 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:17.722035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b2443-21c0-468d-92e8-bf6ca8843a1d None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:17.725675 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a783d49-cde5-4bc0-a427-0f76112f7326 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:17.756067 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92909a-cea0-40ec-b674-ba01f81d0d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:17.756679 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92909a-cea0-40ec-b674-ba01f81d0d12 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:17.756958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92909a-cea0-40ec-b674-ba01f81d0d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:17.757268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92909a-cea0-40ec-b674-ba01f81d0d12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:17.759382 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7ebac-632f-45f6-bb8e-efbcc88bf982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:17.759970 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7ebac-632f-45f6-bb8e-efbcc88bf982 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:17.760251 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7ebac-632f-45f6-bb8e-efbcc88bf982 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:17.760520 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7ebac-632f-45f6-bb8e-efbcc88bf982 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:17.761168 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7ebac-632f-45f6-bb8e-efbcc88bf982 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:17.761467 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7ebac-632f-45f6-bb8e-efbcc88bf982 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:17.762828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7ebac-632f-45f6-bb8e-efbcc88bf982 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:17.767551 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92909a-cea0-40ec-b674-ba01f81d0d12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:17.768999 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92909a-cea0-40ec-b674-ba01f81d0d12 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:17.774320 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 257/495] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:17.775102 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7ebac-632f-45f6-bb8e-efbcc88bf982 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:17.784458 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-ab92909a-cea0-40ec-b674-ba01f81d0d12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:17.784458 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:17.784458 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:17.784458 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:17.784458 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:17.784458 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:17.784458 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:17.784458 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:17.784458 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:17.784458 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:17.784458 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:17.784458 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:17.784458 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:17.784458 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:17.784458 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:17.784458 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:17.785559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:17.785559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:17.785559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:17.785559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:17.785559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:17.785559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:17.785559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:17.785559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:17.785559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:17.785559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:17.785559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:17.785559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:17.785559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:17.785559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:17.785559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:17.785559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:17.785559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:17.786432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:17.786432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:17.786432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:17.786432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 239/496] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:17.786809 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84b572-6572-4bbf-8776-2e8112f7e7d4 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:17.787094 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84b572-6572-4bbf-8776-2e8112f7e7d4 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:17.787365 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84b572-6572-4bbf-8776-2e8112f7e7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:17.805608 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-1a84b572-6572-4bbf-8776-2e8112f7e7d4 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:17.806805 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1a84b572-6572-4bbf-8776-2e8112f7e7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:17.872821 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 240/497] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:17.874129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16801123-5be0-4483-b1be-493c4dd8fc88 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:17.874408 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16801123-5be0-4483-b1be-493c4dd8fc88 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:17.874675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16801123-5be0-4483-b1be-493c4dd8fc88 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:17.875910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 241/498] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:17.876589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16801123-5be0-4483-b1be-493c4dd8fc88 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:17.888505 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7ebac-632f-45f6-bb8e-efbcc88bf982 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:17.902513 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:17.926016 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae299b-df88-4af3-9ba1-f5fd3f66f9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:17.926734 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae299b-df88-4af3-9ba1-f5fd3f66f9a0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:17.927014 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae299b-df88-4af3-9ba1-f5fd3f66f9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:17.927285 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae299b-df88-4af3-9ba1-f5fd3f66f9a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:17.939048 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae299b-df88-4af3-9ba1-f5fd3f66f9a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:17.940498 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae299b-df88-4af3-9ba1-f5fd3f66f9a0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:17.943660 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:17.956834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-3eae299b-df88-4af3-9ba1-f5fd3f66f9a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:17.956834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:17.956834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:17.956834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:17.956834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:17.956834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:17.956834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:17.956834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:17.956834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:17.956834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:17.956834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:17.956834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:17.956834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:17.956834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:17.956834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:17.956834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:17.957767 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:17.957767 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:17.957767 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:17.957767 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:17.957767 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:17.957767 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:17.957767 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:17.957767 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:17.957767 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:17.957767 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:17.957767 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:17.957767 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:17.957767 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:17.957767 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:17.957767 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:17.957767 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:17.957767 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:17.958600 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:17.958600 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:17.958600 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:17.958600 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 258/499] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:17.959104 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae299b-df88-4af3-9ba1-f5fd3f66f9a0 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:17.990576 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16801123-5be0-4483-b1be-493c4dd8fc88 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:18.025316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb9c6f-af4e-44c9-819e-b4d9f75a789d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:18.026041 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb9c6f-af4e-44c9-819e-b4d9f75a789d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:18.026309 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb9c6f-af4e-44c9-819e-b4d9f75a789d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:18.026593 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb9c6f-af4e-44c9-819e-b4d9f75a789d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:18.034352 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb9c6f-af4e-44c9-819e-b4d9f75a789d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:18.035882 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb9c6f-af4e-44c9-819e-b4d9f75a789d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:18.049489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-3cfb9c6f-af4e-44c9-819e-b4d9f75a789d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 13:59:18.049489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:18.049489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:18.049489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:18.049489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:18.049489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:18.049489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:18.049489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:18.049489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:18.049489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:18.049489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:18.049489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:18.049489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 13:59:18.049489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 13:59:18.049489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 13:59:18.049489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 13:59:18.050426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:18.050426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:18.050426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 13:59:18.050426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:18.050426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 13:59:18.050426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:18.050426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:18.050426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:18.050426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:18.050426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:18.050426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:18.050426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:18.050426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:18.050426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:18.050426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:18.050426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:18.050426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:18.050426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:18.056803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:18.056803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:18.056803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 13:59:18.056803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 13:59:18.056803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 13:59:18.056803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 13:59:18.056803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 13:59:18.056803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 13:59:18.056803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 13:59:18.056803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:18.056803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 242/500] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:59:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:18.056803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11032ea6-c6b9-4c41-8433-3abf81eecf8d None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:18.056803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11032ea6-c6b9-4c41-8433-3abf81eecf8d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:18.057701 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11032ea6-c6b9-4c41-8433-3abf81eecf8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:18.070881 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae299b-df88-4af3-9ba1-f5fd3f66f9a0 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:18.073839 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-11032ea6-c6b9-4c41-8433-3abf81eecf8d None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:18.074996 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-11032ea6-c6b9-4c41-8433-3abf81eecf8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:18.104742 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeab995-3776-42f9-b0d5-401ca49ef36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:18.105374 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeab995-3776-42f9-b0d5-401ca49ef36a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:18.105655 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeab995-3776-42f9-b0d5-401ca49ef36a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:18.105931 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeab995-3776-42f9-b0d5-401ca49ef36a None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:18.106571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeab995-3776-42f9-b0d5-401ca49ef36a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:18.106875 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeab995-3776-42f9-b0d5-401ca49ef36a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:18.108235 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeab995-3776-42f9-b0d5-401ca49ef36a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:18.120613 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 259/501] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:18.121444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeab995-3776-42f9-b0d5-401ca49ef36a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:18.150742 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 243/502] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:18.151815 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11032ea6-c6b9-4c41-8433-3abf81eecf8d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:18.167441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:18.189895 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:18.234935 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeab995-3776-42f9-b0d5-401ca49ef36a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:18.257419 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11032ea6-c6b9-4c41-8433-3abf81eecf8d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:18.271901 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c1ea0-d9da-4c5e-8417-8f01561d1519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:18.272506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c1ea0-d9da-4c5e-8417-8f01561d1519 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:18.272788 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c1ea0-d9da-4c5e-8417-8f01561d1519 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:18.273061 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c1ea0-d9da-4c5e-8417-8f01561d1519 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:18.273728 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c1ea0-d9da-4c5e-8417-8f01561d1519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:18.274123 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c1ea0-d9da-4c5e-8417-8f01561d1519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:18.275390 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c1ea0-d9da-4c5e-8417-8f01561d1519 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:18.288232 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 260/503] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:18.288822 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c1ea0-d9da-4c5e-8417-8f01561d1519 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:18.297554 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee4729-1843-4b35-945a-0aea129de42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:18.298177 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee4729-1843-4b35-945a-0aea129de42f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:18.298429 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee4729-1843-4b35-945a-0aea129de42f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:18.298689 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee4729-1843-4b35-945a-0aea129de42f None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:18.299410 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee4729-1843-4b35-945a-0aea129de42f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:18.299699 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee4729-1843-4b35-945a-0aea129de42f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:18.301140 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee4729-1843-4b35-945a-0aea129de42f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:18.342173 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 244/504] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Sep 13 13:59:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:18.342173 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee4729-1843-4b35-945a-0aea129de42f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:18.398015 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c1ea0-d9da-4c5e-8417-8f01561d1519 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:18.415427 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:18.416292 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:18.434130 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668028f2-0e99-4a9e-9ad6-e5fa3cd38ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:18.434753 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668028f2-0e99-4a9e-9ad6-e5fa3cd38ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:18.435024 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668028f2-0e99-4a9e-9ad6-e5fa3cd38ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:18.435291 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668028f2-0e99-4a9e-9ad6-e5fa3cd38ad5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:18.443262 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668028f2-0e99-4a9e-9ad6-e5fa3cd38ad5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:18.444748 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668028f2-0e99-4a9e-9ad6-e5fa3cd38ad5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:18.447032 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee4729-1843-4b35-945a-0aea129de42f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:18.457300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-668028f2-0e99-4a9e-9ad6-e5fa3cd38ad5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 13:59:18.457300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:18.457300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:18.457300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:18.457300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:18.457300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:18.457300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:18.457300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:18.457300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:18.457300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:18.457300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:18.457300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:18.457300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 13:59:18.457300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 13:59:18.457300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 13:59:18.457300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 13:59:18.458879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:18.458879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:18.458879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 13:59:18.458879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:18.458879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 13:59:18.458879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:18.458879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:18.458879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:18.458879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:18.458879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:18.458879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:18.458879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:18.458879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:18.458879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:18.458879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:18.458879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:18.458879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:18.458879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:18.459798 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:18.459798 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:18.459798 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 13:59:18.459798 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 13:59:18.459798 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 13:59:18.459798 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 13:59:18.459798 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 13:59:18.459798 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 13:59:18.459798 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 13:59:18.459798 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:18.459798 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 261/505] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Sep 13 13:59:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:18.460360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668028f2-0e99-4a9e-9ad6-e5fa3cd38ad5 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:18.488645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8031d-4734-4370-ae66-8477963e9cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:18.489330 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8031d-4734-4370-ae66-8477963e9cac None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:18.489605 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8031d-4734-4370-ae66-8477963e9cac None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:18.489869 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8031d-4734-4370-ae66-8477963e9cac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:18.499792 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8031d-4734-4370-ae66-8477963e9cac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:18.501277 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8031d-4734-4370-ae66-8477963e9cac None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:18.516265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-02f8031d-4734-4370-ae66-8477963e9cac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:18.516265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:18.516265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:18.516265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:18.516265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:18.516265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:18.516265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:18.516265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:18.516265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:18.516265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:18.516265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:18.516265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:18.516265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:18.516265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:18.516265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:18.516265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:18.517185 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:18.517185 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:18.517185 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:18.517185 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:18.517185 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:18.517185 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:18.517185 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:18.517185 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:18.517185 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:18.517185 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:18.517185 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:18.517185 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:18.517185 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:18.517185 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:18.517185 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:18.517185 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:18.517185 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:18.518045 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:18.518045 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:18.518045 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:18.518045 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 245/506] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:18.518529 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8031d-4734-4370-ae66-8477963e9cac None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:18.563104 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668028f2-0e99-4a9e-9ad6-e5fa3cd38ad5 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:18.595670 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb9ad2-dd5e-448d-bdff-5ce715a9a3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:18.596279 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb9ad2-dd5e-448d-bdff-5ce715a9a3af None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:18.596556 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb9ad2-dd5e-448d-bdff-5ce715a9a3af None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:18.596833 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb9ad2-dd5e-448d-bdff-5ce715a9a3af None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:18.604552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb9ad2-dd5e-448d-bdff-5ce715a9a3af None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:18.606031 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb9ad2-dd5e-448d-bdff-5ce715a9a3af None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:18.618029 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-94fb9ad2-dd5e-448d-bdff-5ce715a9a3af None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 13:59:18.618029 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:18.618029 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:18.618029 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:18.618029 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:18.618029 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:18.618029 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:18.618029 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:18.618029 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:18.618029 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:18.618029 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:18.618029 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:18.618029 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 13:59:18.618029 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 13:59:18.618029 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 13:59:18.618029 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 13:59:18.618903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:18.618903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:18.618903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 13:59:18.618903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:18.618903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 13:59:18.618903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:18.618903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:18.618903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:18.618903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:18.618903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:18.618903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:18.618903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:18.618903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:18.618903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:18.618903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:18.618903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:18.618903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:18.618903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:18.619812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:18.619812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:18.619812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 13:59:18.619812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 13:59:18.619812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 13:59:18.619812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 13:59:18.619812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 13:59:18.619812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 13:59:18.619812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 13:59:18.619812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:18.619812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 262/507] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:59:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:18.620361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb9ad2-dd5e-448d-bdff-5ce715a9a3af None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:18.628313 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8031d-4734-4370-ae66-8477963e9cac None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:18.651196 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:18.655196 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:18.663085 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada87da-d9ff-4bb7-9807-41e83e989b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:18.663680 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada87da-d9ff-4bb7-9807-41e83e989b9f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:18.663958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada87da-d9ff-4bb7-9807-41e83e989b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:18.664228 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada87da-d9ff-4bb7-9807-41e83e989b9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:18.719361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb9ad2-dd5e-448d-bdff-5ce715a9a3af None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:18.731771 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada87da-d9ff-4bb7-9807-41e83e989b9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:18.733328 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada87da-d9ff-4bb7-9807-41e83e989b9f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:18.752198 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc0796-3f75-4623-91ca-e3039485b380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:18.752831 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc0796-3f75-4623-91ca-e3039485b380 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:18.753087 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc0796-3f75-4623-91ca-e3039485b380 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:18.753383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc0796-3f75-4623-91ca-e3039485b380 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:18.763936 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc0796-3f75-4623-91ca-e3039485b380 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:18.769278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-9bdc0796-3f75-4623-91ca-e3039485b380 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:18.769278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:18.769278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:18.769278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:18.769278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:18.769278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:18.769278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:18.769278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:18.769278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:18.769278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:18.769278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:18.769278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:18.769278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:18.769278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:18.769278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:18.769278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:18.770790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:18.770790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:18.770790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:18.770790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:18.770790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:18.770790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:18.770790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:18.770790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:18.770790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:18.770790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:18.770790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:18.770790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:18.770790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:18.770790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:18.770790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:18.770790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:18.771583 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:18.771583 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:18.771583 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:18.771583 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:18.771583 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:18.771583 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:18.771583 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:18.771583 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:18.771583 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:18.771583 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:18.771583 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:18.771583 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:18.771583 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 263/508] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 13 13:59:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:18.772247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc0796-3f75-4623-91ca-e3039485b380 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:18.831796 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 246/509] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:59:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:59:18.833237 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada87da-d9ff-4bb7-9807-41e83e989b9f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:18.859398 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:18.864832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:18.871231 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc0796-3f75-4623-91ca-e3039485b380 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:18.904610 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a673ee-d359-4754-b0d5-e8c1a0619ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:18.905226 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a673ee-d359-4754-b0d5-e8c1a0619ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:18.905500 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a673ee-d359-4754-b0d5-e8c1a0619ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:18.905765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a673ee-d359-4754-b0d5-e8c1a0619ee5 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:18.906477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a673ee-d359-4754-b0d5-e8c1a0619ee5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:18.906773 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a673ee-d359-4754-b0d5-e8c1a0619ee5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:18.908456 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a673ee-d359-4754-b0d5-e8c1a0619ee5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:18.938467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada87da-d9ff-4bb7-9807-41e83e989b9f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:18.945146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 264/510] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Sep 13 13:59:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:18.945970 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a673ee-d359-4754-b0d5-e8c1a0619ee5 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:18.973153 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007bad4-db9d-49ea-af3d-1ae6044a6e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:18.974245 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007bad4-db9d-49ea-af3d-1ae6044a6e23 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:18.974516 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007bad4-db9d-49ea-af3d-1ae6044a6e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:18.974783 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007bad4-db9d-49ea-af3d-1ae6044a6e23 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:18.975420 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007bad4-db9d-49ea-af3d-1ae6044a6e23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:18.975714 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007bad4-db9d-49ea-af3d-1ae6044a6e23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:18.977078 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007bad4-db9d-49ea-af3d-1ae6044a6e23 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:18.987843 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 247/511] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:18.988606 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007bad4-db9d-49ea-af3d-1ae6044a6e23 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:19.049214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a673ee-d359-4754-b0d5-e8c1a0619ee5 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:19.069980 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:19.082500 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d91d97-e95b-4c77-9399-6b7b10966759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:19.083593 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d91d97-e95b-4c77-9399-6b7b10966759 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:19.083864 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d91d97-e95b-4c77-9399-6b7b10966759 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:19.084128 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d91d97-e95b-4c77-9399-6b7b10966759 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:19.084837 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d91d97-e95b-4c77-9399-6b7b10966759 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:19.085154 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d91d97-e95b-4c77-9399-6b7b10966759 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:19.086241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007bad4-db9d-49ea-af3d-1ae6044a6e23 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:19.086623 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d91d97-e95b-4c77-9399-6b7b10966759 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:19.103482 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 265/512] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Sep 13 13:59:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:19.104263 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d91d97-e95b-4c77-9399-6b7b10966759 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:19.119020 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a5a77-e79b-4f28-b2a5-32ecaf0f09bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:19.119637 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a5a77-e79b-4f28-b2a5-32ecaf0f09bf None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:19.119891 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a5a77-e79b-4f28-b2a5-32ecaf0f09bf None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:19.120160 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a5a77-e79b-4f28-b2a5-32ecaf0f09bf None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:19.120808 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a5a77-e79b-4f28-b2a5-32ecaf0f09bf None admin] RBAC: Adding query filter params (name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:19.121118 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a5a77-e79b-4f28-b2a5-32ecaf0f09bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:19.121906 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:19.122520 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a5a77-e79b-4f28-b2a5-32ecaf0f09bf None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:19.130504 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 248/513] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 13 13:59:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:19.131280 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a5a77-e79b-4f28-b2a5-32ecaf0f09bf None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:19.208134 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d91d97-e95b-4c77-9399-6b7b10966759 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:19.234255 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a5a77-e79b-4f28-b2a5-32ecaf0f09bf None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:19.242499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c186d-7e87-4da8-9cd1-5be43f131590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:19.243117 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c186d-7e87-4da8-9cd1-5be43f131590 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:19.243389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c186d-7e87-4da8-9cd1-5be43f131590 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:19.243654 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c186d-7e87-4da8-9cd1-5be43f131590 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:19.253466 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c186d-7e87-4da8-9cd1-5be43f131590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:19.255434 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c186d-7e87-4da8-9cd1-5be43f131590 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:19.267534 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823362ff-7d67-4687-8abb-3f653f1860c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:19.268125 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823362ff-7d67-4687-8abb-3f653f1860c3 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:19.268399 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823362ff-7d67-4687-8abb-3f653f1860c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:19.268665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823362ff-7d67-4687-8abb-3f653f1860c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:19.269498 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-006c186d-7e87-4da8-9cd1-5be43f131590 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:19.269498 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:19.269498 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:19.269498 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:19.269498 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:19.269498 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:19.269498 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:19.269498 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:19.269498 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:19.269498 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:19.269498 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:19.269498 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:19.269498 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:19.269498 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:19.269498 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:19.269498 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:19.270673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:19.270673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:19.270673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:19.270673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:19.270673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:19.270673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:19.270673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:19.270673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:19.270673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:19.270673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:19.270673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:19.270673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:19.270673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:19.270673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:19.270673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:19.270673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:19.270673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:19.271614 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:19.271614 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:19.271614 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:19.275053 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 266/514] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:19.275845 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c186d-7e87-4da8-9cd1-5be43f131590 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:19.285149 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:19.337961 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:19.341733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823362ff-7d67-4687-8abb-3f653f1860c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:19.343211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823362ff-7d67-4687-8abb-3f653f1860c3 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:19.376875 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c186d-7e87-4da8-9cd1-5be43f131590 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:19.411234 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541179f9-dec0-49aa-9509-052366b5fa68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:19.411833 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541179f9-dec0-49aa-9509-052366b5fa68 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:19.412087 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541179f9-dec0-49aa-9509-052366b5fa68 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:19.412377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541179f9-dec0-49aa-9509-052366b5fa68 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:19.413012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541179f9-dec0-49aa-9509-052366b5fa68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:19.414458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541179f9-dec0-49aa-9509-052366b5fa68 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:19.435700 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 267/515] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 13 13:59:19 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 13:59:19.436667 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541179f9-dec0-49aa-9509-052366b5fa68 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:19.445804 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 249/516] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:59:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:59:19.446826 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823362ff-7d67-4687-8abb-3f653f1860c3 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:19.507627 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:19.558438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541179f9-dec0-49aa-9509-052366b5fa68 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:19.570636 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823362ff-7d67-4687-8abb-3f653f1860c3 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:19.580479 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:19.598664 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c9325-57c6-4b3e-887c-4540ccc85e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:19.599692 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c9325-57c6-4b3e-887c-4540ccc85e4f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:19.600413 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c9325-57c6-4b3e-887c-4540ccc85e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:19.601086 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c9325-57c6-4b3e-887c-4540ccc85e4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:19.614537 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cf7db-cf30-4450-9853-d48f3e72d94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:19.615170 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cf7db-cf30-4450-9853-d48f3e72d94f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:19.615439 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cf7db-cf30-4450-9853-d48f3e72d94f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:19.615698 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cf7db-cf30-4450-9853-d48f3e72d94f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:19.627209 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435cf7db-cf30-4450-9853-d48f3e72d94f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:19.628712 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435cf7db-cf30-4450-9853-d48f3e72d94f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:19.645619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-435cf7db-cf30-4450-9853-d48f3e72d94f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:19.645619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:19.645619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:19.645619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:19.645619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:19.645619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:19.645619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:19.645619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:19.645619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:19.645619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:19.645619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:19.645619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:19.645619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:19.645619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:19.645619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:19.645619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:19.646509 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:19.646509 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:19.646509 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:19.646509 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:19.646509 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:19.646509 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:19.646509 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:19.646509 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:19.646509 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:19.646509 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:19.646509 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:19.646509 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:19.646509 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:19.646509 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:19.646509 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:19.646509 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:19.646509 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:19.647328 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:19.647328 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:19.647328 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:19.648824 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 250/517] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:19.649825 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cf7db-cf30-4450-9853-d48f3e72d94f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:19.695718 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c9325-57c6-4b3e-887c-4540ccc85e4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:19.697239 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c9325-57c6-4b3e-887c-4540ccc85e4f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:19.750768 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:19.756011 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cf7db-cf30-4450-9853-d48f3e72d94f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:19.793398 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22711f-e914-453f-beb9-9778cbeb0f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:19.794054 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22711f-e914-453f-beb9-9778cbeb0f2a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:19.794447 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22711f-e914-453f-beb9-9778cbeb0f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:19.794809 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22711f-e914-453f-beb9-9778cbeb0f2a None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:19.795543 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22711f-e914-453f-beb9-9778cbeb0f2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:19.795961 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22711f-e914-453f-beb9-9778cbeb0f2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:19.797478 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22711f-e914-453f-beb9-9778cbeb0f2a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:19.807000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 268/518] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:59:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:59:19.807000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c9325-57c6-4b3e-887c-4540ccc85e4f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:19.810980 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 251/519] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:19.811888 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22711f-e914-453f-beb9-9778cbeb0f2a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:19.830437 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:19.913621 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c9325-57c6-4b3e-887c-4540ccc85e4f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:19.921349 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22711f-e914-453f-beb9-9778cbeb0f2a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:19.948297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acedcd-89e2-4fa0-a16e-ff3eec9344f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:19.948915 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acedcd-89e2-4fa0-a16e-ff3eec9344f6 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:19.949277 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acedcd-89e2-4fa0-a16e-ff3eec9344f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:19.949550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acedcd-89e2-4fa0-a16e-ff3eec9344f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:19.958803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2025cf-91c0-4eed-b5d9-313bccac1bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:19.959516 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2025cf-91c0-4eed-b5d9-313bccac1bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:19.959876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2025cf-91c0-4eed-b5d9-313bccac1bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:19.960211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2025cf-91c0-4eed-b5d9-313bccac1bf7 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:19.960916 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2025cf-91c0-4eed-b5d9-313bccac1bf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:19.961306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2025cf-91c0-4eed-b5d9-313bccac1bf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:19.961868 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acedcd-89e2-4fa0-a16e-ff3eec9344f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:19.962802 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2025cf-91c0-4eed-b5d9-313bccac1bf7 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:19.963461 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acedcd-89e2-4fa0-a16e-ff3eec9344f6 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:19.979504 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 252/520] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:19.979504 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2025cf-91c0-4eed-b5d9-313bccac1bf7 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:19.979738 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-14acedcd-89e2-4fa0-a16e-ff3eec9344f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:19.979738 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:19.979738 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:19.979738 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:19.979738 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:19.979738 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:19.979738 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:19.979738 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:19.979738 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:19.979738 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:19.979738 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:19.979738 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:19.979738 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:19.979738 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:19.979738 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:19.979738 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:19.980720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:19.980720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:19.980720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:19.980720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:19.980720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:19.980720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:19.980720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:19.980720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:19.980720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:19.980720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:19.980720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:19.980720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:19.980720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:19.980720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:19.980720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:19.980720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:19.980720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:19.981779 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:19.981779 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:19.981779 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:19.981779 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 269/521] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:19.981779 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acedcd-89e2-4fa0-a16e-ff3eec9344f6 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:20.002213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:20.051381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:20.082259 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acedcd-89e2-4fa0-a16e-ff3eec9344f6 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:20.089279 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2025cf-91c0-4eed-b5d9-313bccac1bf7 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:20.115338 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1074e-3649-493d-bcbc-7df9aef38a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:20.116052 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1074e-3649-493d-bcbc-7df9aef38a84 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:20.116327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1074e-3649-493d-bcbc-7df9aef38a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:20.116594 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1074e-3649-493d-bcbc-7df9aef38a84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:20.123263 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1074e-3649-493d-bcbc-7df9aef38a84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:20.124087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e12ee-da95-4ed4-9f32-9d30131c380e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:20.124699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1074e-3649-493d-bcbc-7df9aef38a84 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:20.124808 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e12ee-da95-4ed4-9f32-9d30131c380e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:20.125160 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e12ee-da95-4ed4-9f32-9d30131c380e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:20.125490 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e12ee-da95-4ed4-9f32-9d30131c380e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:20.136793 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e12ee-da95-4ed4-9f32-9d30131c380e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:20.137081 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-cda1074e-3649-493d-bcbc-7df9aef38a84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:20.137081 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:20.137081 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:20.137081 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:20.137081 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:20.137081 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:20.137081 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:20.137081 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:20.137081 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:20.137081 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:20.137081 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:20.137081 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:20.137081 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 13:59:20.137081 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 13:59:20.137081 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 13:59:20.138115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 13:59:20.138115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:20.138115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:20.138115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:20.138115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:20.138115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:20.138115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:20.138115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:20.138115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:20.138115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:20.138115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:20.138115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:20.138115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:20.138115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:20.138115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:20.138115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:20.138115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:20.144033 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 13:59:20.144033 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 13:59:20.144033 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 13:59:20.144033 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 13:59:20.144033 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 13:59:20.144033 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 13:59:20.144033 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:20.144033 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:20.144033 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 270/522] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:20.144735 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e12ee-da95-4ed4-9f32-9d30131c380e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:20.144818 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1074e-3649-493d-bcbc-7df9aef38a84 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:20.158640 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-5a9e12ee-da95-4ed4-9f32-9d30131c380e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:20.158640 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:20.158640 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:20.158640 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:20.158640 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:20.158640 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:20.158640 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:20.158640 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:20.158640 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:20.158640 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:20.158640 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:20.158640 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:20.158640 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:20.158640 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:20.158640 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:20.158640 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:20.159776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:20.159776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:20.159776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:20.159776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:20.159776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:20.159776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:20.159776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:20.159776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:20.159776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:20.159776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:20.159776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:20.159776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:20.159776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:20.159776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:20.159776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:20.159776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:20.159776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:20.160742 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:20.160742 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:20.160742 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:20.160742 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 253/523] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:20.161172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e12ee-da95-4ed4-9f32-9d30131c380e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:20.235754 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:20.248889 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1074e-3649-493d-bcbc-7df9aef38a84 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:20.270897 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e12ee-da95-4ed4-9f32-9d30131c380e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:20.278727 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:20.284675 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fc6ac-62b4-4c78-a3d7-c0cc6882e9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:20.285400 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fc6ac-62b4-4c78-a3d7-c0cc6882e9c9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:20.285767 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fc6ac-62b4-4c78-a3d7-c0cc6882e9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:20.286100 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fc6ac-62b4-4c78-a3d7-c0cc6882e9c9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:20.293697 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326fc6ac-62b4-4c78-a3d7-c0cc6882e9c9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:20.295203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326fc6ac-62b4-4c78-a3d7-c0cc6882e9c9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:20.306304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edbc29-ae71-432f-bad2-b2e19643d996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:20.306836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edbc29-ae71-432f-bad2-b2e19643d996 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:20.306943 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-326fc6ac-62b4-4c78-a3d7-c0cc6882e9c9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 13:59:20.306943 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:20.306943 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:20.306943 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:20.306943 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:20.306943 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:20.306943 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:20.306943 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:20.306943 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:20.306943 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:20.306943 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:20.306943 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:20.306943 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 13:59:20.306943 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 13:59:20.306943 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 13:59:20.306943 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 13:59:20.308088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:20.308088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:20.308088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 13:59:20.308088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:20.308088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 13:59:20.308088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:20.308088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:20.308088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:20.308088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:20.308088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:20.308088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:20.308088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:20.308088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:20.308088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:20.308088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:20.308088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:20.308088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:20.308088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:20.309207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:20.309207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:20.309207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 13:59:20.309207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 13:59:20.309207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 13:59:20.309207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 13:59:20.309207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 13:59:20.309207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 13:59:20.309207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 13:59:20.309207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:20.314537 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edbc29-ae71-432f-bad2-b2e19643d996 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:20.314537 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edbc29-ae71-432f-bad2-b2e19643d996 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:20.314537 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04edbc29-ae71-432f-bad2-b2e19643d996 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:20.314537 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04edbc29-ae71-432f-bad2-b2e19643d996 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:20.314537 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04edbc29-ae71-432f-bad2-b2e19643d996 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:20.314884 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 271/524] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 13 13:59:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:20.314884 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fc6ac-62b4-4c78-a3d7-c0cc6882e9c9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:20.326379 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 254/525] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:20.327176 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edbc29-ae71-432f-bad2-b2e19643d996 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:20.419087 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fc6ac-62b4-4c78-a3d7-c0cc6882e9c9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:20.433939 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edbc29-ae71-432f-bad2-b2e19643d996 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:20.451629 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac075e-6340-4a15-a164-a73ca2b7d604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:20.452323 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac075e-6340-4a15-a164-a73ca2b7d604 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:20.452672 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac075e-6340-4a15-a164-a73ca2b7d604 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:20.453010 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac075e-6340-4a15-a164-a73ca2b7d604 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:20.453729 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac075e-6340-4a15-a164-a73ca2b7d604 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:20.454032 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac075e-6340-4a15-a164-a73ca2b7d604 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:20.455487 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac075e-6340-4a15-a164-a73ca2b7d604 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:20.466330 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:20.472801 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88691e0c-42e4-4bf4-8a01-e564c5664ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:20.473474 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88691e0c-42e4-4bf4-8a01-e564c5664ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:20.473749 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88691e0c-42e4-4bf4-8a01-e564c5664ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:20.474004 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88691e0c-42e4-4bf4-8a01-e564c5664ef3 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:20.474193 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 272/526] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 13:59:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:20.475005 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88691e0c-42e4-4bf4-8a01-e564c5664ef3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:20.475307 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88691e0c-42e4-4bf4-8a01-e564c5664ef3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:20.476661 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88691e0c-42e4-4bf4-8a01-e564c5664ef3 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:20.478098 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac075e-6340-4a15-a164-a73ca2b7d604 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:20.493163 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 255/527] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:20.493163 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88691e0c-42e4-4bf4-8a01-e564c5664ef3 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:20.534684 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:20.587606 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac075e-6340-4a15-a164-a73ca2b7d604 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:20.601033 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88691e0c-42e4-4bf4-8a01-e564c5664ef3 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:20.630336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db2680-6110-4d36-842d-889fd0be03f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:20.630949 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db2680-6110-4d36-842d-889fd0be03f2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:20.631235 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db2680-6110-4d36-842d-889fd0be03f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:20.631481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db2680-6110-4d36-842d-889fd0be03f2 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:20.632207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db2680-6110-4d36-842d-889fd0be03f2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:20.632506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db2680-6110-4d36-842d-889fd0be03f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:20.634079 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db2680-6110-4d36-842d-889fd0be03f2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:20.639724 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e29895-2c8c-4136-bcfc-d6542ff54c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:20.640349 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e29895-2c8c-4136-bcfc-d6542ff54c58 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:20.640605 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e29895-2c8c-4136-bcfc-d6542ff54c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:20.640859 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e29895-2c8c-4136-bcfc-d6542ff54c58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:20.647702 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e29895-2c8c-4136-bcfc-d6542ff54c58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:20.649145 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e29895-2c8c-4136-bcfc-d6542ff54c58 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:20.651726 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 273/528] 10.222.0.26 () {56 vars in 1139 bytes} [Tue Sep 13 13:59:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:20.656533 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db2680-6110-4d36-842d-889fd0be03f2 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:20.662024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-70e29895-2c8c-4136-bcfc-d6542ff54c58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:20.662024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:20.662024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:20.662024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:20.662024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:20.662024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:20.662024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:20.662024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:20.662024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:20.662024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:20.662024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:20.662024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:20.662024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 13:59:20.662024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 13:59:20.662024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 13:59:20.662830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 13:59:20.662830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:20.662830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:20.662830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:20.662830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:20.662830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:20.662830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:20.662830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:20.662830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:20.662830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:20.662830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:20.662830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:20.662830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:20.662830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:20.662830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:20.662830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:20.662830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:20.663667 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 13:59:20.663667 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 13:59:20.663667 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 13:59:20.663667 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 13:59:20.663667 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 13:59:20.663667 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 13:59:20.663667 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:20.663667 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:20.663667 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 256/529] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:20.664143 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e29895-2c8c-4136-bcfc-d6542ff54c58 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:20.717716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:20.763901 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db2680-6110-4d36-842d-889fd0be03f2 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:20.773860 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e29895-2c8c-4136-bcfc-d6542ff54c58 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:20.777069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:20.803633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfcb18-57c2-4e04-9d5d-c26d34f97ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:20.804238 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfcb18-57c2-4e04-9d5d-c26d34f97ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:20.804517 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfcb18-57c2-4e04-9d5d-c26d34f97ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:20.804788 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfcb18-57c2-4e04-9d5d-c26d34f97ed2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:20.805547 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfcb18-57c2-4e04-9d5d-c26d34f97ed2 None admin] RBAC: Adding query filter params (role.id=0c389f21d4434ae0a32fc453a8f2050a, scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086, user.id=22959df6ef034036b5f6b3cda7918e24) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:20.805885 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfcb18-57c2-4e04-9d5d-c26d34f97ed2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:20.807341 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfcb18-57c2-4e04-9d5d-c26d34f97ed2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:20.808199 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca65957-cbfa-4c30-aa8d-47a316a5286b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:20.808846 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca65957-cbfa-4c30-aa8d-47a316a5286b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:20.809148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca65957-cbfa-4c30-aa8d-47a316a5286b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:20.809424 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca65957-cbfa-4c30-aa8d-47a316a5286b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:20.813480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 274/530] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:59:20 2022] GET /identity/v3/role_assignments?user.id=22959df6ef034036b5f6b3cda7918e24&scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086&role.id=0c389f21d4434ae0a32fc453a8f2050a => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:20.814429 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfcb18-57c2-4e04-9d5d-c26d34f97ed2 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:20.816069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca65957-cbfa-4c30-aa8d-47a316a5286b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:20.818110 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca65957-cbfa-4c30-aa8d-47a316a5286b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:20.834456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-cca65957-cbfa-4c30-aa8d-47a316a5286b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:20.834456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:20.834456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:20.834456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:20.834456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:20.834456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:20.834456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:20.834456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:20.834456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:20.834456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:20.834456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:20.834456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:20.834456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 13:59:20.834456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 13:59:20.834456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 13:59:20.835402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 13:59:20.835402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:20.835402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:20.835402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:20.835402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:20.835402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:20.835402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:20.835402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:20.835402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:20.835402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:20.835402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:20.835402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:20.835402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:20.835402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:20.835402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:20.835402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:20.835402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:20.836234 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 13:59:20.836234 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 13:59:20.836234 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 13:59:20.836234 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 13:59:20.836234 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 13:59:20.836234 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 13:59:20.836234 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:20.836234 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:20.840599 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 257/531] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:20.841540 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca65957-cbfa-4c30-aa8d-47a316a5286b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:20.956042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca65957-cbfa-4c30-aa8d-47a316a5286b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:20.968829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:20.972677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfcb18-57c2-4e04-9d5d-c26d34f97ed2 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:20.998644 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9cec4-975c-4f0b-8fdd-706fa59d6d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:20.999308 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9cec4-975c-4f0b-8fdd-706fa59d6d1a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:20.999519 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9cec4-975c-4f0b-8fdd-706fa59d6d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:20.999789 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9cec4-975c-4f0b-8fdd-706fa59d6d1a None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:21.000483 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9cec4-975c-4f0b-8fdd-706fa59d6d1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:21.000806 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9cec4-975c-4f0b-8fdd-706fa59d6d1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:21.003432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9cec4-975c-4f0b-8fdd-706fa59d6d1a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:21.023544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816008f9-12f4-4005-b173-0424d37760fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:21.024523 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816008f9-12f4-4005-b173-0424d37760fb None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:21.025006 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816008f9-12f4-4005-b173-0424d37760fb None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:21.025536 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816008f9-12f4-4005-b173-0424d37760fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:21.029976 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 258/532] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 13:59:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:21.030867 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9cec4-975c-4f0b-8fdd-706fa59d6d1a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:21.083625 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:21.118064 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816008f9-12f4-4005-b173-0424d37760fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:21.120410 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816008f9-12f4-4005-b173-0424d37760fb None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:21.138674 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9cec4-975c-4f0b-8fdd-706fa59d6d1a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:21.174736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa172cf5-c2a7-48f3-8f57-08dea813caef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:21.175338 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa172cf5-c2a7-48f3-8f57-08dea813caef None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:21.175617 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa172cf5-c2a7-48f3-8f57-08dea813caef None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:21.175885 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa172cf5-c2a7-48f3-8f57-08dea813caef None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:21.177403 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa172cf5-c2a7-48f3-8f57-08dea813caef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:21.177526 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa172cf5-c2a7-48f3-8f57-08dea813caef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:21.178841 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa172cf5-c2a7-48f3-8f57-08dea813caef None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:21.191268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 259/533] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 13:59:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:21.192283 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa172cf5-c2a7-48f3-8f57-08dea813caef None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:21.224187 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:21.267212 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 275/534] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:59:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:59:21.267212 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816008f9-12f4-4005-b173-0424d37760fb None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:21.312427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa172cf5-c2a7-48f3-8f57-08dea813caef None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:21.351087 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:21.355116 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db7701-6972-4a70-88f6-9290e369927c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:21.356213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db7701-6972-4a70-88f6-9290e369927c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:21.357347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db7701-6972-4a70-88f6-9290e369927c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:21.358144 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db7701-6972-4a70-88f6-9290e369927c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:21.359156 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db7701-6972-4a70-88f6-9290e369927c None admin] RBAC: Adding query filter params (role.id=0c389f21d4434ae0a32fc453a8f2050a, scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086, user.id=1b3533d0a24e4e7bbf5c7137d3511b13) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:21.359676 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db7701-6972-4a70-88f6-9290e369927c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:21.362150 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db7701-6972-4a70-88f6-9290e369927c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:21.370189 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 260/535] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:59:21 2022] GET /identity/v3/role_assignments?user.id=1b3533d0a24e4e7bbf5c7137d3511b13&scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086&role.id=0c389f21d4434ae0a32fc453a8f2050a => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:21.371261 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db7701-6972-4a70-88f6-9290e369927c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:21.387449 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816008f9-12f4-4005-b173-0424d37760fb None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:21.488568 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:21.498583 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db7701-6972-4a70-88f6-9290e369927c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:21.502299 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed2b82-d4aa-43c4-a191-d4e436767c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:21.502816 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed2b82-d4aa-43c4-a191-d4e436767c7b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:21.502816 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed2b82-d4aa-43c4-a191-d4e436767c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:21.503093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed2b82-d4aa-43c4-a191-d4e436767c7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:21.503723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed2b82-d4aa-43c4-a191-d4e436767c7b None admin] RBAC: Adding query filter params (role.id=0c389f21d4434ae0a32fc453a8f2050a, scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086, user.id=052d3a21bd3c48c89dcc38ec1444d39a) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:21.504068 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed2b82-d4aa-43c4-a191-d4e436767c7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:21.505591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed2b82-d4aa-43c4-a191-d4e436767c7b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:21.516327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 276/536] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:59:21 2022] GET /identity/v3/role_assignments?user.id=052d3a21bd3c48c89dcc38ec1444d39a&scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086&role.id=0c389f21d4434ae0a32fc453a8f2050a => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:21.555119 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecd03f-cadb-4563-aa32-5a06730508e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:21.555886 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecd03f-cadb-4563-aa32-5a06730508e0 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:21.556166 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecd03f-cadb-4563-aa32-5a06730508e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:21.556435 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecd03f-cadb-4563-aa32-5a06730508e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:21.577642 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecd03f-cadb-4563-aa32-5a06730508e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:21.579145 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecd03f-cadb-4563-aa32-5a06730508e0 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:21.602444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-69ecd03f-cadb-4563-aa32-5a06730508e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:21.602444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:21.602444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:21.602444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:21.602444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:21.602444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:21.602444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:21.602444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:21.602444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:21.602444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:21.602444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:21.602444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:21.602444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:21.602444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:21.602444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:21.602444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:21.603413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:21.603413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:21.603413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:21.603413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:21.603413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:21.603413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:21.603413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:21.603413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:21.603413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:21.603413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:21.603413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:21.603413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:21.603413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:21.603413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:21.603413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:21.603413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:21.603413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:21.604334 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:21.604334 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:21.604334 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:21.604334 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 261/537] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:21.610900 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed2b82-d4aa-43c4-a191-d4e436767c7b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:21.665077 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed452cdd-ee02-49e6-b474-013635c538d3 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:21.665402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed452cdd-ee02-49e6-b474-013635c538d3 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:21.665593 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed452cdd-ee02-49e6-b474-013635c538d3 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:21.667237 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 262/538] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 13:59:21.672857 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdd901-d68e-48f1-a1ee-a59c659d53e5 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:21.673159 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdd901-d68e-48f1-a1ee-a59c659d53e5 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:21.673420 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdd901-d68e-48f1-a1ee-a59c659d53e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:21.710169 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-9dbdd901-d68e-48f1-a1ee-a59c659d53e5 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:21.711372 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-9dbdd901-d68e-48f1-a1ee-a59c659d53e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:21.741747 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed2b82-d4aa-43c4-a191-d4e436767c7b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:21.817708 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 263/539] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 13:59:21.822277 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfba19-c91a-4266-a1d0-6c9ab17daf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:21.822582 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfba19-c91a-4266-a1d0-6c9ab17daf3a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:21.822862 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfba19-c91a-4266-a1d0-6c9ab17daf3a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:21.823132 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfba19-c91a-4266-a1d0-6c9ab17daf3a None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:21.823784 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bfba19-c91a-4266-a1d0-6c9ab17daf3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:21.824086 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bfba19-c91a-4266-a1d0-6c9ab17daf3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:21.826849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bfba19-c91a-4266-a1d0-6c9ab17daf3a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:21.834638 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:21.842142 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 277/540] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:21.848030 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdd901-d68e-48f1-a1ee-a59c659d53e5 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:21.947309 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:21.978803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdd901-d68e-48f1-a1ee-a59c659d53e5 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:22.031072 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafb4f4-987b-4238-aab2-d8a22aea8c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:22.031757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafb4f4-987b-4238-aab2-d8a22aea8c97 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:22.032039 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafb4f4-987b-4238-aab2-d8a22aea8c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:22.032307 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafb4f4-987b-4238-aab2-d8a22aea8c97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:22.043780 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beafb4f4-987b-4238-aab2-d8a22aea8c97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:22.045257 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beafb4f4-987b-4238-aab2-d8a22aea8c97 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:22.060516 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-beafb4f4-987b-4238-aab2-d8a22aea8c97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:22.060516 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:22.060516 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:22.060516 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:22.060516 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:22.060516 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:22.060516 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:22.060516 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:22.060516 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:22.060516 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:22.060516 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:22.060516 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:22.060516 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 13:59:22.060516 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 13:59:22.060516 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 13:59:22.061375 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 13:59:22.061375 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:22.061375 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:22.061375 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:22.061375 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:22.061375 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:22.061375 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:22.061375 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:22.061375 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:22.061375 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:22.061375 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:22.061375 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:22.061375 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:22.061375 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:22.061375 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:22.061375 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:22.061375 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:22.062208 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 13:59:22.062208 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 13:59:22.062208 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 13:59:22.062208 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 13:59:22.062208 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 13:59:22.062208 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 13:59:22.062208 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:22.062208 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:22.064037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 264/541] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:22.074179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfba19-c91a-4266-a1d0-6c9ab17daf3a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:22.107808 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafb4f4-987b-4238-aab2-d8a22aea8c97 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:22.228184 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfba19-c91a-4266-a1d0-6c9ab17daf3a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:22.297886 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7900dc2-80c1-476b-8199-20a170440989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:22.298663 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7900dc2-80c1-476b-8199-20a170440989 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:22.298946 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7900dc2-80c1-476b-8199-20a170440989 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:22.299215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7900dc2-80c1-476b-8199-20a170440989 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:22.299906 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7900dc2-80c1-476b-8199-20a170440989 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:22.300207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7900dc2-80c1-476b-8199-20a170440989 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:22.300917 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafb4f4-987b-4238-aab2-d8a22aea8c97 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:22.301728 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7900dc2-80c1-476b-8199-20a170440989 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:22.325815 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 278/542] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 13:59:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:22.331708 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7900dc2-80c1-476b-8199-20a170440989 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:22.337571 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5f7bb-adab-4ff7-ac0b-77e6dfb51cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:22.339141 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5f7bb-adab-4ff7-ac0b-77e6dfb51cc3 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:22.339416 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5f7bb-adab-4ff7-ac0b-77e6dfb51cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:22.339679 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5f7bb-adab-4ff7-ac0b-77e6dfb51cc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:22.342511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:22.353361 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5f7bb-adab-4ff7-ac0b-77e6dfb51cc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:22.360077 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-abb5f7bb-adab-4ff7-ac0b-77e6dfb51cc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:22.360077 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:22.360077 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:22.360077 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:22.360077 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:22.360077 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:22.360077 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:22.360077 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:22.360077 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:22.360077 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:22.360077 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:22.360077 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:22.360077 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:22.360077 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:22.360077 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:22.360077 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:22.361182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:22.361182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:22.361182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:22.361182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:22.361182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:22.361182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:22.361182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:22.361182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:22.361182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:22.361182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:22.361182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:22.361182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:22.361182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:22.361182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:22.361182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:22.361182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:22.362177 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:22.362177 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:22.362177 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:22.362177 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:22.362177 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:22.362177 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:22.362177 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:22.362177 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:22.362177 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:22.362177 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:22.362177 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:22.362177 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:22.369913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 265/543] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 13 13:59:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:59:22.369913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5f7bb-adab-4ff7-ac0b-77e6dfb51cc3 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:22.429488 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:22.486976 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7900dc2-80c1-476b-8199-20a170440989 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:22.523754 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee81aee-4eb5-4829-9742-9b963de01164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:22.524378 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee81aee-4eb5-4829-9742-9b963de01164 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:22.524667 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee81aee-4eb5-4829-9742-9b963de01164 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:22.524947 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee81aee-4eb5-4829-9742-9b963de01164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:22.525751 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee81aee-4eb5-4829-9742-9b963de01164 None admin] RBAC: Adding query filter params (role.id=0c389f21d4434ae0a32fc453a8f2050a, scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086, user.id=cb992cf1a7a445119262b567ce345181) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:22.526059 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee81aee-4eb5-4829-9742-9b963de01164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:22.527498 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee81aee-4eb5-4829-9742-9b963de01164 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:22.534263 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 279/544] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:59:22 2022] GET /identity/v3/role_assignments?user.id=cb992cf1a7a445119262b567ce345181&scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086&role.id=0c389f21d4434ae0a32fc453a8f2050a => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:22.542775 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5f7bb-adab-4ff7-ac0b-77e6dfb51cc3 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:22.587585 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd784e2-ac09-4b59-b010-64fc14eb3034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:22.588196 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd784e2-ac09-4b59-b010-64fc14eb3034 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:22.588468 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd784e2-ac09-4b59-b010-64fc14eb3034 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:22.588736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd784e2-ac09-4b59-b010-64fc14eb3034 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:22.589437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd784e2-ac09-4b59-b010-64fc14eb3034 None admin] RBAC: Adding query filter params (name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:22.589733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd784e2-ac09-4b59-b010-64fc14eb3034 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:22.591102 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd784e2-ac09-4b59-b010-64fc14eb3034 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:22.601304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 266/545] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 13 13:59:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:22.611645 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee81aee-4eb5-4829-9742-9b963de01164 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:22.775993 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee81aee-4eb5-4829-9742-9b963de01164 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:22.803103 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:22.815513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82818235-1733-480d-939d-fc56ca7cf749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:22.816161 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82818235-1733-480d-939d-fc56ca7cf749 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:22.816442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82818235-1733-480d-939d-fc56ca7cf749 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:22.816713 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82818235-1733-480d-939d-fc56ca7cf749 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:22.828738 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82818235-1733-480d-939d-fc56ca7cf749 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:22.830268 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82818235-1733-480d-939d-fc56ca7cf749 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:22.845372 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-82818235-1733-480d-939d-fc56ca7cf749 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:22.845372 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:22.845372 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:22.845372 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:22.845372 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:22.845372 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:22.845372 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:22.845372 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:22.845372 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:22.845372 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:22.845372 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:22.845372 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:22.845372 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:22.845372 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:22.845372 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:22.845372 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:22.846440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:22.846440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:22.846440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:22.846440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:22.846440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:22.846440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:22.846440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:22.846440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:22.846440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:22.846440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:22.846440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:22.846440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:22.846440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:22.846440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:22.846440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:22.846440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:22.846440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:22.847443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:22.847443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:22.847443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:22.847443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 280/546] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:22.852957 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd784e2-ac09-4b59-b010-64fc14eb3034 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:22.916861 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:22.977732 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd784e2-ac09-4b59-b010-64fc14eb3034 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:23.021428 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506611e5-f5bf-46ae-af74-eca6fdc41e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:23.022035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506611e5-f5bf-46ae-af74-eca6fdc41e27 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:23.022313 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506611e5-f5bf-46ae-af74-eca6fdc41e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:23.022583 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506611e5-f5bf-46ae-af74-eca6fdc41e27 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:23.023228 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506611e5-f5bf-46ae-af74-eca6fdc41e27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:23.023528 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506611e5-f5bf-46ae-af74-eca6fdc41e27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:23.024951 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506611e5-f5bf-46ae-af74-eca6fdc41e27 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:23.039756 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 267/547] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:23.046232 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82818235-1733-480d-939d-fc56ca7cf749 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:23.173867 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82818235-1733-480d-939d-fc56ca7cf749 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:23.227649 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810705b-0937-4237-8a28-f549cdcce0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:23.228287 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810705b-0937-4237-8a28-f549cdcce0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:23.228569 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810705b-0937-4237-8a28-f549cdcce0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:23.228836 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810705b-0937-4237-8a28-f549cdcce0b9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:23.238898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810705b-0937-4237-8a28-f549cdcce0b9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:23.240369 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810705b-0937-4237-8a28-f549cdcce0b9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:23.256733 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-4810705b-0937-4237-8a28-f549cdcce0b9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 13:59:23.256733 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:23.256733 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:23.256733 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:23.256733 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:23.256733 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:23.256733 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:23.256733 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:23.256733 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:23.256733 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:23.256733 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:23.256733 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:23.256733 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 13:59:23.256733 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 13:59:23.256733 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 13:59:23.256733 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 13:59:23.258685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:23.258685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:23.258685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 13:59:23.258685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:23.258685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 13:59:23.258685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:23.258685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:23.258685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:23.258685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:23.258685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:23.258685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:23.258685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:23.258685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:23.258685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:23.258685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:23.258685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:23.258685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:23.258685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:23.260304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:23.260304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:23.260304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 13:59:23.260304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 13:59:23.260304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 13:59:23.260304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 13:59:23.260304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 13:59:23.260304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 13:59:23.260304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 13:59:23.260304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:23.261780 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 281/548] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 13:59:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:23.263450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506611e5-f5bf-46ae-af74-eca6fdc41e27 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:23.400772 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506611e5-f5bf-46ae-af74-eca6fdc41e27 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:23.420912 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:23.440589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3056f6e-8e2f-4754-9734-84667fa528ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:23.441224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3056f6e-8e2f-4754-9734-84667fa528ac None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:23.441501 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3056f6e-8e2f-4754-9734-84667fa528ac None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:23.441796 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3056f6e-8e2f-4754-9734-84667fa528ac None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:23.442568 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3056f6e-8e2f-4754-9734-84667fa528ac None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:23.442869 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3056f6e-8e2f-4754-9734-84667fa528ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:23.444308 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3056f6e-8e2f-4754-9734-84667fa528ac None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:23.463386 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 268/549] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Sep 13 13:59:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:23.468873 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810705b-0937-4237-8a28-f549cdcce0b9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:23.517536 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:23.574826 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810705b-0937-4237-8a28-f549cdcce0b9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:23.610034 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3e78c-a898-410f-bbd3-9b9fda114cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:23.610643 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3e78c-a898-410f-bbd3-9b9fda114cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:23.610919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3e78c-a898-410f-bbd3-9b9fda114cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:23.611193 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3e78c-a898-410f-bbd3-9b9fda114cb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:23.638205 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634a1b5-0250-428f-a588-27d684de3a0e None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:23.638700 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634a1b5-0250-428f-a588-27d684de3a0e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:23.638801 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634a1b5-0250-428f-a588-27d684de3a0e None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:23.640244 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 269/550] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 13:59:23.645275 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dc5e1-23af-4386-8984-8da22f7cd4e0 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:23.645552 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dc5e1-23af-4386-8984-8da22f7cd4e0 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:23.645820 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dc5e1-23af-4386-8984-8da22f7cd4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:23.674185 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-aa0dc5e1-23af-4386-8984-8da22f7cd4e0 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:23.680259 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-aa0dc5e1-23af-4386-8984-8da22f7cd4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:23.762142 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3e78c-a898-410f-bbd3-9b9fda114cb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:23.762620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 270/551] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 13:59:23.763630 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3e78c-a898-410f-bbd3-9b9fda114cb5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:23.826671 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:23.912910 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 282/552] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:59:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:59:23.918063 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0dc5e1-23af-4386-8984-8da22f7cd4e0 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:24.022900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0dc5e1-23af-4386-8984-8da22f7cd4e0 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:24.031242 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:24.062355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee9323-c2b6-4f09-a404-074f31340917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:24.063058 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee9323-c2b6-4f09-a404-074f31340917 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:24.063338 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee9323-c2b6-4f09-a404-074f31340917 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:24.063610 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee9323-c2b6-4f09-a404-074f31340917 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:24.079735 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee9323-c2b6-4f09-a404-074f31340917 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:24.081437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee9323-c2b6-4f09-a404-074f31340917 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:24.106224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-e9ee9323-c2b6-4f09-a404-074f31340917 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:24.106224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:24.106224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:24.106224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:24.106224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:24.106224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:24.106224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:24.106224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:24.106224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:24.106224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:24.106224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:24.106224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:24.106224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:24.106224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:24.106224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:24.106224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:24.107282 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:24.107282 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:24.107282 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:24.107282 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:24.107282 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:24.107282 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:24.107282 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:24.107282 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:24.107282 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:24.107282 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:24.107282 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:24.107282 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:24.107282 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:24.107282 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:24.107282 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:24.107282 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:24.107282 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:24.108134 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:24.108134 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:24.108134 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:24.108134 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 271/553] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:59:24.113138 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3e78c-a898-410f-bbd3-9b9fda114cb5 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:24.199873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09031e39-4bf3-4bb7-8dd1-08e02b060b3b None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:24.200186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09031e39-4bf3-4bb7-8dd1-08e02b060b3b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:24.200412 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09031e39-4bf3-4bb7-8dd1-08e02b060b3b None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:24.201929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 272/554] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 13:59:24.208015 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9751f95-cd15-496d-a6a1-2be5ea5b1bd9 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:24.208292 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9751f95-cd15-496d-a6a1-2be5ea5b1bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:24.208562 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9751f95-cd15-496d-a6a1-2be5ea5b1bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:24.239220 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-c9751f95-cd15-496d-a6a1-2be5ea5b1bd9 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:24.240410 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c9751f95-cd15-496d-a6a1-2be5ea5b1bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:24.241147 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3e78c-a898-410f-bbd3-9b9fda114cb5 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:24.284746 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e556e7-596a-4ec2-8a53-8fac034a734e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:24.285309 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e556e7-596a-4ec2-8a53-8fac034a734e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:24.286100 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e556e7-596a-4ec2-8a53-8fac034a734e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:24.286372 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e556e7-596a-4ec2-8a53-8fac034a734e None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:24.287022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e556e7-596a-4ec2-8a53-8fac034a734e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:24.287323 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e556e7-596a-4ec2-8a53-8fac034a734e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:24.289069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e556e7-596a-4ec2-8a53-8fac034a734e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:24.291323 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:24.304715 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 283/555] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:24.305796 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e556e7-596a-4ec2-8a53-8fac034a734e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:24.321133 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 273/556] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:24.321133 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccbaf3-17b6-462f-b350-a7fd87a9956e None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:24.321133 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccbaf3-17b6-462f-b350-a7fd87a9956e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:24.321133 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccbaf3-17b6-462f-b350-a7fd87a9956e None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:24.321133 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 274/557] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:24.321507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccbaf3-17b6-462f-b350-a7fd87a9956e None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:24.414858 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e556e7-596a-4ec2-8a53-8fac034a734e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:24.435360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:24.449664 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccbaf3-17b6-462f-b350-a7fd87a9956e None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:24.456788 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fe6ec-b116-4c1d-a73c-0fbb5a607d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:24.457515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fe6ec-b116-4c1d-a73c-0fbb5a607d2a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:24.457799 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fe6ec-b116-4c1d-a73c-0fbb5a607d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:24.458072 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fe6ec-b116-4c1d-a73c-0fbb5a607d2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:24.469339 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959fe6ec-b116-4c1d-a73c-0fbb5a607d2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:24.477349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-959fe6ec-b116-4c1d-a73c-0fbb5a607d2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:24.477349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:24.477349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:24.477349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:24.477349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:24.477349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:24.477349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:24.477349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:24.477349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:24.477349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:24.477349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:24.477349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:24.477349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:24.477349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:24.477349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:24.477349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:24.478249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:24.478249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:24.478249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:24.478249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:24.478249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:24.478249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:24.478249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:24.478249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:24.478249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:24.478249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:24.478249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:24.478249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:24.478249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:24.478249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:24.478249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:24.478249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:24.479066 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:24.479066 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:24.479066 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:24.479066 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:24.479066 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:24.479066 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:24.479066 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:24.479066 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:24.479066 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:24.479066 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:24.479066 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:24.479066 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:24.479066 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 284/558] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 13 13:59:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:24.480008 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4511e8-a8f3-4df8-970a-8ac674b7c664 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:24.480298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4511e8-a8f3-4df8-970a-8ac674b7c664 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:24.480645 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4511e8-a8f3-4df8-970a-8ac674b7c664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:24.490986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f440a3-62ec-44e4-bbe4-a519696ec986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:24.491893 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f440a3-62ec-44e4-bbe4-a519696ec986 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:24.492319 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f440a3-62ec-44e4-bbe4-a519696ec986 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:24.492744 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f440a3-62ec-44e4-bbe4-a519696ec986 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:24.500428 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f440a3-62ec-44e4-bbe4-a519696ec986 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:24.500660 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ef4511e8-a8f3-4df8-970a-8ac674b7c664 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:24.501696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ef4511e8-a8f3-4df8-970a-8ac674b7c664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:24.502468 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f440a3-62ec-44e4-bbe4-a519696ec986 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:24.514708 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-41f440a3-62ec-44e4-bbe4-a519696ec986 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:24.514708 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:24.514708 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:24.514708 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:24.514708 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:24.514708 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:24.514708 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:24.514708 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:24.514708 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:24.514708 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:24.514708 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:24.514708 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:24.514708 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 13:59:24.514708 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 13:59:24.514708 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 13:59:24.515757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 13:59:24.515757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:24.515757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:24.515757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:24.515757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:24.515757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:24.515757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:24.515757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:24.515757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:24.515757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:24.515757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:24.515757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:24.515757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:24.515757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:24.515757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:24.515757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:24.515757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:24.516803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 13:59:24.516803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 13:59:24.516803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 13:59:24.516803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 13:59:24.516803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 13:59:24.516803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 13:59:24.516803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:24.516803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:24.518688 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 275/559] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:24.519667 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f440a3-62ec-44e4-bbe4-a519696ec986 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:24.558585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:24.580130 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 285/560] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:24.581040 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4511e8-a8f3-4df8-970a-8ac674b7c664 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:24.638595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f440a3-62ec-44e4-bbe4-a519696ec986 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:24.677032 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876ddbd-3848-4a91-ac3c-e1a2329eefac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:24.678103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876ddbd-3848-4a91-ac3c-e1a2329eefac None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:24.678715 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876ddbd-3848-4a91-ac3c-e1a2329eefac None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:24.679205 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876ddbd-3848-4a91-ac3c-e1a2329eefac None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:24.680073 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876ddbd-3848-4a91-ac3c-e1a2329eefac None admin] RBAC: Adding query filter params (name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:24.680627 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876ddbd-3848-4a91-ac3c-e1a2329eefac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:24.682505 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876ddbd-3848-4a91-ac3c-e1a2329eefac None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:24.690884 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4511e8-a8f3-4df8-970a-8ac674b7c664 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:24.692541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 276/561] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 13 13:59:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:24.693803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876ddbd-3848-4a91-ac3c-e1a2329eefac None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:24.707043 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:24.731087 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c58a7-c36a-4b43-b84d-8b13217dd8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:24.731977 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c58a7-c36a-4b43-b84d-8b13217dd8f8 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:24.732258 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c58a7-c36a-4b43-b84d-8b13217dd8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:24.732526 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c58a7-c36a-4b43-b84d-8b13217dd8f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:24.733262 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c58a7-c36a-4b43-b84d-8b13217dd8f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:24.733569 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c58a7-c36a-4b43-b84d-8b13217dd8f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:24.735780 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c58a7-c36a-4b43-b84d-8b13217dd8f8 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:24.748004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 286/562] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 13:59:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:24.748759 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c58a7-c36a-4b43-b84d-8b13217dd8f8 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:24.807447 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876ddbd-3848-4a91-ac3c-e1a2329eefac None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:24.814558 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:24.849286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe40dd-b701-4467-b281-5039b84feb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:24.850279 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe40dd-b701-4467-b281-5039b84feb3c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:24.850760 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe40dd-b701-4467-b281-5039b84feb3c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:24.851215 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe40dd-b701-4467-b281-5039b84feb3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:24.862363 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe40dd-b701-4467-b281-5039b84feb3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:24.868454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-6bfe40dd-b701-4467-b281-5039b84feb3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:24.868454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:24.868454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:24.868454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:24.868454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:24.868454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:24.868454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:24.868454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:24.868454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:24.868454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:24.868454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:24.868454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:24.868454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:24.868454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:24.868454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:24.868454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:24.869595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:24.869595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:24.869595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:24.869595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:24.869595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:24.869595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:24.869595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:24.869595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:24.869595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:24.869595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:24.869595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:24.869595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:24.869595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:24.869595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:24.869595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:24.869595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:24.870651 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:24.870651 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:24.870651 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:24.870651 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:24.870651 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:24.870651 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:24.870651 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:24.870651 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:24.870651 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:24.870651 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:24.870651 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:24.870651 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:24.872833 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 277/563] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 13 13:59:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:24.873852 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe40dd-b701-4467-b281-5039b84feb3c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:24.892028 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c58a7-c36a-4b43-b84d-8b13217dd8f8 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:24.928321 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bb2cc-d647-4f59-8af7-d3df2b3d151f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:24.928950 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bb2cc-d647-4f59-8af7-d3df2b3d151f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:24.929263 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bb2cc-d647-4f59-8af7-d3df2b3d151f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:24.929534 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bb2cc-d647-4f59-8af7-d3df2b3d151f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:24.940128 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bb2cc-d647-4f59-8af7-d3df2b3d151f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:24.941622 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bb2cc-d647-4f59-8af7-d3df2b3d151f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:24.948476 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:24.956387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-9e8bb2cc-d647-4f59-8af7-d3df2b3d151f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:24.956387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:24.956387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:24.956387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:24.956387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:24.956387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:24.956387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:24.956387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:24.956387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:24.956387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:24.956387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:24.956387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:24.956387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:24.956387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:24.956387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:24.956387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:24.957926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:24.957926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:24.957926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:24.957926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:24.957926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:24.957926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:24.957926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:24.957926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:24.957926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:24.957926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:24.957926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:24.957926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:24.957926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:24.957926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:24.957926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:24.957926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:24.957926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:24.958790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:24.958790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:24.958790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:24.961469 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 287/564] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:24.962495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bb2cc-d647-4f59-8af7-d3df2b3d151f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:24.985504 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe40dd-b701-4467-b281-5039b84feb3c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:25.025050 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce590a8-c515-4e76-a663-2bfdd57e783c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:25.025683 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce590a8-c515-4e76-a663-2bfdd57e783c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:25.025965 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce590a8-c515-4e76-a663-2bfdd57e783c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:25.026238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce590a8-c515-4e76-a663-2bfdd57e783c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:25.026974 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce590a8-c515-4e76-a663-2bfdd57e783c None admin] RBAC: Adding query filter params (role.id=0c389f21d4434ae0a32fc453a8f2050a, scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086, user.id=97c27e930f604bd38634ca08e56cf8cd) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:25.027283 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce590a8-c515-4e76-a663-2bfdd57e783c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:25.028713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce590a8-c515-4e76-a663-2bfdd57e783c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:25.034697 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 278/565] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:59:24 2022] GET /identity/v3/role_assignments?user.id=97c27e930f604bd38634ca08e56cf8cd&scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086&role.id=0c389f21d4434ae0a32fc453a8f2050a => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:25.035494 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce590a8-c515-4e76-a663-2bfdd57e783c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:25.079772 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:25.088441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bb2cc-d647-4f59-8af7-d3df2b3d151f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:25.142917 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eada44-ae1b-4c06-a671-4fc6e8b05cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:25.144258 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eada44-ae1b-4c06-a671-4fc6e8b05cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:25.144734 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eada44-ae1b-4c06-a671-4fc6e8b05cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:25.145295 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eada44-ae1b-4c06-a671-4fc6e8b05cd2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:25.162322 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eada44-ae1b-4c06-a671-4fc6e8b05cd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:25.169591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-60eada44-ae1b-4c06-a671-4fc6e8b05cd2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:25.169591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:25.169591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:25.169591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:25.169591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:25.169591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:25.169591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:25.169591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:25.169591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:25.169591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:25.169591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:25.169591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:25.169591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:25.169591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:25.169591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:25.169591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:25.170585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:25.170585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:25.170585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:25.170585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:25.170585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:25.170585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:25.170585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:25.170585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:25.170585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:25.170585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:25.170585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:25.170585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:25.170585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:25.170585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:25.170585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:25.170585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:25.171423 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:25.171423 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:25.171423 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:25.171423 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:25.171423 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:25.171423 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:25.171423 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:25.171423 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:25.171423 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:25.171423 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:25.171423 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:25.171423 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:25.175981 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 288/566] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 13 13:59:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:25.177133 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eada44-ae1b-4c06-a671-4fc6e8b05cd2 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:25.178754 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce590a8-c515-4e76-a663-2bfdd57e783c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:25.223668 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d342679-b53b-42d2-b80d-b2b4004d150e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:25.225137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d342679-b53b-42d2-b80d-b2b4004d150e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:25.225418 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d342679-b53b-42d2-b80d-b2b4004d150e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:25.225683 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d342679-b53b-42d2-b80d-b2b4004d150e None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:25.226731 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d342679-b53b-42d2-b80d-b2b4004d150e None admin] RBAC: Adding query filter params (name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:25.227035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d342679-b53b-42d2-b80d-b2b4004d150e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:25.228997 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d342679-b53b-42d2-b80d-b2b4004d150e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:25.230731 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:25.245296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 279/567] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 13 13:59:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:25.245296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d342679-b53b-42d2-b80d-b2b4004d150e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:25.292592 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eada44-ae1b-4c06-a671-4fc6e8b05cd2 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:25.329335 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee01d55-d5b6-4ac8-82ed-a9fe4811c392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:25.329979 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee01d55-d5b6-4ac8-82ed-a9fe4811c392 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:25.330208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee01d55-d5b6-4ac8-82ed-a9fe4811c392 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:25.330480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee01d55-d5b6-4ac8-82ed-a9fe4811c392 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:25.331119 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee01d55-d5b6-4ac8-82ed-a9fe4811c392 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:25.331420 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee01d55-d5b6-4ac8-82ed-a9fe4811c392 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:25.333144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee01d55-d5b6-4ac8-82ed-a9fe4811c392 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:25.351148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 289/568] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:25.351148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb041811-47ab-4859-9115-0d9649c3ad0a None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:25.351375 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d342679-b53b-42d2-b80d-b2b4004d150e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:25.351452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb041811-47ab-4859-9115-0d9649c3ad0a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:25.351452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb041811-47ab-4859-9115-0d9649c3ad0a None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:25.351452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 290/569] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:25.351452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb041811-47ab-4859-9115-0d9649c3ad0a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:25.369951 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:25.392881 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301d898-22d4-45a3-80e3-7d3bf6afcc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:25.393522 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301d898-22d4-45a3-80e3-7d3bf6afcc73 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:25.393803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301d898-22d4-45a3-80e3-7d3bf6afcc73 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:25.394069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301d898-22d4-45a3-80e3-7d3bf6afcc73 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:25.394736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301d898-22d4-45a3-80e3-7d3bf6afcc73 None admin] RBAC: Adding query filter params (name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:25.395096 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301d898-22d4-45a3-80e3-7d3bf6afcc73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:25.396461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301d898-22d4-45a3-80e3-7d3bf6afcc73 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:25.404693 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 280/570] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 13 13:59:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:25.405527 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301d898-22d4-45a3-80e3-7d3bf6afcc73 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:25.469289 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:25.474933 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb041811-47ab-4859-9115-0d9649c3ad0a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:25.511686 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c4cdc-56f5-44b9-995f-1693be111578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:25.512634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c4cdc-56f5-44b9-995f-1693be111578 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:25.513119 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c4cdc-56f5-44b9-995f-1693be111578 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:25.513228 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301d898-22d4-45a3-80e3-7d3bf6afcc73 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:25.513669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c4cdc-56f5-44b9-995f-1693be111578 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:25.524863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c4cdc-56f5-44b9-995f-1693be111578 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:25.526742 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c4cdc-56f5-44b9-995f-1693be111578 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:25.541765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-a41c4cdc-56f5-44b9-995f-1693be111578 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:25.541765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:25.541765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:25.541765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:25.541765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:25.541765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:25.541765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:25.541765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:25.541765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:25.541765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:25.541765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:25.541765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:25.541765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:25.541765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:25.541765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:25.541765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:25.542690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:25.542690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:25.542690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:25.542690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:25.542690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:25.542690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:25.542690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:25.542690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:25.542690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:25.542690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:25.542690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:25.542690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:25.542690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:25.542690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:25.542690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:25.542690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:25.542690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:25.543557 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:25.543557 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:25.543557 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:25.545200 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 291/571] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:25.546578 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba29756-f139-41fd-988c-367ab3115e21 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:25.546867 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba29756-f139-41fd-988c-367ab3115e21 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:25.547140 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba29756-f139-41fd-988c-367ab3115e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:25.554786 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864f7e2-0c87-4bfc-bd5f-ffdf2083c636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:25.555411 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864f7e2-0c87-4bfc-bd5f-ffdf2083c636 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:25.555686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864f7e2-0c87-4bfc-bd5f-ffdf2083c636 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:25.555956 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864f7e2-0c87-4bfc-bd5f-ffdf2083c636 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:25.563715 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864f7e2-0c87-4bfc-bd5f-ffdf2083c636 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:25.565166 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864f7e2-0c87-4bfc-bd5f-ffdf2083c636 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:25.566563 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-cba29756-f139-41fd-988c-367ab3115e21 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:25.568030 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cba29756-f139-41fd-988c-367ab3115e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:25.577012 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-6864f7e2-0c87-4bfc-bd5f-ffdf2083c636 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 13:59:25.577012 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:25.577012 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:25.577012 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:25.577012 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:25.577012 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:25.577012 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:25.577012 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:25.577012 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:25.577012 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:25.577012 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:25.577012 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:25.577012 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 13:59:25.577012 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 13:59:25.577012 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 13:59:25.577012 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 13:59:25.578194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:25.578194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:25.578194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 13:59:25.578194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:25.578194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 13:59:25.578194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:25.578194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:25.578194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:25.578194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:25.578194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:25.578194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:25.578194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:25.578194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:25.578194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:25.578194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:25.578194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:25.578194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:25.578194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:25.579209 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:25.579209 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:25.579209 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 13:59:25.579209 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 13:59:25.579209 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 13:59:25.579209 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 13:59:25.579209 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 13:59:25.579209 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 13:59:25.579209 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 13:59:25.579209 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:25.579209 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 281/572] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:59:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:25.579209 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864f7e2-0c87-4bfc-bd5f-ffdf2083c636 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:25.640462 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:25.647688 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 292/573] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:25.648654 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba29756-f139-41fd-988c-367ab3115e21 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:25.706903 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864f7e2-0c87-4bfc-bd5f-ffdf2083c636 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:25.729064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:25.747971 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07478888-1aa7-4194-970c-a6daaf68f3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:25.748895 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07478888-1aa7-4194-970c-a6daaf68f3aa None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:25.749414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07478888-1aa7-4194-970c-a6daaf68f3aa None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:25.749919 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07478888-1aa7-4194-970c-a6daaf68f3aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:25.761637 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07478888-1aa7-4194-970c-a6daaf68f3aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:25.763425 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07478888-1aa7-4194-970c-a6daaf68f3aa None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:25.779103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-07478888-1aa7-4194-970c-a6daaf68f3aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:25.779103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:25.779103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:25.779103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:25.779103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:25.779103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:25.779103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:25.779103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:25.779103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:25.779103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:25.779103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:25.779103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:25.779103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:25.779103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:25.779103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:25.779103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:25.780072 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:25.780072 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:25.780072 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:25.780072 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:25.780072 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:25.780072 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:25.780072 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:25.780072 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:25.780072 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:25.780072 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:25.780072 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:25.780072 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:25.780072 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:25.780072 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:25.780072 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:25.780072 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:25.780072 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:25.780945 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:25.780945 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:25.780945 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:25.781159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba29756-f139-41fd-988c-367ab3115e21 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:25.783390 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 282/574] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:25.784409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07478888-1aa7-4194-970c-a6daaf68f3aa None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:25.830333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0f39b-b82e-46ac-9aea-7181de6ef30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:25.831337 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0f39b-b82e-46ac-9aea-7181de6ef30b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:25.832078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0f39b-b82e-46ac-9aea-7181de6ef30b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:25.834047 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0f39b-b82e-46ac-9aea-7181de6ef30b None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:25.834958 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0f39b-b82e-46ac-9aea-7181de6ef30b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:25.835470 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0f39b-b82e-46ac-9aea-7181de6ef30b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:25.837184 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0f39b-b82e-46ac-9aea-7181de6ef30b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:25.850436 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 293/575] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:25.855394 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0f39b-b82e-46ac-9aea-7181de6ef30b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:25.910951 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07478888-1aa7-4194-970c-a6daaf68f3aa None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:25.915691 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:25.949412 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413774b-8e51-40f4-bf58-e99cdd9b76f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:25.950015 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413774b-8e51-40f4-bf58-e99cdd9b76f0 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:25.950316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413774b-8e51-40f4-bf58-e99cdd9b76f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:25.950594 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413774b-8e51-40f4-bf58-e99cdd9b76f0 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:25.951320 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413774b-8e51-40f4-bf58-e99cdd9b76f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:25.951626 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413774b-8e51-40f4-bf58-e99cdd9b76f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:25.953063 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413774b-8e51-40f4-bf58-e99cdd9b76f0 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:25.961117 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0f39b-b82e-46ac-9aea-7181de6ef30b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:25.970749 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 283/576] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Sep 13 13:59:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:25.971455 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413774b-8e51-40f4-bf58-e99cdd9b76f0 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:26.001629 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b47be1-c1d4-488d-9477-3fd84dbbb33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:26.002382 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b47be1-c1d4-488d-9477-3fd84dbbb33e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:26.002663 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b47be1-c1d4-488d-9477-3fd84dbbb33e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:26.003100 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:26.003286 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b47be1-c1d4-488d-9477-3fd84dbbb33e None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:26.004238 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b47be1-c1d4-488d-9477-3fd84dbbb33e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:26.004626 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b47be1-c1d4-488d-9477-3fd84dbbb33e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:26.006602 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b47be1-c1d4-488d-9477-3fd84dbbb33e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:26.020113 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 294/577] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:26.020113 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b47be1-c1d4-488d-9477-3fd84dbbb33e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:26.088370 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413774b-8e51-40f4-bf58-e99cdd9b76f0 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:26.124315 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b47be1-c1d4-488d-9477-3fd84dbbb33e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:26.126447 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed48f1-e6f9-446e-9aba-41edc99ff587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:26.127165 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed48f1-e6f9-446e-9aba-41edc99ff587 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:26.127506 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed48f1-e6f9-446e-9aba-41edc99ff587 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:26.127778 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed48f1-e6f9-446e-9aba-41edc99ff587 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:26.134899 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ed48f1-e6f9-446e-9aba-41edc99ff587 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:26.136365 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ed48f1-e6f9-446e-9aba-41edc99ff587 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:26.142948 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:26.147874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-d1ed48f1-e6f9-446e-9aba-41edc99ff587 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 13:59:26.147874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:26.147874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:26.147874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:26.147874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:26.147874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:26.147874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:26.147874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:26.147874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:26.147874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:26.147874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:26.147874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:26.147874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 13:59:26.147874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 13:59:26.147874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 13:59:26.147874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 13:59:26.148775 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:26.148775 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:26.148775 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 13:59:26.148775 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:26.148775 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 13:59:26.148775 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:26.148775 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:26.148775 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:26.148775 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:26.148775 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:26.148775 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:26.148775 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:26.148775 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:26.148775 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:26.148775 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:26.148775 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:26.148775 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:26.148775 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:26.150157 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:26.150157 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:26.150157 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 13:59:26.150157 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 13:59:26.150157 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 13:59:26.150157 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 13:59:26.150157 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 13:59:26.150157 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 13:59:26.150157 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 13:59:26.150157 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:26.150157 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 284/578] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Sep 13 13:59:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:26.154171 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed48f1-e6f9-446e-9aba-41edc99ff587 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:26.166111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08783e97-46bc-4687-bf78-53cf03cb1836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:26.166683 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08783e97-46bc-4687-bf78-53cf03cb1836 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:26.167276 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08783e97-46bc-4687-bf78-53cf03cb1836 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:26.167547 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08783e97-46bc-4687-bf78-53cf03cb1836 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:26.178749 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08783e97-46bc-4687-bf78-53cf03cb1836 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:26.183546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-08783e97-46bc-4687-bf78-53cf03cb1836 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:26.183546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:26.183546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:26.183546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:26.183546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:26.183546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:26.183546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:26.183546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:26.183546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:26.183546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:26.183546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:26.183546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:26.183546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:26.183546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:26.183546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:26.183546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:26.184442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:26.184442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:26.184442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:26.184442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:26.184442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:26.184442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:26.184442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:26.184442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:26.184442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:26.184442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:26.184442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:26.184442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:26.184442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:26.184442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:26.184442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:26.184442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:26.185273 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:26.185273 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:26.185273 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:26.185273 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:26.185273 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:26.185273 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:26.185273 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:26.185273 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:26.185273 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:26.185273 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:26.185273 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:26.185273 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:26.185273 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 295/579] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 13 13:59:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:26.185942 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08783e97-46bc-4687-bf78-53cf03cb1836 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:26.248731 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:26.263370 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed48f1-e6f9-446e-9aba-41edc99ff587 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:26.293558 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08783e97-46bc-4687-bf78-53cf03cb1836 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:26.303158 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89886510-ac76-4566-92fa-1597bed3fdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:26.303787 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89886510-ac76-4566-92fa-1597bed3fdec None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:26.304062 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89886510-ac76-4566-92fa-1597bed3fdec None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:26.304327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89886510-ac76-4566-92fa-1597bed3fdec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:26.315090 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89886510-ac76-4566-92fa-1597bed3fdec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:26.316539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89886510-ac76-4566-92fa-1597bed3fdec None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:26.329953 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80377090-f737-4d17-a3ab-ef7cfcc0fab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:26.330777 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80377090-f737-4d17-a3ab-ef7cfcc0fab0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:26.331235 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80377090-f737-4d17-a3ab-ef7cfcc0fab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:26.331347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-89886510-ac76-4566-92fa-1597bed3fdec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:26.331347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:26.331347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:26.331347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:26.331347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:26.331347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:26.331347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:26.331347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:26.331347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:26.331347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:26.331347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:26.331347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:26.331347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:26.331347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:26.331347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:26.331347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:26.332426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:26.332426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:26.332426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:26.332426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:26.332426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:26.332426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:26.332426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:26.332426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:26.332426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:26.332426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:26.332426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:26.332426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:26.332426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:26.332426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:26.332426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:26.332426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:26.332426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:26.333448 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:26.333448 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:26.333448 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:26.333448 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 285/580] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:26.333689 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89886510-ac76-4566-92fa-1597bed3fdec None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:26.334100 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80377090-f737-4d17-a3ab-ef7cfcc0fab0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:26.344339 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80377090-f737-4d17-a3ab-ef7cfcc0fab0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:26.345836 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80377090-f737-4d17-a3ab-ef7cfcc0fab0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:26.357358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-80377090-f737-4d17-a3ab-ef7cfcc0fab0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 13:59:26.357358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:26.357358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:26.357358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:26.357358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:26.357358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:26.357358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:26.357358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:26.357358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:26.357358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:26.357358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:26.357358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:26.357358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 13:59:26.357358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 13:59:26.357358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 13:59:26.357358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 13:59:26.358267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:26.358267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:26.358267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 13:59:26.358267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:26.358267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 13:59:26.358267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:26.358267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:26.358267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:26.358267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:26.358267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:26.358267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:26.358267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:26.358267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:26.358267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:26.358267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:26.358267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:26.358267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:26.358267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:26.359192 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:26.359192 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:26.359192 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 13:59:26.359192 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 13:59:26.359192 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 13:59:26.359192 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 13:59:26.359192 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 13:59:26.359192 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 13:59:26.359192 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 13:59:26.359192 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:26.359192 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 296/581] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:59:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:26.359192 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80377090-f737-4d17-a3ab-ef7cfcc0fab0 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:26.405366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:26.456022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89886510-ac76-4566-92fa-1597bed3fdec None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:26.468513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80377090-f737-4d17-a3ab-ef7cfcc0fab0 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:26.491899 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce391b59-46b0-4d8a-9a7a-ebbfb67f2924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:26.492485 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce391b59-46b0-4d8a-9a7a-ebbfb67f2924 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:26.492759 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce391b59-46b0-4d8a-9a7a-ebbfb67f2924 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:26.493133 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce391b59-46b0-4d8a-9a7a-ebbfb67f2924 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:26.493767 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce391b59-46b0-4d8a-9a7a-ebbfb67f2924 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:26.494062 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce391b59-46b0-4d8a-9a7a-ebbfb67f2924 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:26.495476 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce391b59-46b0-4d8a-9a7a-ebbfb67f2924 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:26.503001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85dd3f-d2ab-4fad-aacf-353a3b9bc393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:26.503592 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85dd3f-d2ab-4fad-aacf-353a3b9bc393 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:26.503875 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85dd3f-d2ab-4fad-aacf-353a3b9bc393 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:26.504166 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85dd3f-d2ab-4fad-aacf-353a3b9bc393 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:26.505438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85dd3f-d2ab-4fad-aacf-353a3b9bc393 None admin] RBAC: Adding query filter params (name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:26.505732 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85dd3f-d2ab-4fad-aacf-353a3b9bc393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:26.506380 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:26.507243 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85dd3f-d2ab-4fad-aacf-353a3b9bc393 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:26.519473 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 297/582] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 13 13:59:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:26.519473 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85dd3f-d2ab-4fad-aacf-353a3b9bc393 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:26.519690 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 286/583] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Sep 13 13:59:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:26.520725 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce391b59-46b0-4d8a-9a7a-ebbfb67f2924 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:26.623479 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:26.628020 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85dd3f-d2ab-4fad-aacf-353a3b9bc393 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:26.631574 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce391b59-46b0-4d8a-9a7a-ebbfb67f2924 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:26.668637 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab92696-81d0-49c5-ab61-a0a9774adf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:26.669287 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab92696-81d0-49c5-ab61-a0a9774adf0c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:26.669567 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab92696-81d0-49c5-ab61-a0a9774adf0c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:26.669836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab92696-81d0-49c5-ab61-a0a9774adf0c None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:26.670568 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab92696-81d0-49c5-ab61-a0a9774adf0c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:26.670870 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab92696-81d0-49c5-ab61-a0a9774adf0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:26.672300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab92696-81d0-49c5-ab61-a0a9774adf0c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:26.680551 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398e4f6-6f8c-41a1-a5c7-95af6946c04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:26.682206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398e4f6-6f8c-41a1-a5c7-95af6946c04f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:26.682584 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398e4f6-6f8c-41a1-a5c7-95af6946c04f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:26.682947 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398e4f6-6f8c-41a1-a5c7-95af6946c04f None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:26.683884 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398e4f6-6f8c-41a1-a5c7-95af6946c04f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:26.684335 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398e4f6-6f8c-41a1-a5c7-95af6946c04f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:26.685800 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398e4f6-6f8c-41a1-a5c7-95af6946c04f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:26.694933 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 287/584] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Sep 13 13:59:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:26.694933 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab92696-81d0-49c5-ab61-a0a9774adf0c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:26.701904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 298/585] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:26.706490 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398e4f6-6f8c-41a1-a5c7-95af6946c04f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:26.756772 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:26.803773 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab92696-81d0-49c5-ab61-a0a9774adf0c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:26.809961 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398e4f6-6f8c-41a1-a5c7-95af6946c04f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:26.842051 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533dfd8f-de78-4f1e-a1db-0886cb9df064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:26.842675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dfd8f-de78-4f1e-a1db-0886cb9df064 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:26.842950 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dfd8f-de78-4f1e-a1db-0886cb9df064 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:26.843218 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dfd8f-de78-4f1e-a1db-0886cb9df064 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:26.845827 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef116c-cea4-4e23-963c-c789f5936d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:26.846447 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef116c-cea4-4e23-963c-c789f5936d61 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:26.846730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef116c-cea4-4e23-963c-c789f5936d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:26.847000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef116c-cea4-4e23-963c-c789f5936d61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:26.853804 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533dfd8f-de78-4f1e-a1db-0886cb9df064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:26.855253 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533dfd8f-de78-4f1e-a1db-0886cb9df064 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:26.858159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef116c-cea4-4e23-963c-c789f5936d61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:26.859594 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef116c-cea4-4e23-963c-c789f5936d61 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:26.870306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-533dfd8f-de78-4f1e-a1db-0886cb9df064 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:26.870306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:26.870306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:26.870306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:26.870306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:26.870306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:26.870306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:26.870306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:26.870306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:26.870306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:26.870306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:26.870306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:26.870306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:26.870306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:26.870306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:26.870306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:26.871212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:26.871212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:26.871212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:26.871212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:26.871212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:26.871212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:26.871212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:26.871212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:26.871212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:26.871212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:26.871212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:26.871212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:26.871212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:26.871212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:26.871212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:26.871212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:26.871212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:26.872074 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:26.872074 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:26.872074 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:26.872074 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 288/586] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:26.872687 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533dfd8f-de78-4f1e-a1db-0886cb9df064 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:26.879762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-90ef116c-cea4-4e23-963c-c789f5936d61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:26.879762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:26.879762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:26.879762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:26.879762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:26.879762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:26.879762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:26.879762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:26.879762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:26.879762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:26.879762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:26.879762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:26.879762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:26.879762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:26.879762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:26.879762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:26.880690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:26.880690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:26.880690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:26.880690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:26.880690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:26.880690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:26.880690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:26.880690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:26.880690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:26.880690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:26.880690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:26.880690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:26.880690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:26.880690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:26.880690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:26.880690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:26.880690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:26.886379 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:26.886379 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:26.886379 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:26.886379 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 299/587] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:26.886379 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef116c-cea4-4e23-963c-c789f5936d61 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:26.898923 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:26.984952 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533dfd8f-de78-4f1e-a1db-0886cb9df064 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:26.985357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef116c-cea4-4e23-963c-c789f5936d61 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:26.995322 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:27.027471 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc31b4-046c-49da-b8bb-b989d89871fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:27.027774 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51311dec-a30a-43b7-a4e3-1b97865a2da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:27.028110 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc31b4-046c-49da-b8bb-b989d89871fe None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:27.028314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51311dec-a30a-43b7-a4e3-1b97865a2da2 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:27.028433 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc31b4-046c-49da-b8bb-b989d89871fe None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:27.028635 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51311dec-a30a-43b7-a4e3-1b97865a2da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:27.028753 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc31b4-046c-49da-b8bb-b989d89871fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:27.028854 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51311dec-a30a-43b7-a4e3-1b97865a2da2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:27.036530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc31b4-046c-49da-b8bb-b989d89871fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:27.038029 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc31b4-046c-49da-b8bb-b989d89871fe None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:27.040742 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51311dec-a30a-43b7-a4e3-1b97865a2da2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:27.042194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51311dec-a30a-43b7-a4e3-1b97865a2da2 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:27.049555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-8ffc31b4-046c-49da-b8bb-b989d89871fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:27.049555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:27.049555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:27.049555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:27.049555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:27.049555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:27.049555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:27.049555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:27.049555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:27.049555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:27.049555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:27.049555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:27.049555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 13:59:27.049555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 13:59:27.049555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 13:59:27.050424 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 13:59:27.050424 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:27.050424 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:27.050424 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:27.050424 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:27.050424 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:27.050424 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:27.050424 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:27.050424 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:27.050424 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:27.050424 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:27.050424 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:27.050424 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:27.050424 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:27.050424 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:27.050424 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:27.050424 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:27.051452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 13:59:27.051452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 13:59:27.051452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 13:59:27.051452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 13:59:27.051452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 13:59:27.051452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 13:59:27.051452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:27.051452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:27.054574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 300/588] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:27.054574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc31b4-046c-49da-b8bb-b989d89871fe None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:27.060645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-51311dec-a30a-43b7-a4e3-1b97865a2da2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:27.060645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:27.060645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:27.060645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:27.060645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:27.060645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:27.060645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:27.060645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:27.060645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:27.060645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:27.060645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:27.060645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:27.060645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:27.060645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:27.060645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:27.060645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:27.061613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:27.061613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:27.061613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:27.061613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:27.061613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:27.061613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:27.061613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:27.061613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:27.061613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:27.061613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:27.061613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:27.061613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:27.061613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:27.061613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:27.061613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:27.061613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:27.061613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:27.062520 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:27.062520 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:27.062520 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:27.066678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 289/589] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:27.066678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51311dec-a30a-43b7-a4e3-1b97865a2da2 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:27.130169 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:27.162553 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc31b4-046c-49da-b8bb-b989d89871fe None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:27.175041 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51311dec-a30a-43b7-a4e3-1b97865a2da2 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:27.200703 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30d405-e56b-4901-916f-9f5967731046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:27.201703 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30d405-e56b-4901-916f-9f5967731046 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:27.201949 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30d405-e56b-4901-916f-9f5967731046 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:27.202223 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30d405-e56b-4901-916f-9f5967731046 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:27.202863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30d405-e56b-4901-916f-9f5967731046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:27.203162 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30d405-e56b-4901-916f-9f5967731046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:27.204533 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30d405-e56b-4901-916f-9f5967731046 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:27.212314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a83dc-e1f9-4a1f-ae20-5ddba8a80310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:27.212909 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a83dc-e1f9-4a1f-ae20-5ddba8a80310 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:27.213230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a83dc-e1f9-4a1f-ae20-5ddba8a80310 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:27.213508 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a83dc-e1f9-4a1f-ae20-5ddba8a80310 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:27.214155 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a83dc-e1f9-4a1f-ae20-5ddba8a80310 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:27.214455 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a83dc-e1f9-4a1f-ae20-5ddba8a80310 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:27.215800 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a83dc-e1f9-4a1f-ae20-5ddba8a80310 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:27.217074 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 301/590] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:27.217913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30d405-e56b-4901-916f-9f5967731046 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:27.230940 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 290/591] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:27.231755 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a83dc-e1f9-4a1f-ae20-5ddba8a80310 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:27.252360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:27.317677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30d405-e56b-4901-916f-9f5967731046 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:27.328976 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a83dc-e1f9-4a1f-ae20-5ddba8a80310 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:27.346790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:27.352966 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b686ad-922b-47b8-a390-baf7c85b13bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:27.353593 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b686ad-922b-47b8-a390-baf7c85b13bd None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:27.353869 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b686ad-922b-47b8-a390-baf7c85b13bd None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:27.354140 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b686ad-922b-47b8-a390-baf7c85b13bd None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:27.354823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b686ad-922b-47b8-a390-baf7c85b13bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:27.355126 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b686ad-922b-47b8-a390-baf7c85b13bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:27.356548 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b686ad-922b-47b8-a390-baf7c85b13bd None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:27.362910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e249818-4f97-48c9-9d26-e30e35adff06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:27.363506 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e249818-4f97-48c9-9d26-e30e35adff06 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:27.363778 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e249818-4f97-48c9-9d26-e30e35adff06 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:27.364053 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e249818-4f97-48c9-9d26-e30e35adff06 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:27.364684 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e249818-4f97-48c9-9d26-e30e35adff06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:27.364979 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e249818-4f97-48c9-9d26-e30e35adff06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:27.366351 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e249818-4f97-48c9-9d26-e30e35adff06 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:27.367795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 302/592] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 13:59:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:27.369020 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e42dd5-1a00-4c9e-9969-e8b8eaaa4076 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:27.369337 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e42dd5-1a00-4c9e-9969-e8b8eaaa4076 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:27.369611 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e42dd5-1a00-4c9e-9969-e8b8eaaa4076 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:27.370813 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 303/593] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:27.371494 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e42dd5-1a00-4c9e-9969-e8b8eaaa4076 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:27.383400 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 291/594] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:27.383400 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e249818-4f97-48c9-9d26-e30e35adff06 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:27.466211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:27.476509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e42dd5-1a00-4c9e-9969-e8b8eaaa4076 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:27.485549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e249818-4f97-48c9-9d26-e30e35adff06 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:27.510535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbc8b9-2086-4412-b0c0-a0a0839e2953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:27.511083 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbc8b9-2086-4412-b0c0-a0a0839e2953 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:27.511353 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbc8b9-2086-4412-b0c0-a0a0839e2953 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:27.511621 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbc8b9-2086-4412-b0c0-a0a0839e2953 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:27.518398 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffbc8b9-2086-4412-b0c0-a0a0839e2953 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:27.519671 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6cdce-6548-4f8d-8ad4-739bb80f4f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:27.519848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffbc8b9-2086-4412-b0c0-a0a0839e2953 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:27.520282 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6cdce-6548-4f8d-8ad4-739bb80f4f15 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:27.520556 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6cdce-6548-4f8d-8ad4-739bb80f4f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:27.520823 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6cdce-6548-4f8d-8ad4-739bb80f4f15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:27.528343 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6cdce-6548-4f8d-8ad4-739bb80f4f15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:27.529815 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6cdce-6548-4f8d-8ad4-739bb80f4f15 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:27.531094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-9ffbc8b9-2086-4412-b0c0-a0a0839e2953 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 13:59:27.531094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:27.531094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:27.531094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:27.531094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:27.531094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:27.531094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:27.531094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:27.531094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:27.531094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:27.531094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:27.531094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:27.531094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 13:59:27.531094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 13:59:27.531094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 13:59:27.531094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 13:59:27.532170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:27.532170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:27.532170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 13:59:27.532170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:27.532170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 13:59:27.532170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:27.532170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:27.532170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:27.532170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:27.532170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:27.532170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:27.532170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:27.532170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:27.532170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:27.532170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:27.532170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:27.532170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:27.532170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:27.533584 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:27.533584 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:27.533584 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 13:59:27.533584 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 13:59:27.533584 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 13:59:27.533584 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 13:59:27.533584 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 13:59:27.533584 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 13:59:27.533584 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 13:59:27.533584 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:27.533584 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 304/595] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 13 13:59:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:27.533584 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbc8b9-2086-4412-b0c0-a0a0839e2953 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:27.546633 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-edb6cdce-6548-4f8d-8ad4-739bb80f4f15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:27.546633 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:27.546633 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:27.546633 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:27.546633 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:27.546633 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:27.546633 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:27.546633 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:27.546633 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:27.546633 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:27.546633 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:27.546633 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:27.546633 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 13:59:27.546633 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 13:59:27.546633 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 13:59:27.547673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 13:59:27.547673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:27.547673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:27.547673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:27.547673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:27.547673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:27.547673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:27.547673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:27.547673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:27.547673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:27.547673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:27.547673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:27.547673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:27.547673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:27.547673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:27.547673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:27.547673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:27.548616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 13:59:27.548616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 13:59:27.548616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 13:59:27.548616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 13:59:27.548616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 13:59:27.548616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 13:59:27.548616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:27.548616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:27.548616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 292/596] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:27.549198 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec368e6-e2c6-46e3-afa9-f37fb8ef5a5c None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:27.549383 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec368e6-e2c6-46e3-afa9-f37fb8ef5a5c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:27.549654 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec368e6-e2c6-46e3-afa9-f37fb8ef5a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:27.567441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-0ec368e6-e2c6-46e3-afa9-f37fb8ef5a5c None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:27.568617 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0ec368e6-e2c6-46e3-afa9-f37fb8ef5a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:27.590364 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:27.635532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 293/597] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:27.636377 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec368e6-e2c6-46e3-afa9-f37fb8ef5a5c None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:27.640470 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbc8b9-2086-4412-b0c0-a0a0839e2953 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:27.676647 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5bdfc-9a9a-4f23-9a71-d73544c045f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:27.677658 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5bdfc-9a9a-4f23-9a71-d73544c045f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:27.677658 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5bdfc-9a9a-4f23-9a71-d73544c045f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:27.677853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5bdfc-9a9a-4f23-9a71-d73544c045f2 None admin] PATH_INFO: `/v3/projects/17ba27c26bf34daa91cf8f7cc25bf086/users/22959df6ef034036b5f6b3cda7918e24/roles/0c389f21d4434ae0a32fc453a8f2050a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:27.692485 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5bdfc-9a9a-4f23-9a71-d73544c045f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=17ba27c26bf34daa91cf8f7cc25bf086, user_id=22959df6ef034036b5f6b3cda7918e24, role_id=0c389f21d4434ae0a32fc453a8f2050a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:27.694041 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5bdfc-9a9a-4f23-9a71-d73544c045f2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:27.717128 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 305/598] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 13 13:59:27 2022] PUT /identity/v3/projects/17ba27c26bf34daa91cf8f7cc25bf086/users/22959df6ef034036b5f6b3cda7918e24/roles/0c389f21d4434ae0a32fc453a8f2050a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 13:59:27.717128 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5bdfc-9a9a-4f23-9a71-d73544c045f2 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:27.720905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:27.765017 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec368e6-e2c6-46e3-afa9-f37fb8ef5a5c None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:27.813528 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b7188-5983-468f-877a-00e8e70078f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:27.814556 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b7188-5983-468f-877a-00e8e70078f0 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:27.814904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b7188-5983-468f-877a-00e8e70078f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:27.815247 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b7188-5983-468f-877a-00e8e70078f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:27.825686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b7188-5983-468f-877a-00e8e70078f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:27.828016 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b7188-5983-468f-877a-00e8e70078f0 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:27.834034 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5bdfc-9a9a-4f23-9a71-d73544c045f2 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:27.835855 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:27.852395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-ee6b7188-5983-468f-877a-00e8e70078f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:27.852395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:27.852395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:27.852395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:27.852395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:27.852395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:27.852395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:27.852395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:27.852395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:27.852395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:27.852395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:27.852395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:27.852395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 13:59:27.852395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 13:59:27.852395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 13:59:27.853489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 13:59:27.853489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:27.853489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:27.853489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:27.853489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:27.853489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:27.853489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:27.853489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:27.853489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:27.853489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:27.853489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:27.853489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:27.853489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:27.853489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:27.853489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:27.853489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:27.853489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:27.854396 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 13:59:27.854396 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 13:59:27.854396 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 13:59:27.854396 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 13:59:27.854396 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 13:59:27.854396 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 13:59:27.854396 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:27.854396 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:27.854830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 294/599] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:27.855540 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b7188-5983-468f-877a-00e8e70078f0 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:27.880920 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ad381-e528-4bc9-90c7-a0bbd53632e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:27.882078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ad381-e528-4bc9-90c7-a0bbd53632e6 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:27.882419 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ad381-e528-4bc9-90c7-a0bbd53632e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:27.882768 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ad381-e528-4bc9-90c7-a0bbd53632e6 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:27.883663 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ad381-e528-4bc9-90c7-a0bbd53632e6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:27.884062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ad381-e528-4bc9-90c7-a0bbd53632e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:27.885661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ad381-e528-4bc9-90c7-a0bbd53632e6 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:27.909188 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 306/600] 10.222.0.26 () {56 vars in 1139 bytes} [Tue Sep 13 13:59:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:27.911722 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ad381-e528-4bc9-90c7-a0bbd53632e6 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:27.977572 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b7188-5983-468f-877a-00e8e70078f0 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:28.017739 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:28.022531 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ad381-e528-4bc9-90c7-a0bbd53632e6 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:28.025600 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e508f0-0e77-4fc9-b1f3-2d8f037229f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:28.025600 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e508f0-0e77-4fc9-b1f3-2d8f037229f1 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:28.025922 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e508f0-0e77-4fc9-b1f3-2d8f037229f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:28.026138 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e508f0-0e77-4fc9-b1f3-2d8f037229f1 None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:28.026816 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e508f0-0e77-4fc9-b1f3-2d8f037229f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:28.027113 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e508f0-0e77-4fc9-b1f3-2d8f037229f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:28.028528 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e508f0-0e77-4fc9-b1f3-2d8f037229f1 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:28.042175 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 295/601] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 13:59:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:28.047417 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e508f0-0e77-4fc9-b1f3-2d8f037229f1 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:28.061717 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77481142-22ea-4429-9deb-a8453f00d15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:28.062320 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77481142-22ea-4429-9deb-a8453f00d15f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:28.062595 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77481142-22ea-4429-9deb-a8453f00d15f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:28.062863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77481142-22ea-4429-9deb-a8453f00d15f None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:28.063550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77481142-22ea-4429-9deb-a8453f00d15f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:28.063847 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77481142-22ea-4429-9deb-a8453f00d15f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:28.065299 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77481142-22ea-4429-9deb-a8453f00d15f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:28.077687 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 307/602] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 13:59:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:28.083464 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77481142-22ea-4429-9deb-a8453f00d15f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:28.105279 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:28.150404 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e508f0-0e77-4fc9-b1f3-2d8f037229f1 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:28.185223 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77481142-22ea-4429-9deb-a8453f00d15f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:28.185410 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49055be6-af01-494d-9c5b-efe1ec804208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:28.186026 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49055be6-af01-494d-9c5b-efe1ec804208 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:28.186297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49055be6-af01-494d-9c5b-efe1ec804208 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:28.186557 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49055be6-af01-494d-9c5b-efe1ec804208 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:28.198535 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49055be6-af01-494d-9c5b-efe1ec804208 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:28.203969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-49055be6-af01-494d-9c5b-efe1ec804208 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:28.203969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:28.203969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:28.203969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:28.203969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:28.203969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:28.203969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:28.203969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:28.203969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:28.203969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:28.203969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:28.203969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:28.203969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:28.203969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:28.203969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:28.203969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:28.204876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:28.204876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:28.204876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:28.204876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:28.204876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:28.204876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:28.204876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:28.204876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:28.204876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:28.204876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:28.204876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:28.204876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:28.204876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:28.204876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:28.204876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:28.204876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:28.206048 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:28.206048 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:28.206048 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:28.206048 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:28.206048 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:28.206048 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:28.206048 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:28.206048 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:28.206048 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:28.206048 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:28.206048 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:28.206048 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:28.210108 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 296/603] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 13 13:59:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:28.211056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49055be6-af01-494d-9c5b-efe1ec804208 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:28.223473 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3074891-9c74-474b-a534-a0d262e7460f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:28.224409 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3074891-9c74-474b-a534-a0d262e7460f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:28.226596 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3074891-9c74-474b-a534-a0d262e7460f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:28.226596 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3074891-9c74-474b-a534-a0d262e7460f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:28.239170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3074891-9c74-474b-a534-a0d262e7460f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:28.241417 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3074891-9c74-474b-a534-a0d262e7460f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:28.260646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-e3074891-9c74-474b-a534-a0d262e7460f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:28.260646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:28.260646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:28.260646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:28.260646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:28.260646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:28.260646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:28.260646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:28.260646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:28.260646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:28.260646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:28.260646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:28.260646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:28.260646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:28.260646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:28.260646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:28.261828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:28.261828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:28.261828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:28.261828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:28.261828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:28.261828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:28.261828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:28.261828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:28.261828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:28.261828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:28.261828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:28.261828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:28.261828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:28.261828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:28.261828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:28.261828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:28.261828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:28.262718 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:28.262718 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:28.262718 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:28.264839 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:28.266509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 308/604] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:28.267313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3074891-9c74-474b-a534-a0d262e7460f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:28.318534 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49055be6-af01-494d-9c5b-efe1ec804208 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:28.348809 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:28.358130 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52083b40-fb17-4f72-a3c0-f170c5d1bf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:28.358778 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52083b40-fb17-4f72-a3c0-f170c5d1bf87 None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:28.359050 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52083b40-fb17-4f72-a3c0-f170c5d1bf87 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:28.359318 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52083b40-fb17-4f72-a3c0-f170c5d1bf87 None admin] PATH_INFO: `/v3/projects/17ba27c26bf34daa91cf8f7cc25bf086/users/1b3533d0a24e4e7bbf5c7137d3511b13/roles/0c389f21d4434ae0a32fc453a8f2050a` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:28.373290 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52083b40-fb17-4f72-a3c0-f170c5d1bf87 None admin] RBAC: Authorizing `identity:create_grant(project_id=17ba27c26bf34daa91cf8f7cc25bf086, user_id=1b3533d0a24e4e7bbf5c7137d3511b13, role_id=0c389f21d4434ae0a32fc453a8f2050a)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:28.374718 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52083b40-fb17-4f72-a3c0-f170c5d1bf87 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:28.383665 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3074891-9c74-474b-a534-a0d262e7460f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:28.387640 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 297/605] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 13 13:59:28 2022] PUT /identity/v3/projects/17ba27c26bf34daa91cf8f7cc25bf086/users/1b3533d0a24e4e7bbf5c7137d3511b13/roles/0c389f21d4434ae0a32fc453a8f2050a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 13:59:28.388440 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52083b40-fb17-4f72-a3c0-f170c5d1bf87 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:28.433999 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854854f-50f5-4e20-a18b-93654afff78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:28.435425 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854854f-50f5-4e20-a18b-93654afff78f None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:28.436911 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854854f-50f5-4e20-a18b-93654afff78f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:28.437447 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854854f-50f5-4e20-a18b-93654afff78f None admin] PATH_INFO: `/v3/projects/17ba27c26bf34daa91cf8f7cc25bf086/users/052d3a21bd3c48c89dcc38ec1444d39a/roles/0c389f21d4434ae0a32fc453a8f2050a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:28.459146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854854f-50f5-4e20-a18b-93654afff78f None admin] RBAC: Authorizing `identity:create_grant(project_id=17ba27c26bf34daa91cf8f7cc25bf086, user_id=052d3a21bd3c48c89dcc38ec1444d39a, role_id=0c389f21d4434ae0a32fc453a8f2050a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:28.462132 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854854f-50f5-4e20-a18b-93654afff78f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:28.483163 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 309/606] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 13 13:59:28 2022] PUT /identity/v3/projects/17ba27c26bf34daa91cf8f7cc25bf086/users/052d3a21bd3c48c89dcc38ec1444d39a/roles/0c389f21d4434ae0a32fc453a8f2050a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 13:59:28.484455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854854f-50f5-4e20-a18b-93654afff78f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:28.547038 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:28.555076 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52083b40-fb17-4f72-a3c0-f170c5d1bf87 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:28.618629 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34e151-b29b-416e-a55b-a93a348569ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:28.618758 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34e151-b29b-416e-a55b-a93a348569ca None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:28.619010 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34e151-b29b-416e-a55b-a93a348569ca None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:28.619528 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34e151-b29b-416e-a55b-a93a348569ca None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:28.622940 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34e151-b29b-416e-a55b-a93a348569ca None admin] RBAC: Adding query filter params (name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:28.622940 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34e151-b29b-416e-a55b-a93a348569ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:28.624038 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34e151-b29b-416e-a55b-a93a348569ca None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:28.641209 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 298/607] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 13 13:59:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:28.655836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34e151-b29b-416e-a55b-a93a348569ca None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:28.695026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854854f-50f5-4e20-a18b-93654afff78f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:28.749484 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:28.753410 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8464d0-9461-42d6-ad5a-98d7a48aa17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:28.754067 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8464d0-9461-42d6-ad5a-98d7a48aa17c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:28.754396 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8464d0-9461-42d6-ad5a-98d7a48aa17c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:28.754929 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8464d0-9461-42d6-ad5a-98d7a48aa17c None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:28.756483 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8464d0-9461-42d6-ad5a-98d7a48aa17c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:28.756796 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8464d0-9461-42d6-ad5a-98d7a48aa17c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:28.758296 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8464d0-9461-42d6-ad5a-98d7a48aa17c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:28.774139 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 310/608] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:28.781414 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8464d0-9461-42d6-ad5a-98d7a48aa17c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:28.792889 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34e151-b29b-416e-a55b-a93a348569ca None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:28.832813 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8844602-ed13-4d41-8ed0-5681f7679b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:28.833586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8844602-ed13-4d41-8ed0-5681f7679b8b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:28.833963 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8844602-ed13-4d41-8ed0-5681f7679b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:28.834294 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8844602-ed13-4d41-8ed0-5681f7679b8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:28.846447 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8844602-ed13-4d41-8ed0-5681f7679b8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:28.848137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8844602-ed13-4d41-8ed0-5681f7679b8b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:28.864122 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-b8844602-ed13-4d41-8ed0-5681f7679b8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:28.864122 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:28.864122 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:28.864122 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:28.864122 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:28.864122 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:28.864122 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:28.864122 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:28.864122 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:28.864122 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:28.864122 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:28.864122 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:28.864122 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:28.864122 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:28.864122 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:28.864122 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:28.865087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:28.865087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:28.865087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:28.865087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:28.865087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:28.865087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:28.865087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:28.865087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:28.865087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:28.865087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:28.865087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:28.865087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:28.865087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:28.865087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:28.865087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:28.865087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:28.865087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:28.865993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:28.865993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:28.865993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:28.868013 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 299/609] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:59:28.873609 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8844602-ed13-4d41-8ed0-5681f7679b8b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:28.891154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:28.936994 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8464d0-9461-42d6-ad5a-98d7a48aa17c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:28.986051 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8844602-ed13-4d41-8ed0-5681f7679b8b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:29.005821 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4ec8b-890d-4d54-9a66-7dd4115a8b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:29.006467 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4ec8b-890d-4d54-9a66-7dd4115a8b09 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:29.006746 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4ec8b-890d-4d54-9a66-7dd4115a8b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:29.007016 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4ec8b-890d-4d54-9a66-7dd4115a8b09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:29.014229 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4ec8b-890d-4d54-9a66-7dd4115a8b09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:29.015680 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4ec8b-890d-4d54-9a66-7dd4115a8b09 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:29.026228 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7380a75-3979-4b6b-9ab7-3ed6971e6bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:29.027211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7380a75-3979-4b6b-9ab7-3ed6971e6bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:29.027704 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7380a75-3979-4b6b-9ab7-3ed6971e6bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:29.028174 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7380a75-3979-4b6b-9ab7-3ed6971e6bb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:29.029084 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7380a75-3979-4b6b-9ab7-3ed6971e6bb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:29.029617 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7380a75-3979-4b6b-9ab7-3ed6971e6bb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:29.031291 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7380a75-3979-4b6b-9ab7-3ed6971e6bb3 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:29.043602 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-d4a4ec8b-890d-4d54-9a66-7dd4115a8b09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:29.043602 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:29.043602 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:29.043602 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:29.043602 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:29.043602 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:29.043602 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:29.043602 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:29.043602 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:29.043602 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:29.043602 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:29.043602 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:29.043602 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 13:59:29.043602 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 13:59:29.043602 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 13:59:29.044513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 13:59:29.044513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:29.044513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:29.044513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:29.044513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:29.044513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:29.044513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:29.044513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:29.044513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:29.044513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:29.044513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:29.044513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:29.044513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:29.044513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:29.044513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:29.044513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:29.044513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:29.045449 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 13:59:29.045449 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 13:59:29.045449 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 13:59:29.045449 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 13:59:29.045449 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 13:59:29.045449 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 13:59:29.045449 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:29.045449 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:29.053437 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 311/611] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:59:29.053708 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 300/611] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:29.055491 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4ec8b-890d-4d54-9a66-7dd4115a8b09 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:29.057144 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7380a75-3979-4b6b-9ab7-3ed6971e6bb3 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:29.132703 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:29.150738 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:29.200805 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7380a75-3979-4b6b-9ab7-3ed6971e6bb3 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:29.235310 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4ec8b-890d-4d54-9a66-7dd4115a8b09 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:29.272662 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864eaa8-5634-46ad-bb67-e5b7ced873e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:29.273920 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864eaa8-5634-46ad-bb67-e5b7ced873e9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:29.274906 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864eaa8-5634-46ad-bb67-e5b7ced873e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:29.275707 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e60a2f-da93-432b-838a-550b36044366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:29.276196 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864eaa8-5634-46ad-bb67-e5b7ced873e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:29.277022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e60a2f-da93-432b-838a-550b36044366 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:29.278364 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e60a2f-da93-432b-838a-550b36044366 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:29.278610 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864eaa8-5634-46ad-bb67-e5b7ced873e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:29.279104 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864eaa8-5634-46ad-bb67-e5b7ced873e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:29.279644 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e60a2f-da93-432b-838a-550b36044366 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:29.283521 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864eaa8-5634-46ad-bb67-e5b7ced873e9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:29.296598 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e60a2f-da93-432b-838a-550b36044366 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:29.300855 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e60a2f-da93-432b-838a-550b36044366 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:29.311449 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 312/612] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 13:59:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:29.322813 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864eaa8-5634-46ad-bb67-e5b7ced873e9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:29.338024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-f9e60a2f-da93-432b-838a-550b36044366 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 13:59:29.338024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:29.338024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:29.338024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:29.338024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:29.338024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:29.338024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:29.338024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:29.338024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:29.338024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:29.338024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:29.338024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:29.338024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 13:59:29.338024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 13:59:29.338024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 13:59:29.338024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 13:59:29.339064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:29.339064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:29.339064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 13:59:29.339064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:29.339064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 13:59:29.339064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:29.339064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:29.339064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:29.339064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:29.339064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:29.339064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:29.339064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:29.339064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:29.339064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:29.339064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:29.339064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:29.339064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:29.339064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:29.340022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:29.340022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:29.340022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 13:59:29.340022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 13:59:29.340022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 13:59:29.340022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 13:59:29.340022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 13:59:29.340022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 13:59:29.340022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 13:59:29.340022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:29.343315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 301/613] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 13:59:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:59:29.352663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e60a2f-da93-432b-838a-550b36044366 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:29.492053 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e60a2f-da93-432b-838a-550b36044366 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:29.528215 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eee7d3-bd65-4a53-ae2a-415eac83b68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:29.529086 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eee7d3-bd65-4a53-ae2a-415eac83b68e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:29.529568 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eee7d3-bd65-4a53-ae2a-415eac83b68e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:29.529996 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eee7d3-bd65-4a53-ae2a-415eac83b68e None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:29.530889 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eee7d3-bd65-4a53-ae2a-415eac83b68e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:29.531346 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eee7d3-bd65-4a53-ae2a-415eac83b68e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:29.533261 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eee7d3-bd65-4a53-ae2a-415eac83b68e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:29.534272 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864eaa8-5634-46ad-bb67-e5b7ced873e9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:29.535436 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:29.545690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:29.557216 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 302/614] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Sep 13 13:59:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:29.559721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eee7d3-bd65-4a53-ae2a-415eac83b68e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:29.681907 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0344ac3-371b-460e-b735-039d86ac0d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:29.682599 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0344ac3-371b-460e-b735-039d86ac0d9a None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:29.682880 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0344ac3-371b-460e-b735-039d86ac0d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:29.683157 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0344ac3-371b-460e-b735-039d86ac0d9a None admin] PATH_INFO: `/v3/projects/17ba27c26bf34daa91cf8f7cc25bf086/users/cb992cf1a7a445119262b567ce345181/roles/0c389f21d4434ae0a32fc453a8f2050a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:29.683623 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eee7d3-bd65-4a53-ae2a-415eac83b68e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:29.721114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142559c2-2199-4264-8bb2-e8c40129d12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:29.722326 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142559c2-2199-4264-8bb2-e8c40129d12f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:29.722769 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142559c2-2199-4264-8bb2-e8c40129d12f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:29.723716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142559c2-2199-4264-8bb2-e8c40129d12f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:29.735228 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142559c2-2199-4264-8bb2-e8c40129d12f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:29.737031 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142559c2-2199-4264-8bb2-e8c40129d12f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:29.738139 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0344ac3-371b-460e-b735-039d86ac0d9a None admin] RBAC: Authorizing `identity:create_grant(project_id=17ba27c26bf34daa91cf8f7cc25bf086, user_id=cb992cf1a7a445119262b567ce345181, role_id=0c389f21d4434ae0a32fc453a8f2050a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:29.740202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0344ac3-371b-460e-b735-039d86ac0d9a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:29.753958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-142559c2-2199-4264-8bb2-e8c40129d12f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:29.753958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:29.753958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:29.753958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:29.753958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:29.753958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:29.753958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:29.753958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:29.753958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:29.753958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:29.753958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:29.753958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:29.753958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:29.753958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:29.753958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:29.753958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:29.755142 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:29.755142 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:29.755142 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:29.755142 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:29.755142 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:29.755142 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:29.755142 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:29.755142 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:29.755142 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:29.755142 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:29.755142 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:29.755142 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:29.755142 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:29.755142 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:29.755142 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:29.755142 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:29.755142 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:29.756215 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:29.756215 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:29.756215 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:29.762325 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 303/615] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:29.763729 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142559c2-2199-4264-8bb2-e8c40129d12f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:29.783831 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 313/616] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 13 13:59:29 2022] PUT /identity/v3/projects/17ba27c26bf34daa91cf8f7cc25bf086/users/cb992cf1a7a445119262b567ce345181/roles/0c389f21d4434ae0a32fc453a8f2050a => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 13:59:29.840108 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:29.885558 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142559c2-2199-4264-8bb2-e8c40129d12f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:29.923532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ade655-d65c-4314-8d63-2eb6d75cab4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:29.924460 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ade655-d65c-4314-8d63-2eb6d75cab4c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:29.924887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ade655-d65c-4314-8d63-2eb6d75cab4c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:29.925345 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ade655-d65c-4314-8d63-2eb6d75cab4c None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:29.926244 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ade655-d65c-4314-8d63-2eb6d75cab4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:29.926705 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ade655-d65c-4314-8d63-2eb6d75cab4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:29.928277 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ade655-d65c-4314-8d63-2eb6d75cab4c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:29.946006 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 304/617] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:29.949136 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0344ac3-371b-460e-b735-039d86ac0d9a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:30.076417 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0344ac3-371b-460e-b735-039d86ac0d9a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:30.114315 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9438a6-9175-4075-85b1-823a236ff13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:30.115221 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9438a6-9175-4075-85b1-823a236ff13e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:30.115660 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9438a6-9175-4075-85b1-823a236ff13e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:30.116084 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9438a6-9175-4075-85b1-823a236ff13e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:30.123609 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9438a6-9175-4075-85b1-823a236ff13e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:30.125298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9438a6-9175-4075-85b1-823a236ff13e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:30.138053 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-7a9438a6-9175-4075-85b1-823a236ff13e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:30.138053 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:30.138053 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:30.138053 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:30.138053 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:30.138053 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:30.138053 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:30.138053 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:30.138053 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:30.138053 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:30.138053 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:30.138053 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:30.138053 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 13:59:30.138053 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 13:59:30.138053 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 13:59:30.139301 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 13:59:30.139301 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:30.139301 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:30.139301 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:30.139301 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:30.139301 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:30.139301 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:30.139301 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:30.139301 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:30.139301 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:30.139301 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:30.139301 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:30.139301 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:30.139301 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:30.139301 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:30.139301 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:30.139301 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:30.140371 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 13:59:30.140371 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 13:59:30.140371 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 13:59:30.140371 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 13:59:30.140371 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 13:59:30.140371 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 13:59:30.140371 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:30.140371 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:30.146874 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 314/618] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:30.148391 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ade655-d65c-4314-8d63-2eb6d75cab4c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:30.185056 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb0f2e-5d31-4ebf-bfd8-0641acd5e761 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:30.185711 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb0f2e-5d31-4ebf-bfd8-0641acd5e761 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:30.186183 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb0f2e-5d31-4ebf-bfd8-0641acd5e761 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:30.187886 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 315/619] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:30.193117 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276dd54-376d-4960-8be7-3dd83ca07553 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:30.193574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276dd54-376d-4960-8be7-3dd83ca07553 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:30.193977 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276dd54-376d-4960-8be7-3dd83ca07553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:30.218720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-3276dd54-376d-4960-8be7-3dd83ca07553 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:30.220596 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3276dd54-376d-4960-8be7-3dd83ca07553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:30.231572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:30.273440 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ade655-d65c-4314-8d63-2eb6d75cab4c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:30.276338 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:30.306122 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 316/620] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:30.333859 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a180f3-9471-48ac-8c8b-2bd834fc0dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:30.334507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a180f3-9471-48ac-8c8b-2bd834fc0dba None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:30.334843 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a180f3-9471-48ac-8c8b-2bd834fc0dba None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:30.335177 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a180f3-9471-48ac-8c8b-2bd834fc0dba None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:30.335938 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a180f3-9471-48ac-8c8b-2bd834fc0dba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:30.336303 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a180f3-9471-48ac-8c8b-2bd834fc0dba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:30.337840 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a180f3-9471-48ac-8c8b-2bd834fc0dba None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:30.354827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 305/621] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 13:59:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:30.360630 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276dd54-376d-4960-8be7-3dd83ca07553 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:30.502967 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276dd54-376d-4960-8be7-3dd83ca07553 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:30.550487 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258528c5-0a6e-478d-996c-beccc1a24860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:30.551308 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258528c5-0a6e-478d-996c-beccc1a24860 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:30.551657 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258528c5-0a6e-478d-996c-beccc1a24860 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:30.552009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258528c5-0a6e-478d-996c-beccc1a24860 None admin] PATH_INFO: `/v3/projects/17ba27c26bf34daa91cf8f7cc25bf086/users/97c27e930f604bd38634ca08e56cf8cd/roles/0c389f21d4434ae0a32fc453a8f2050a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:30.572409 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:30.575660 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258528c5-0a6e-478d-996c-beccc1a24860 None admin] RBAC: Authorizing `identity:create_grant(project_id=17ba27c26bf34daa91cf8f7cc25bf086, user_id=97c27e930f604bd38634ca08e56cf8cd, role_id=0c389f21d4434ae0a32fc453a8f2050a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:30.577328 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258528c5-0a6e-478d-996c-beccc1a24860 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:30.601478 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 317/622] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 13 13:59:30 2022] PUT /identity/v3/projects/17ba27c26bf34daa91cf8f7cc25bf086/users/97c27e930f604bd38634ca08e56cf8cd/roles/0c389f21d4434ae0a32fc453a8f2050a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 13:59:30.632404 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a180f3-9471-48ac-8c8b-2bd834fc0dba None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:30.766747 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a180f3-9471-48ac-8c8b-2bd834fc0dba None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:30.810390 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0da856-f071-4476-8d19-eaa63ddcee98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:30.811029 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0da856-f071-4476-8d19-eaa63ddcee98 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:30.811302 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0da856-f071-4476-8d19-eaa63ddcee98 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:30.811574 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0da856-f071-4476-8d19-eaa63ddcee98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:30.827426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0da856-f071-4476-8d19-eaa63ddcee98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:30.833392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-bf0da856-f071-4476-8d19-eaa63ddcee98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:30.833392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:30.833392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:30.833392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:30.833392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:30.833392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:30.833392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:30.833392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:30.833392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:30.833392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:30.833392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:30.833392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:30.833392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:30.833392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:30.833392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:30.833392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:30.834547 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:30.834547 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:30.834547 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:30.834547 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:30.834547 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:30.834547 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:30.834547 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:30.834547 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:30.834547 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:30.834547 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:30.834547 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:30.834547 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:30.834547 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:30.834547 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:30.834547 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:30.834547 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:30.835672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:30.835672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:30.835672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:30.835672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:30.835672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:30.835672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:30.835672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:30.835672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:30.835672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:30.835672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:30.835672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:30.835672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:30.835672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 306/623] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 13 13:59:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:30.840766 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258528c5-0a6e-478d-996c-beccc1a24860 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:30.950187 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258528c5-0a6e-478d-996c-beccc1a24860 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:31.001660 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab0dde-d1bb-4c27-95be-500bf0119898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:31.002279 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab0dde-d1bb-4c27-95be-500bf0119898 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:31.002559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab0dde-d1bb-4c27-95be-500bf0119898 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:31.002878 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab0dde-d1bb-4c27-95be-500bf0119898 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:31.003546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab0dde-d1bb-4c27-95be-500bf0119898 None admin] RBAC: Adding query filter params (name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:31.003890 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab0dde-d1bb-4c27-95be-500bf0119898 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:31.005452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab0dde-d1bb-4c27-95be-500bf0119898 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:31.014661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 318/624] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 13 13:59:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:31.020751 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0da856-f071-4476-8d19-eaa63ddcee98 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:31.055456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:31.143228 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0da856-f071-4476-8d19-eaa63ddcee98 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:31.178672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e4cc6-237c-4ef2-a2a7-62886b7d1a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:31.179285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e4cc6-237c-4ef2-a2a7-62886b7d1a0f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:31.179549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e4cc6-237c-4ef2-a2a7-62886b7d1a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:31.179817 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e4cc6-237c-4ef2-a2a7-62886b7d1a0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:31.190638 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e4cc6-237c-4ef2-a2a7-62886b7d1a0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:31.192698 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e4cc6-237c-4ef2-a2a7-62886b7d1a0f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:31.207238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-d88e4cc6-237c-4ef2-a2a7-62886b7d1a0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:31.207238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:31.207238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:31.207238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:31.207238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:31.207238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:31.207238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:31.207238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:31.207238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:31.207238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:31.207238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:31.207238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:31.207238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:31.207238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:31.207238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:31.207238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:31.209360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:31.209360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:31.209360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:31.209360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:31.209360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:31.209360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:31.209360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:31.209360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:31.209360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:31.209360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:31.209360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:31.209360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:31.209360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:31.209360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:31.209360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:31.209360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:31.209360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:31.211363 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:31.211363 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:31.211363 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:31.211363 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 307/625] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:31.214394 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab0dde-d1bb-4c27-95be-500bf0119898 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:31.280834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:31.329767 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab0dde-d1bb-4c27-95be-500bf0119898 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:31.338512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b30e2-e493-40c7-a88d-62843f2ce6e5 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:31.338987 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b30e2-e493-40c7-a88d-62843f2ce6e5 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:31.339463 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b30e2-e493-40c7-a88d-62843f2ce6e5 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:31.349581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 308/626] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:31 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 13:59:31.364934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae274c-4437-4dae-9704-caa6f20a2091 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:31.365440 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae274c-4437-4dae-9704-caa6f20a2091 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:31.365916 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae274c-4437-4dae-9704-caa6f20a2091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:31.370965 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6e51f-4ed5-47c1-b7aa-11d76b9e2c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:31.371797 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6e51f-4ed5-47c1-b7aa-11d76b9e2c18 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:31.372238 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6e51f-4ed5-47c1-b7aa-11d76b9e2c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:31.372680 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6e51f-4ed5-47c1-b7aa-11d76b9e2c18 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:31.373494 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6e51f-4ed5-47c1-b7aa-11d76b9e2c18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:31.373984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6e51f-4ed5-47c1-b7aa-11d76b9e2c18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:31.375473 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6e51f-4ed5-47c1-b7aa-11d76b9e2c18 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:31.389023 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 319/627] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:31.394012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6e51f-4ed5-47c1-b7aa-11d76b9e2c18 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:31.415504 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-fdae274c-4437-4dae-9704-caa6f20a2091 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:31.417518 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-fdae274c-4437-4dae-9704-caa6f20a2091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:31.507399 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6e51f-4ed5-47c1-b7aa-11d76b9e2c18 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:31.523225 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:31.548936 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4a004-f567-4f6e-aaf7-046d0824bdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:31.550006 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4a004-f567-4f6e-aaf7-046d0824bdd1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:31.550427 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4a004-f567-4f6e-aaf7-046d0824bdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:31.551609 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4a004-f567-4f6e-aaf7-046d0824bdd1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:31.560369 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4a004-f567-4f6e-aaf7-046d0824bdd1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:31.562398 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4a004-f567-4f6e-aaf7-046d0824bdd1 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:31.588248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-afc4a004-f567-4f6e-aaf7-046d0824bdd1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 13:59:31.588248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:31.588248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:31.588248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:31.588248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:31.588248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:31.588248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:31.588248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:31.588248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:31.588248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:31.588248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:31.588248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:31.588248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 13:59:31.588248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 13:59:31.588248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 13:59:31.588248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 13:59:31.589440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:31.589440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:31.589440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 13:59:31.589440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:31.589440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 13:59:31.589440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:31.589440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:31.589440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:31.589440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:31.589440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:31.589440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:31.589440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:31.589440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:31.589440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:31.589440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:31.589440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:31.589440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:31.589440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:31.590453 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:31.590453 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:31.590453 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 13:59:31.590453 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 13:59:31.590453 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 13:59:31.590453 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 13:59:31.590453 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 13:59:31.590453 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 13:59:31.590453 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 13:59:31.590453 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:31.594707 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 320/628] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:59:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:59:31.597399 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 309/629] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 13:59:31.600283 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4a004-f567-4f6e-aaf7-046d0824bdd1 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:31.849640 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4a004-f567-4f6e-aaf7-046d0824bdd1 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:31.920152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67fc82-b27d-48e4-a394-dba3363a0e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:31.920763 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67fc82-b27d-48e4-a394-dba3363a0e51 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:31.921042 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67fc82-b27d-48e4-a394-dba3363a0e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:31.921244 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfa0d2-c589-4288-9869-f49ae0c0d5ad None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:31.921388 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67fc82-b27d-48e4-a394-dba3363a0e51 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:31.921692 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfa0d2-c589-4288-9869-f49ae0c0d5ad None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:31.922059 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67fc82-b27d-48e4-a394-dba3363a0e51 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:31.922215 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfa0d2-c589-4288-9869-f49ae0c0d5ad None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:31.922373 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67fc82-b27d-48e4-a394-dba3363a0e51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:31.929124 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67fc82-b27d-48e4-a394-dba3363a0e51 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:31.931166 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 310/630] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:31 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:31.939386 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fc468-4204-4019-9ae1-6fc9d397e152 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:31.940196 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fc468-4204-4019-9ae1-6fc9d397e152 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:31.940976 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fc468-4204-4019-9ae1-6fc9d397e152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:31.962617 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 321/631] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Sep 13 13:59:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:31.967795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67fc82-b27d-48e4-a394-dba3363a0e51 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:31.977893 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:31.987266 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-eb2fc468-4204-4019-9ae1-6fc9d397e152 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:31.990956 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-eb2fc468-4204-4019-9ae1-6fc9d397e152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:32.045171 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:32.084537 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 311/632] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:32.093516 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fc468-4204-4019-9ae1-6fc9d397e152 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:32.201177 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67fc82-b27d-48e4-a394-dba3363a0e51 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:32.250083 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fc468-4204-4019-9ae1-6fc9d397e152 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:32.297120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842235ef-2ded-4464-a427-90bd9af38aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:32.298233 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842235ef-2ded-4464-a427-90bd9af38aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:32.298524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842235ef-2ded-4464-a427-90bd9af38aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:32.298800 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842235ef-2ded-4464-a427-90bd9af38aa8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:32.304870 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:32.334379 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842235ef-2ded-4464-a427-90bd9af38aa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:32.339278 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-842235ef-2ded-4464-a427-90bd9af38aa8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:32.339278 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:32.339278 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:32.339278 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:32.339278 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:32.339278 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:32.339278 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:32.339278 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:32.339278 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:32.339278 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:32.339278 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:32.339278 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:32.339278 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:32.339278 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:32.339278 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:32.339278 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:32.340910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:32.340910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:32.340910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:32.340910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:32.340910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:32.340910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:32.340910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:32.340910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:32.340910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:32.340910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:32.340910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:32.340910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:32.340910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:32.340910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:32.340910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:32.340910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:32.341756 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:32.341756 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:32.341756 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:32.341756 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:32.341756 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:32.341756 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:32.341756 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:32.341756 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:32.341756 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:32.341756 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:32.341756 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:32.341756 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:32.351528 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9a6ec-f4c2-4019-ad2f-b7b91d98eb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:32.352207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9a6ec-f4c2-4019-ad2f-b7b91d98eb8f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:32.352428 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9a6ec-f4c2-4019-ad2f-b7b91d98eb8f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:32.353639 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9a6ec-f4c2-4019-ad2f-b7b91d98eb8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:32.356415 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 312/633] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 13 13:59:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:32.369122 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842235ef-2ded-4464-a427-90bd9af38aa8 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:32.489876 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9a6ec-f4c2-4019-ad2f-b7b91d98eb8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:32.491387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9a6ec-f4c2-4019-ad2f-b7b91d98eb8f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:32.514311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842235ef-2ded-4464-a427-90bd9af38aa8 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:32.556371 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:32.571173 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da2a40-cda2-4159-9df1-8818b68e264d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:32.571789 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da2a40-cda2-4159-9df1-8818b68e264d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:32.572068 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da2a40-cda2-4159-9df1-8818b68e264d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:32.572337 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da2a40-cda2-4159-9df1-8818b68e264d None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:32.573013 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da2a40-cda2-4159-9df1-8818b68e264d None admin] RBAC: Adding query filter params (name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:32.573341 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da2a40-cda2-4159-9df1-8818b68e264d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:32.574723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da2a40-cda2-4159-9df1-8818b68e264d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:32.595252 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 313/634] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 13 13:59:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:32.601641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da2a40-cda2-4159-9df1-8818b68e264d None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:32.664830 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 322/635] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:59:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:59:32.665791 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9a6ec-f4c2-4019-ad2f-b7b91d98eb8f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:32.693040 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:32.748943 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da2a40-cda2-4159-9df1-8818b68e264d None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:32.772393 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9a6ec-f4c2-4019-ad2f-b7b91d98eb8f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:32.785896 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8abb0-9812-4efa-8e00-ad11b66a24f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:32.787115 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8abb0-9812-4efa-8e00-ad11b66a24f2 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:32.787398 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8abb0-9812-4efa-8e00-ad11b66a24f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:32.787673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8abb0-9812-4efa-8e00-ad11b66a24f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:32.798345 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8abb0-9812-4efa-8e00-ad11b66a24f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:32.799826 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8abb0-9812-4efa-8e00-ad11b66a24f2 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:32.803571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:32.808958 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a32107-2336-41ce-8e02-32793ed25f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:32.810198 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a32107-2336-41ce-8e02-32793ed25f7e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:32.810864 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a32107-2336-41ce-8e02-32793ed25f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:32.811134 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a32107-2336-41ce-8e02-32793ed25f7e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:32.814551 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-fec8abb0-9812-4efa-8e00-ad11b66a24f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:32.814551 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:32.814551 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:32.814551 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:32.814551 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:32.814551 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:32.814551 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:32.814551 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:32.814551 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:32.814551 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:32.814551 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:32.814551 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:32.814551 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:32.814551 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:32.814551 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:32.814551 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:32.815471 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:32.815471 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:32.815471 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:32.815471 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:32.815471 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:32.815471 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:32.815471 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:32.815471 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:32.815471 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:32.815471 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:32.815471 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:32.815471 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:32.815471 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:32.815471 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:32.815471 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:32.815471 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:32.815471 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:32.816349 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:32.816349 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:32.816349 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:32.816349 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 314/636] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:32.816349 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8abb0-9812-4efa-8e00-ad11b66a24f2 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:32.827985 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a32107-2336-41ce-8e02-32793ed25f7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:32.833730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-39a32107-2336-41ce-8e02-32793ed25f7e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:32.833730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:32.833730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:32.833730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:32.833730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:32.833730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:32.833730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:32.833730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:32.833730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:32.833730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:32.833730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:32.833730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:32.833730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:32.833730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:32.833730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:32.833730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:32.834672 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:32.834672 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:32.834672 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:32.834672 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:32.834672 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:32.834672 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:32.834672 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:32.834672 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:32.834672 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:32.834672 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:32.834672 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:32.834672 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:32.834672 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:32.834672 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:32.834672 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:32.834672 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:32.835497 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:32.835497 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:32.835497 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:32.835497 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:32.835497 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:32.835497 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:32.835497 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:32.835497 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:32.835497 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:32.835497 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:32.835497 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:32.835497 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:32.835497 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 323/637] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 13 13:59:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:32.836188 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f84fad-4a93-4d25-995d-e9be849cfaf9 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:32.836841 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f84fad-4a93-4d25-995d-e9be849cfaf9 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:32.836841 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f84fad-4a93-4d25-995d-e9be849cfaf9 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:32.841605 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 324/638] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:32.841605 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f84fad-4a93-4d25-995d-e9be849cfaf9 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:32.925959 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8abb0-9812-4efa-8e00-ad11b66a24f2 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:32.936387 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:32.950608 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f84fad-4a93-4d25-995d-e9be849cfaf9 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:32.961978 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e4657-7434-44a9-beba-209e498d8807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:32.962607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e4657-7434-44a9-beba-209e498d8807 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:32.962883 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e4657-7434-44a9-beba-209e498d8807 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:32.963154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e4657-7434-44a9-beba-209e498d8807 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:32.974034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e4657-7434-44a9-beba-209e498d8807 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:32.975477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e4657-7434-44a9-beba-209e498d8807 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:32.988532 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1f1ab-9db0-4e68-92e5-6867abb32e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:32.989424 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1f1ab-9db0-4e68-92e5-6867abb32e7a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:32.989721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-fe3e4657-7434-44a9-beba-209e498d8807 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:32.989721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:32.989721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:32.989721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:32.989721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:32.989721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:32.989721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:32.989721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:32.989721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:32.989721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:32.989721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:32.989721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:32.989721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:32.989721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:32.989721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:32.989721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:32.990641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:32.990641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:32.990641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:32.990641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:32.990641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:32.990641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:32.990641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:32.990641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:32.990641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:32.990641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:32.990641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:32.990641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:32.990641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:32.990641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:32.990641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:32.990641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:32.990641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:32.991552 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:32.991552 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:32.991552 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:32.991552 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 315/639] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:32.991552 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e4657-7434-44a9-beba-209e498d8807 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:32.992206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1f1ab-9db0-4e68-92e5-6867abb32e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:32.992646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1f1ab-9db0-4e68-92e5-6867abb32e7a None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:32.993326 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1f1ab-9db0-4e68-92e5-6867abb32e7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:32.993635 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1f1ab-9db0-4e68-92e5-6867abb32e7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:32.995365 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1f1ab-9db0-4e68-92e5-6867abb32e7a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:33.009174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 325/640] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:33.010841 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62f4b2-8c03-4c8d-89b0-74c3416b38de None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:33.011721 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62f4b2-8c03-4c8d-89b0-74c3416b38de None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:33.012476 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62f4b2-8c03-4c8d-89b0-74c3416b38de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:33.035602 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-7e62f4b2-8c03-4c8d-89b0-74c3416b38de None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:33.037395 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7e62f4b2-8c03-4c8d-89b0-74c3416b38de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:33.086118 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:33.104761 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e4657-7434-44a9-beba-209e498d8807 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:33.107495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 326/641] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:33.108339 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62f4b2-8c03-4c8d-89b0-74c3416b38de None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:33.155403 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e461ce-d94f-478c-9e88-635edb2dff4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:33.156275 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e461ce-d94f-478c-9e88-635edb2dff4d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:33.156728 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e461ce-d94f-478c-9e88-635edb2dff4d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:33.157210 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e461ce-d94f-478c-9e88-635edb2dff4d None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:33.158353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e461ce-d94f-478c-9e88-635edb2dff4d None admin] RBAC: Adding query filter params (name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:33.158800 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e461ce-d94f-478c-9e88-635edb2dff4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:33.160571 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e461ce-d94f-478c-9e88-635edb2dff4d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:33.170587 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 316/642] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 13 13:59:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:33.171611 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e461ce-d94f-478c-9e88-635edb2dff4d None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:33.200690 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:33.236701 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62f4b2-8c03-4c8d-89b0-74c3416b38de None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:33.281854 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63855776-c63d-43b5-9b9d-f2a084153a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:33.282452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63855776-c63d-43b5-9b9d-f2a084153a59 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:33.283080 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63855776-c63d-43b5-9b9d-f2a084153a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:33.283710 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63855776-c63d-43b5-9b9d-f2a084153a59 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:33.284902 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63855776-c63d-43b5-9b9d-f2a084153a59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:33.285267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63855776-c63d-43b5-9b9d-f2a084153a59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:33.286909 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63855776-c63d-43b5-9b9d-f2a084153a59 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:33.288149 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e461ce-d94f-478c-9e88-635edb2dff4d None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:33.305777 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 327/643] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:33.305777 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63855776-c63d-43b5-9b9d-f2a084153a59 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:33.341051 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef74bf0-0da1-4a27-88d9-3f46c7d69d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:33.341708 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef74bf0-0da1-4a27-88d9-3f46c7d69d63 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:33.341988 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef74bf0-0da1-4a27-88d9-3f46c7d69d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:33.342262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef74bf0-0da1-4a27-88d9-3f46c7d69d63 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:33.349760 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:33.354618 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef74bf0-0da1-4a27-88d9-3f46c7d69d63 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:33.355879 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef74bf0-0da1-4a27-88d9-3f46c7d69d63 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:33.369454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-8ef74bf0-0da1-4a27-88d9-3f46c7d69d63 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 13:59:33.369454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:33.369454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:33.369454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:33.369454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:33.369454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:33.369454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:33.369454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:33.369454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:33.369454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:33.369454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:33.369454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:33.369454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 13:59:33.369454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 13:59:33.369454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 13:59:33.369454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 13:59:33.370459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:33.370459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:33.370459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 13:59:33.370459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:33.370459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 13:59:33.370459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:33.370459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:33.370459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:33.370459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:33.370459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:33.370459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:33.370459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:33.370459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:33.370459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:33.370459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:33.370459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:33.370459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:33.370459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:33.371381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:33.371381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:33.371381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 13:59:33.371381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 13:59:33.371381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 13:59:33.371381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 13:59:33.371381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 13:59:33.371381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 13:59:33.371381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 13:59:33.371381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:33.371381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 317/644] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Sep 13 13:59:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:33.371975 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef74bf0-0da1-4a27-88d9-3f46c7d69d63 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:33.422068 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63855776-c63d-43b5-9b9d-f2a084153a59 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:33.461251 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d45a3-34af-4660-a346-2784d8de8bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:33.461911 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d45a3-34af-4660-a346-2784d8de8bcb None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:33.462209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d45a3-34af-4660-a346-2784d8de8bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:33.462484 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d45a3-34af-4660-a346-2784d8de8bcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:33.466554 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:33.475451 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d45a3-34af-4660-a346-2784d8de8bcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:33.476941 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d45a3-34af-4660-a346-2784d8de8bcb None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:33.483843 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef74bf0-0da1-4a27-88d9-3f46c7d69d63 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:33.492677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-dc2d45a3-34af-4660-a346-2784d8de8bcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:33.492677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:33.492677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:33.492677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:33.492677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:33.492677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:33.492677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:33.492677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:33.492677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:33.492677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:33.492677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:33.492677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:33.492677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:33.492677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:33.492677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:33.492677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:33.493709 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:33.493709 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:33.493709 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:33.493709 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:33.493709 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:33.493709 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:33.493709 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:33.493709 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:33.493709 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:33.493709 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:33.493709 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:33.493709 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:33.493709 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:33.493709 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:33.493709 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:33.493709 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:33.493709 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:33.494787 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:33.494787 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:33.494787 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:33.494787 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 328/645] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:33.495690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d45a3-34af-4660-a346-2784d8de8bcb None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:33.522662 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3a8b7-0658-4a09-832f-bbbce8fa23e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:33.523286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3a8b7-0658-4a09-832f-bbbce8fa23e3 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:33.523559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3a8b7-0658-4a09-832f-bbbce8fa23e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:33.523830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3a8b7-0658-4a09-832f-bbbce8fa23e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:33.530734 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3a8b7-0658-4a09-832f-bbbce8fa23e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:33.532206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3a8b7-0658-4a09-832f-bbbce8fa23e3 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:33.544427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-e0a3a8b7-0658-4a09-832f-bbbce8fa23e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:33.544427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:33.544427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:33.544427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:33.544427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:33.544427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:33.544427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:33.544427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:33.544427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:33.544427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:33.544427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:33.544427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:33.544427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 13:59:33.544427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 13:59:33.544427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 13:59:33.545755 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 13:59:33.545755 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:33.545755 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:33.545755 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:33.545755 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:33.545755 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:33.545755 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:33.545755 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:33.545755 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:33.545755 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:33.545755 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:33.545755 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:33.545755 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:33.545755 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:33.545755 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:33.545755 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:33.545755 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:33.546929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 13:59:33.546929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 13:59:33.546929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 13:59:33.546929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 13:59:33.546929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 13:59:33.546929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 13:59:33.546929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:33.546929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:33.550427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 318/646] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:33.550427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3a8b7-0658-4a09-832f-bbbce8fa23e3 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:33.593171 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:33.600814 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d45a3-34af-4660-a346-2784d8de8bcb None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:33.636038 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a3bf7-217c-4280-9d17-c296a3e54b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:33.636642 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a3bf7-217c-4280-9d17-c296a3e54b7c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:33.636923 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a3bf7-217c-4280-9d17-c296a3e54b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:33.637229 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a3bf7-217c-4280-9d17-c296a3e54b7c None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:33.637959 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a3bf7-217c-4280-9d17-c296a3e54b7c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:33.638265 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a3bf7-217c-4280-9d17-c296a3e54b7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:33.639693 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a3bf7-217c-4280-9d17-c296a3e54b7c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:33.651355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3a8b7-0658-4a09-832f-bbbce8fa23e3 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:33.656725 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 329/647] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Sep 13 13:59:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:33.657810 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a3bf7-217c-4280-9d17-c296a3e54b7c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:33.688614 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9935c5-d64b-41f2-94d5-d605d38356c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:33.689263 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9935c5-d64b-41f2-94d5-d605d38356c2 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:33.689544 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9935c5-d64b-41f2-94d5-d605d38356c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:33.689820 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9935c5-d64b-41f2-94d5-d605d38356c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:33.699608 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9935c5-d64b-41f2-94d5-d605d38356c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:33.704809 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-3f9935c5-d64b-41f2-94d5-d605d38356c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:33.704809 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:33.704809 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:33.704809 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:33.704809 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:33.704809 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:33.704809 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:33.704809 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:33.704809 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:33.704809 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:33.704809 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:33.704809 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:33.704809 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:33.704809 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:33.704809 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:33.704809 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:33.705838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:33.705838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:33.705838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:33.705838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:33.705838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:33.705838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:33.705838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:33.705838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:33.705838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:33.705838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:33.705838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:33.705838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:33.705838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:33.705838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:33.705838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:33.705838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:33.706677 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:33.706677 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:33.706677 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:33.706677 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:33.706677 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:33.706677 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:33.706677 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:33.706677 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:33.706677 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:33.706677 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:33.706677 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:33.706677 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:33.706677 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 319/648] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 13 13:59:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:33.707339 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56bc7d-4108-48e7-ab33-3367d5c33eda None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:33.707339 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56bc7d-4108-48e7-ab33-3367d5c33eda None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:33.707562 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56bc7d-4108-48e7-ab33-3367d5c33eda None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:33.709257 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 320/649] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:33.709638 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56bc7d-4108-48e7-ab33-3367d5c33eda None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:33.715853 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:33.759126 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a3bf7-217c-4280-9d17-c296a3e54b7c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:33.792875 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99a434-33f8-4870-9b43-985e2c058a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:33.793465 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99a434-33f8-4870-9b43-985e2c058a2d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:33.793746 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99a434-33f8-4870-9b43-985e2c058a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:33.794017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99a434-33f8-4870-9b43-985e2c058a2d None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:33.794657 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99a434-33f8-4870-9b43-985e2c058a2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:33.794958 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99a434-33f8-4870-9b43-985e2c058a2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:33.796350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99a434-33f8-4870-9b43-985e2c058a2d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:33.807878 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 330/650] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:33.812729 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99a434-33f8-4870-9b43-985e2c058a2d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:33.820668 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56bc7d-4108-48e7-ab33-3367d5c33eda None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:33.823454 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:33.854792 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27baf9c7-bc89-4821-90dc-e53bc0996e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:33.855436 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27baf9c7-bc89-4821-90dc-e53bc0996e5a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:33.855716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27baf9c7-bc89-4821-90dc-e53bc0996e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:33.855981 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27baf9c7-bc89-4821-90dc-e53bc0996e5a None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:33.856665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27baf9c7-bc89-4821-90dc-e53bc0996e5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:33.856965 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27baf9c7-bc89-4821-90dc-e53bc0996e5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:33.858410 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27baf9c7-bc89-4821-90dc-e53bc0996e5a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:33.870611 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 321/651] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 13:59:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:33.871448 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27baf9c7-bc89-4821-90dc-e53bc0996e5a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:33.909851 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99a434-33f8-4870-9b43-985e2c058a2d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:33.934500 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:33.943618 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f380fe0-7ede-465d-800d-94bdc76befdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:33.944211 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f380fe0-7ede-465d-800d-94bdc76befdd None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:33.944485 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f380fe0-7ede-465d-800d-94bdc76befdd None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:33.944752 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f380fe0-7ede-465d-800d-94bdc76befdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:33.971894 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27baf9c7-bc89-4821-90dc-e53bc0996e5a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:34.007381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60344f4-4c55-49a4-a3ca-a13517b80860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:34.008051 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60344f4-4c55-49a4-a3ca-a13517b80860 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:34.008325 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60344f4-4c55-49a4-a3ca-a13517b80860 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:34.008593 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60344f4-4c55-49a4-a3ca-a13517b80860 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:34.009276 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60344f4-4c55-49a4-a3ca-a13517b80860 None admin] RBAC: Adding query filter params (name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:34.009576 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60344f4-4c55-49a4-a3ca-a13517b80860 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:34.010884 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f380fe0-7ede-465d-800d-94bdc76befdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:34.011314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60344f4-4c55-49a4-a3ca-a13517b80860 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:34.012316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f380fe0-7ede-465d-800d-94bdc76befdd None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:34.018658 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 322/652] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 13 13:59:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:34.019792 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a168e-56ec-42fb-a45b-5c215f9fb02b None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:34.020077 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a168e-56ec-42fb-a45b-5c215f9fb02b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:34.020343 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a168e-56ec-42fb-a45b-5c215f9fb02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:34.026543 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:34.038701 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-9e5a168e-56ec-42fb-a45b-5c215f9fb02b None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:34.039878 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-9e5a168e-56ec-42fb-a45b-5c215f9fb02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:34.121194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 323/653] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:34.121194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a168e-56ec-42fb-a45b-5c215f9fb02b None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:34.121836 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 331/654] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:59:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:59:34.121836 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f380fe0-7ede-465d-800d-94bdc76befdd None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:34.182481 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:34.215011 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f380fe0-7ede-465d-800d-94bdc76befdd None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:34.229301 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:34.231739 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a168e-56ec-42fb-a45b-5c215f9fb02b None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:34.254633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b9e53-8d43-4b8a-b52f-2fca923acc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:34.255401 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b9e53-8d43-4b8a-b52f-2fca923acc7f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:34.255690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b9e53-8d43-4b8a-b52f-2fca923acc7f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:34.255949 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b9e53-8d43-4b8a-b52f-2fca923acc7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:34.256669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b9e53-8d43-4b8a-b52f-2fca923acc7f None admin] RBAC: Adding query filter params (role.id=0c389f21d4434ae0a32fc453a8f2050a, scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086, user.id=22959df6ef034036b5f6b3cda7918e24) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:34.256977 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b9e53-8d43-4b8a-b52f-2fca923acc7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:34.258461 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b9e53-8d43-4b8a-b52f-2fca923acc7f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:34.264189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 332/655] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:59:34 2022] GET /identity/v3/role_assignments?user.id=22959df6ef034036b5f6b3cda7918e24&scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086&role.id=0c389f21d4434ae0a32fc453a8f2050a => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:34.264950 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b9e53-8d43-4b8a-b52f-2fca923acc7f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:34.281126 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504db6a2-3e00-4464-a95c-514dd4545806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:34.282381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504db6a2-3e00-4464-a95c-514dd4545806 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:34.283263 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504db6a2-3e00-4464-a95c-514dd4545806 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:34.283738 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504db6a2-3e00-4464-a95c-514dd4545806 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:34.293134 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504db6a2-3e00-4464-a95c-514dd4545806 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:34.295003 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504db6a2-3e00-4464-a95c-514dd4545806 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:34.309524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-504db6a2-3e00-4464-a95c-514dd4545806 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 13:59:34.309524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:34.309524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:34.309524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:34.309524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:34.309524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:34.309524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:34.309524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:34.309524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:34.309524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:34.309524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:34.309524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:34.309524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 13:59:34.309524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 13:59:34.309524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 13:59:34.309524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 13:59:34.310530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:34.310530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:34.310530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 13:59:34.310530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:34.310530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 13:59:34.310530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:34.310530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:34.310530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:34.310530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:34.310530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:34.310530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:34.310530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:34.310530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:34.310530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:34.310530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:34.310530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:34.310530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:34.310530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:34.311464 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:34.311464 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:34.311464 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 13:59:34.311464 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 13:59:34.311464 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 13:59:34.311464 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 13:59:34.311464 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 13:59:34.311464 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 13:59:34.311464 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 13:59:34.311464 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:34.319358 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 324/656] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:59:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:34.320700 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504db6a2-3e00-4464-a95c-514dd4545806 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:34.395567 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b9e53-8d43-4b8a-b52f-2fca923acc7f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:34.439941 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325415a4-399d-4345-839a-2a84dfd08b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:34.440680 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325415a4-399d-4345-839a-2a84dfd08b01 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:34.441053 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325415a4-399d-4345-839a-2a84dfd08b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:34.441463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325415a4-399d-4345-839a-2a84dfd08b01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:34.451458 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504db6a2-3e00-4464-a95c-514dd4545806 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:34.456738 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325415a4-399d-4345-839a-2a84dfd08b01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:34.458401 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325415a4-399d-4345-839a-2a84dfd08b01 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:34.470315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:34.475368 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-325415a4-399d-4345-839a-2a84dfd08b01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:34.475368 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:34.475368 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:34.475368 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:34.475368 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:34.475368 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:34.475368 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:34.475368 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:34.475368 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:34.475368 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:34.475368 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:34.475368 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:34.475368 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:34.475368 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:34.475368 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:34.475368 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:34.476324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:34.476324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:34.476324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:34.476324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:34.476324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:34.476324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:34.476324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:34.476324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:34.476324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:34.476324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:34.476324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:34.476324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:34.476324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:34.476324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:34.476324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:34.476324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:34.476324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:34.477359 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:34.477359 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:34.477359 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:34.477359 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 333/657] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:34.477359 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325415a4-399d-4345-839a-2a84dfd08b01 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:34.494714 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f0afe-3b4a-4053-b2a0-acde535bda1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:34.495575 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f0afe-3b4a-4053-b2a0-acde535bda1f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:34.496029 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f0afe-3b4a-4053-b2a0-acde535bda1f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:34.496305 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f0afe-3b4a-4053-b2a0-acde535bda1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:34.508633 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f0afe-3b4a-4053-b2a0-acde535bda1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:34.510021 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:34.510508 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f0afe-3b4a-4053-b2a0-acde535bda1f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:34.526900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-541f0afe-3b4a-4053-b2a0-acde535bda1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:34.526900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:34.526900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:34.526900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:34.526900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:34.526900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:34.526900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:34.526900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:34.526900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:34.526900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:34.526900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:34.526900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:34.526900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:34.526900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:34.526900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:34.526900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:34.532373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:34.532373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:34.532373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:34.532373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:34.532373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:34.532373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:34.532373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:34.532373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:34.532373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:34.532373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:34.532373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:34.532373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:34.532373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:34.532373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:34.532373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:34.532373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:34.532373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:34.533697 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:34.533697 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:34.533697 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:34.533697 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 325/658] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:34.533697 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f0afe-3b4a-4053-b2a0-acde535bda1f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:34.599849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325415a4-399d-4345-839a-2a84dfd08b01 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:34.640206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a31c9-66e9-4310-9a6c-483f529213dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:34.640802 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a31c9-66e9-4310-9a6c-483f529213dd None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:34.641084 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a31c9-66e9-4310-9a6c-483f529213dd None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:34.641380 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a31c9-66e9-4310-9a6c-483f529213dd None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:34.642126 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a31c9-66e9-4310-9a6c-483f529213dd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:34.642431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a31c9-66e9-4310-9a6c-483f529213dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:34.643879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a31c9-66e9-4310-9a6c-483f529213dd None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:34.644516 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f0afe-3b4a-4053-b2a0-acde535bda1f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:34.666847 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 334/659] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Sep 13 13:59:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:34.666847 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a31c9-66e9-4310-9a6c-483f529213dd None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:34.687970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f313e-b537-40a0-b69b-5fe57d4a9c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:34.688699 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f313e-b537-40a0-b69b-5fe57d4a9c1f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:34.689203 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f313e-b537-40a0-b69b-5fe57d4a9c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:34.689602 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f313e-b537-40a0-b69b-5fe57d4a9c1f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:34.702246 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f313e-b537-40a0-b69b-5fe57d4a9c1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:34.708589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-4a3f313e-b537-40a0-b69b-5fe57d4a9c1f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:34.708589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:34.708589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:34.708589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:34.708589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:34.708589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:34.708589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:34.708589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:34.708589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:34.708589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:34.708589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:34.708589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:34.708589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:34.708589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:34.708589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:34.708589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:34.709779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:34.709779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:34.709779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:34.709779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:34.709779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:34.709779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:34.709779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:34.709779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:34.709779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:34.709779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:34.709779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:34.709779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:34.709779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:34.709779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:34.709779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:34.709779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:34.710747 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:34.710747 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:34.710747 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:34.710747 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:34.710747 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:34.710747 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:34.710747 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:34.710747 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:34.710747 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:34.710747 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:34.710747 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:34.710747 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:34.710747 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 326/660] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 13 13:59:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:34.712590 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f313e-b537-40a0-b69b-5fe57d4a9c1f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:34.744371 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:34.760606 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:34.776702 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a31c9-66e9-4310-9a6c-483f529213dd None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:34.813680 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ca784-666b-4598-a32c-fe70b1cb12e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:34.814373 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ca784-666b-4598-a32c-fe70b1cb12e0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:34.814724 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ca784-666b-4598-a32c-fe70b1cb12e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:34.815055 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ca784-666b-4598-a32c-fe70b1cb12e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:34.815692 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ca784-666b-4598-a32c-fe70b1cb12e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:34.815992 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ca784-666b-4598-a32c-fe70b1cb12e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:34.817449 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ca784-666b-4598-a32c-fe70b1cb12e0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:34.828033 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f313e-b537-40a0-b69b-5fe57d4a9c1f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:34.833144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 335/661] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:34.833144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ca784-666b-4598-a32c-fe70b1cb12e0 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:34.871218 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24c9b6-813c-4f04-9b0c-614a24fab0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:34.871825 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24c9b6-813c-4f04-9b0c-614a24fab0fe None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:34.872106 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24c9b6-813c-4f04-9b0c-614a24fab0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:34.872376 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24c9b6-813c-4f04-9b0c-614a24fab0fe None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:34.873482 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24c9b6-813c-4f04-9b0c-614a24fab0fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:34.873790 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24c9b6-813c-4f04-9b0c-614a24fab0fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:34.875525 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24c9b6-813c-4f04-9b0c-614a24fab0fe None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:34.892152 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 327/662] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:34.892152 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24c9b6-813c-4f04-9b0c-614a24fab0fe None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:34.939278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ca784-666b-4598-a32c-fe70b1cb12e0 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:34.974832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad5cf5-375f-4ee4-be8e-d322a32c3094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:34.975433 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad5cf5-375f-4ee4-be8e-d322a32c3094 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:34.975846 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad5cf5-375f-4ee4-be8e-d322a32c3094 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:34.976098 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad5cf5-375f-4ee4-be8e-d322a32c3094 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:34.985356 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:34.995835 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:34.998630 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24c9b6-813c-4f04-9b0c-614a24fab0fe None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:35.033400 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cd397-4fa1-4f96-bb88-405ca13b7fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:35.034294 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cd397-4fa1-4f96-bb88-405ca13b7fda None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:35.034578 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cd397-4fa1-4f96-bb88-405ca13b7fda None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:35.034844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cd397-4fa1-4f96-bb88-405ca13b7fda None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:35.036056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1cd397-4fa1-4f96-bb88-405ca13b7fda None admin] RBAC: Adding query filter params (name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:35.036354 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1cd397-4fa1-4f96-bb88-405ca13b7fda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:35.038176 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1cd397-4fa1-4f96-bb88-405ca13b7fda None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:35.046511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 328/663] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 13 13:59:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:35.050022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cd397-4fa1-4f96-bb88-405ca13b7fda None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:35.055443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad5cf5-375f-4ee4-be8e-d322a32c3094 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:35.056964 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad5cf5-375f-4ee4-be8e-d322a32c3094 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:35.152781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cd397-4fa1-4f96-bb88-405ca13b7fda None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:35.165455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 336/664] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:59:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:59:35.165455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad5cf5-375f-4ee4-be8e-d322a32c3094 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:35.192911 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47aca9-9de8-4282-8a8b-f2a75f8134ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:35.193603 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47aca9-9de8-4282-8a8b-f2a75f8134ca None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:35.193954 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47aca9-9de8-4282-8a8b-f2a75f8134ca None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:35.194289 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47aca9-9de8-4282-8a8b-f2a75f8134ca None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:35.201769 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47aca9-9de8-4282-8a8b-f2a75f8134ca None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:35.203273 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47aca9-9de8-4282-8a8b-f2a75f8134ca None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:35.209769 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:35.215470 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-8e47aca9-9de8-4282-8a8b-f2a75f8134ca None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 13:59:35.215470 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:35.215470 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:35.215470 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:35.215470 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:35.215470 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:35.215470 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:35.215470 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:35.215470 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:35.215470 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:35.215470 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:35.215470 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:35.215470 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 13:59:35.215470 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 13:59:35.215470 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 13:59:35.215470 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 13:59:35.216601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:35.216601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:35.216601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 13:59:35.216601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:35.216601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 13:59:35.216601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:35.216601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:35.216601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:35.216601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:35.216601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:35.216601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:35.216601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:35.216601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:35.216601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:35.216601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:35.216601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:35.216601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:35.216601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:35.217812 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:35.217812 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:35.217812 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 13:59:35.217812 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 13:59:35.217812 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 13:59:35.217812 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 13:59:35.217812 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 13:59:35.217812 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 13:59:35.217812 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 13:59:35.217812 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:35.218791 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 329/665] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 13 13:59:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:35.219639 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47aca9-9de8-4282-8a8b-f2a75f8134ca None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:35.232745 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:35.274612 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad5cf5-375f-4ee4-be8e-d322a32c3094 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:35.310296 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74398bdf-e3db-4652-b427-81aec5421792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:35.310911 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74398bdf-e3db-4652-b427-81aec5421792 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:35.311183 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74398bdf-e3db-4652-b427-81aec5421792 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:35.311449 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74398bdf-e3db-4652-b427-81aec5421792 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:35.318037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74398bdf-e3db-4652-b427-81aec5421792 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:35.319459 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74398bdf-e3db-4652-b427-81aec5421792 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:35.326662 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47aca9-9de8-4282-8a8b-f2a75f8134ca None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:35.332853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-74398bdf-e3db-4652-b427-81aec5421792 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:35.332853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:35.332853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:35.332853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:35.332853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:35.332853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:35.332853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:35.332853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:35.332853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:35.332853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:35.332853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:35.332853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:35.332853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 13:59:35.332853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 13:59:35.332853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 13:59:35.333903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 13:59:35.333903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:35.333903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:35.333903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:35.333903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:35.333903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:35.333903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:35.333903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:35.333903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:35.333903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:35.333903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:35.333903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:35.333903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:35.333903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:35.333903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:35.333903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:35.333903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:35.334788 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 13:59:35.334788 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 13:59:35.334788 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 13:59:35.334788 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 13:59:35.334788 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 13:59:35.334788 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 13:59:35.334788 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:35.334788 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:35.338726 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 337/666] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:35.339341 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74398bdf-e3db-4652-b427-81aec5421792 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:35.366190 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a00ac0-7c55-4c79-a409-8a389a8f69b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:35.366804 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a00ac0-7c55-4c79-a409-8a389a8f69b1 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:35.367074 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a00ac0-7c55-4c79-a409-8a389a8f69b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:35.367340 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a00ac0-7c55-4c79-a409-8a389a8f69b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:35.378627 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a00ac0-7c55-4c79-a409-8a389a8f69b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:35.380264 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a00ac0-7c55-4c79-a409-8a389a8f69b1 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:35.395757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-83a00ac0-7c55-4c79-a409-8a389a8f69b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:35.395757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:35.395757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:35.395757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:35.395757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:35.395757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:35.395757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:35.395757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:35.395757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:35.395757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:35.395757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:35.395757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:35.395757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:35.395757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:35.395757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:35.395757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:35.396874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:35.396874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:35.396874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:35.396874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:35.396874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:35.396874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:35.396874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:35.396874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:35.396874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:35.396874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:35.396874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:35.396874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:35.396874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:35.396874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:35.396874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:35.396874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:35.396874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:35.398079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:35.398079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:35.398079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:35.398079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 330/667] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:35.398079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a00ac0-7c55-4c79-a409-8a389a8f69b1 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:35.444914 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74398bdf-e3db-4652-b427-81aec5421792 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:35.451724 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:35.464852 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:35.482102 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557cf73-8eeb-4241-8237-4798d1e61f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:35.482725 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557cf73-8eeb-4241-8237-4798d1e61f3a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:35.482999 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557cf73-8eeb-4241-8237-4798d1e61f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:35.483271 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557cf73-8eeb-4241-8237-4798d1e61f3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:35.493939 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557cf73-8eeb-4241-8237-4798d1e61f3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:35.495381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557cf73-8eeb-4241-8237-4798d1e61f3a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:35.508331 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a00ac0-7c55-4c79-a409-8a389a8f69b1 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:35.509698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-b557cf73-8eeb-4241-8237-4798d1e61f3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:35.509698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:35.509698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:35.509698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:35.509698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:35.509698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:35.509698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:35.509698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:35.509698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:35.509698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:35.509698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:35.509698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:35.509698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:35.509698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:35.509698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:35.509698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:35.516146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:35.516146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:35.516146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:35.516146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:35.516146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:35.516146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:35.516146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:35.516146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:35.516146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:35.516146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:35.516146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:35.516146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:35.516146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:35.516146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:35.516146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:35.516146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:35.516146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:35.517306 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:35.517306 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:35.517306 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:35.517306 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 338/668] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:35.517306 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557cf73-8eeb-4241-8237-4798d1e61f3a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:35.553348 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe783d8-7f3d-4d06-b408-de49d98bd892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:35.554038 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe783d8-7f3d-4d06-b408-de49d98bd892 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:35.554384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe783d8-7f3d-4d06-b408-de49d98bd892 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:35.554724 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe783d8-7f3d-4d06-b408-de49d98bd892 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:35.555523 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe783d8-7f3d-4d06-b408-de49d98bd892 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:35.555968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe783d8-7f3d-4d06-b408-de49d98bd892 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:35.557353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe783d8-7f3d-4d06-b408-de49d98bd892 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:35.576967 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 331/669] 10.222.0.26 () {56 vars in 1139 bytes} [Tue Sep 13 13:59:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:35.578184 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe783d8-7f3d-4d06-b408-de49d98bd892 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:35.629420 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557cf73-8eeb-4241-8237-4798d1e61f3a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:35.675360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9ae36-e4ee-42ce-9e86-591b26fdbb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:35.676914 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9ae36-e4ee-42ce-9e86-591b26fdbb90 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:35.677234 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9ae36-e4ee-42ce-9e86-591b26fdbb90 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:35.677515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9ae36-e4ee-42ce-9e86-591b26fdbb90 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:35.678483 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f9ae36-e4ee-42ce-9e86-591b26fdbb90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:35.678792 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f9ae36-e4ee-42ce-9e86-591b26fdbb90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:35.681064 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f9ae36-e4ee-42ce-9e86-591b26fdbb90 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:35.685998 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe783d8-7f3d-4d06-b408-de49d98bd892 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:35.700935 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 339/670] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 13:59:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:35.700935 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9ae36-e4ee-42ce-9e86-591b26fdbb90 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:35.706698 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:35.720848 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904529e1-6159-4732-93e2-4b09112efa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:35.721619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904529e1-6159-4732-93e2-4b09112efa2a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:35.722140 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904529e1-6159-4732-93e2-4b09112efa2a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:35.722524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904529e1-6159-4732-93e2-4b09112efa2a None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:35.723453 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:35.724434 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904529e1-6159-4732-93e2-4b09112efa2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:35.724907 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904529e1-6159-4732-93e2-4b09112efa2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:35.726606 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904529e1-6159-4732-93e2-4b09112efa2a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:35.743035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 332/671] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:35.743035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904529e1-6159-4732-93e2-4b09112efa2a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:35.809284 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9ae36-e4ee-42ce-9e86-591b26fdbb90 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:35.845770 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904529e1-6159-4732-93e2-4b09112efa2a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:35.846677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89ac0e-1798-4801-892e-983c751c4776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:35.847375 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89ac0e-1798-4801-892e-983c751c4776 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:35.848236 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89ac0e-1798-4801-892e-983c751c4776 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:35.848573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89ac0e-1798-4801-892e-983c751c4776 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:35.849324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a89ac0e-1798-4801-892e-983c751c4776 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:35.849696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a89ac0e-1798-4801-892e-983c751c4776 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:35.851141 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a89ac0e-1798-4801-892e-983c751c4776 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:35.868896 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 340/672] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:35.869814 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89ac0e-1798-4801-892e-983c751c4776 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:35.880016 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6be84-8419-428b-97d4-605e4ff04dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:35.880684 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6be84-8419-428b-97d4-605e4ff04dab None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:35.881035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6be84-8419-428b-97d4-605e4ff04dab None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:35.881379 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6be84-8419-428b-97d4-605e4ff04dab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:35.929464 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:35.950149 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6be84-8419-428b-97d4-605e4ff04dab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:35.951646 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6be84-8419-428b-97d4-605e4ff04dab None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:35.955249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:35.978830 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89ac0e-1798-4801-892e-983c751c4776 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:36.015049 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cdc3d-a5f5-4510-853a-62996f8285ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:36.015890 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cdc3d-a5f5-4510-853a-62996f8285ce None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:36.016385 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cdc3d-a5f5-4510-853a-62996f8285ce None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:36.016829 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cdc3d-a5f5-4510-853a-62996f8285ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:36.017898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50cdc3d-a5f5-4510-853a-62996f8285ce None admin] RBAC: Adding query filter params (role.id=0c389f21d4434ae0a32fc453a8f2050a, scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086, user.id=1b3533d0a24e4e7bbf5c7137d3511b13) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:36.018354 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50cdc3d-a5f5-4510-853a-62996f8285ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:36.020590 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50cdc3d-a5f5-4510-853a-62996f8285ce None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:36.026765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 341/673] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:59:35 2022] GET /identity/v3/role_assignments?user.id=1b3533d0a24e4e7bbf5c7137d3511b13&scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086&role.id=0c389f21d4434ae0a32fc453a8f2050a => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:36.027841 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cdc3d-a5f5-4510-853a-62996f8285ce None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:36.072621 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 333/674] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:59:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:59:36.073764 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6be84-8419-428b-97d4-605e4ff04dab None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:36.150124 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cdc3d-a5f5-4510-853a-62996f8285ce None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:36.188224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:36.194815 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be8489-6c94-42d1-b320-ce59a4c2a59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:36.195828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be8489-6c94-42d1-b320-ce59a4c2a59f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:36.196300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be8489-6c94-42d1-b320-ce59a4c2a59f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:36.196749 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be8489-6c94-42d1-b320-ce59a4c2a59f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:36.206444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be8489-6c94-42d1-b320-ce59a4c2a59f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:36.208994 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be8489-6c94-42d1-b320-ce59a4c2a59f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:36.214079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6be84-8419-428b-97d4-605e4ff04dab None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:36.223477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-99be8489-6c94-42d1-b320-ce59a4c2a59f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 13:59:36.223477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:36.223477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:36.223477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:36.223477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:36.223477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:36.223477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:36.223477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:36.223477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:36.223477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:36.223477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:36.223477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:36.223477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 13:59:36.223477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 13:59:36.223477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 13:59:36.223477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 13:59:36.224637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:36.224637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:36.224637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 13:59:36.224637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:36.224637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 13:59:36.224637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:36.224637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:36.224637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:36.224637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:36.224637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:36.224637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:36.224637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:36.224637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:36.224637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:36.224637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:36.224637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:36.224637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:36.224637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:36.225625 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:36.225625 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:36.225625 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 13:59:36.225625 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 13:59:36.225625 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 13:59:36.225625 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 13:59:36.225625 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 13:59:36.225625 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 13:59:36.225625 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 13:59:36.225625 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:36.225625 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 342/675] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 13:59:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:36.225625 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be8489-6c94-42d1-b320-ce59a4c2a59f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:36.230786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:36.262475 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f2b96-8cb2-4417-a118-1ef588ce83ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:36.263359 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f2b96-8cb2-4417-a118-1ef588ce83ac None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:36.263775 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f2b96-8cb2-4417-a118-1ef588ce83ac None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:36.264184 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f2b96-8cb2-4417-a118-1ef588ce83ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:36.272669 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f2b96-8cb2-4417-a118-1ef588ce83ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:36.274820 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f2b96-8cb2-4417-a118-1ef588ce83ac None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:36.289961 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-2e9f2b96-8cb2-4417-a118-1ef588ce83ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:36.289961 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:36.289961 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:36.289961 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:36.289961 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:36.289961 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:36.289961 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:36.289961 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:36.289961 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:36.289961 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:36.289961 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:36.289961 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:36.289961 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 13:59:36.289961 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 13:59:36.289961 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 13:59:36.290880 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 13:59:36.290880 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:36.290880 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:36.290880 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:36.290880 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:36.290880 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:36.290880 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:36.290880 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:36.290880 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:36.290880 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:36.290880 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:36.290880 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:36.290880 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:36.290880 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:36.290880 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:36.290880 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:36.290880 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:36.291772 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 13:59:36.291772 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 13:59:36.291772 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 13:59:36.291772 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 13:59:36.291772 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 13:59:36.291772 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 13:59:36.291772 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:36.291772 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:36.291772 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 334/676] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:36.291772 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f2b96-8cb2-4417-a118-1ef588ce83ac None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:36.362234 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be8489-6c94-42d1-b320-ce59a4c2a59f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:36.399689 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6427c2-9cd2-44df-a2b6-3eb0fed00481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:36.400460 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6427c2-9cd2-44df-a2b6-3eb0fed00481 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:36.400744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6427c2-9cd2-44df-a2b6-3eb0fed00481 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:36.401014 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6427c2-9cd2-44df-a2b6-3eb0fed00481 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:36.406777 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f2b96-8cb2-4417-a118-1ef588ce83ac None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:36.414430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6427c2-9cd2-44df-a2b6-3eb0fed00481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:36.416034 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6427c2-9cd2-44df-a2b6-3eb0fed00481 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:36.433444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-cf6427c2-9cd2-44df-a2b6-3eb0fed00481 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:36.433444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:36.433444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:36.433444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:36.433444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:36.433444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:36.433444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:36.433444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:36.433444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:36.433444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:36.433444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:36.433444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:36.433444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:36.433444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:36.433444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:36.433444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:36.434458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:36.434458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:36.434458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:36.434458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:36.434458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:36.434458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:36.434458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:36.434458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:36.434458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:36.434458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:36.434458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:36.434458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:36.434458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:36.434458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:36.434458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:36.434458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:36.434458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:36.435318 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:36.435318 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:36.435318 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:36.435318 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 343/677] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:36.435936 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6427c2-9cd2-44df-a2b6-3eb0fed00481 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:36.451704 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51726b6e-b460-4b88-9dac-93539a6f27cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:36.452691 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51726b6e-b460-4b88-9dac-93539a6f27cb None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:36.453133 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51726b6e-b460-4b88-9dac-93539a6f27cb None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:36.453569 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51726b6e-b460-4b88-9dac-93539a6f27cb None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:36.454599 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51726b6e-b460-4b88-9dac-93539a6f27cb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:36.455343 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51726b6e-b460-4b88-9dac-93539a6f27cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:36.458037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51726b6e-b460-4b88-9dac-93539a6f27cb None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:36.469224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:36.480664 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 335/678] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Sep 13 13:59:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:36.481610 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51726b6e-b460-4b88-9dac-93539a6f27cb None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:36.503621 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:36.565083 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6427c2-9cd2-44df-a2b6-3eb0fed00481 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:36.596353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51726b6e-b460-4b88-9dac-93539a6f27cb None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:36.600594 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71199a0b-db8a-47c6-85e3-1a38870449dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:36.601221 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71199a0b-db8a-47c6-85e3-1a38870449dc None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:36.601497 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71199a0b-db8a-47c6-85e3-1a38870449dc None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:36.601762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71199a0b-db8a-47c6-85e3-1a38870449dc None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:36.602440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71199a0b-db8a-47c6-85e3-1a38870449dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:36.602739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71199a0b-db8a-47c6-85e3-1a38870449dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:36.604166 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71199a0b-db8a-47c6-85e3-1a38870449dc None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:36.624605 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 344/679] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 13:59:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:36.624605 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71199a0b-db8a-47c6-85e3-1a38870449dc None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:36.636722 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b304d-c89a-4321-865d-fada666af231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:36.637350 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b304d-c89a-4321-865d-fada666af231 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:36.637624 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b304d-c89a-4321-865d-fada666af231 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:36.637881 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b304d-c89a-4321-865d-fada666af231 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:36.638931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b304d-c89a-4321-865d-fada666af231 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:36.639231 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b304d-c89a-4321-865d-fada666af231 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:36.640932 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b304d-c89a-4321-865d-fada666af231 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:36.659114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 336/680] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:36.659114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b710e7-9ea4-4ba6-a79d-5bafa808f55b None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:36.659114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b710e7-9ea4-4ba6-a79d-5bafa808f55b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:36.659114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b710e7-9ea4-4ba6-a79d-5bafa808f55b None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:36.659114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 337/681] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:36.659114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b710e7-9ea4-4ba6-a79d-5bafa808f55b None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:36.725468 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:36.748459 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71199a0b-db8a-47c6-85e3-1a38870449dc None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:36.766187 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:36.773895 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b710e7-9ea4-4ba6-a79d-5bafa808f55b None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:36.790658 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdbfee-aea5-42d2-ad3f-288822289c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:36.791284 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdbfee-aea5-42d2-ad3f-288822289c97 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:36.791534 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdbfee-aea5-42d2-ad3f-288822289c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:36.791799 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdbfee-aea5-42d2-ad3f-288822289c97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:36.810404 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f9a23-32c6-44e2-932c-60b471b26d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:36.811335 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f9a23-32c6-44e2-932c-60b471b26d43 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:36.811613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f9a23-32c6-44e2-932c-60b471b26d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:36.811882 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f9a23-32c6-44e2-932c-60b471b26d43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:36.812606 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f9a23-32c6-44e2-932c-60b471b26d43 None admin] RBAC: Adding query filter params (role.id=0c389f21d4434ae0a32fc453a8f2050a, scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086, user.id=052d3a21bd3c48c89dcc38ec1444d39a) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:36.812911 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f9a23-32c6-44e2-932c-60b471b26d43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:36.814390 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f9a23-32c6-44e2-932c-60b471b26d43 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:36.820538 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 338/682] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:59:36 2022] GET /identity/v3/role_assignments?user.id=052d3a21bd3c48c89dcc38ec1444d39a&scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086&role.id=0c389f21d4434ae0a32fc453a8f2050a => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:36.821340 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f9a23-32c6-44e2-932c-60b471b26d43 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:36.886590 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cdbfee-aea5-42d2-ad3f-288822289c97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:36.888754 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cdbfee-aea5-42d2-ad3f-288822289c97 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:36.953903 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f9a23-32c6-44e2-932c-60b471b26d43 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:36.983698 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:37.000963 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64937ac-3b0d-429c-8334-01f937575304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:37.002260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64937ac-3b0d-429c-8334-01f937575304 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:37.002726 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64937ac-3b0d-429c-8334-01f937575304 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:37.003211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64937ac-3b0d-429c-8334-01f937575304 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:37.013244 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64937ac-3b0d-429c-8334-01f937575304 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:37.015953 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64937ac-3b0d-429c-8334-01f937575304 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:37.029700 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-b64937ac-3b0d-429c-8334-01f937575304 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:37.029700 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:37.029700 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:37.029700 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:37.029700 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:37.029700 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:37.029700 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:37.029700 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:37.029700 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:37.029700 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:37.029700 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:37.029700 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:37.029700 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 13:59:37.029700 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 13:59:37.029700 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 13:59:37.030615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 13:59:37.030615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:37.030615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:37.030615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:37.030615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:37.030615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:37.030615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:37.030615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:37.030615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:37.030615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:37.030615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:37.030615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:37.030615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:37.030615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:37.030615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:37.030615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:37.030615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:37.031517 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 13:59:37.031517 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 13:59:37.031517 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 13:59:37.031517 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 13:59:37.031517 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 13:59:37.031517 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 13:59:37.031517 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:37.031517 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:37.031517 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 339/683] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:37.032469 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12622ad9-a1e0-45ab-b6a9-a60f7ce8e5c6 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:37.032469 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12622ad9-a1e0-45ab-b6a9-a60f7ce8e5c6 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:37.032881 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12622ad9-a1e0-45ab-b6a9-a60f7ce8e5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:37.033978 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 345/684] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:59:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:59:37.039129 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdbfee-aea5-42d2-ad3f-288822289c97 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:37.057919 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-12622ad9-a1e0-45ab-b6a9-a60f7ce8e5c6 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:37.058516 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-12622ad9-a1e0-45ab-b6a9-a60f7ce8e5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:37.064911 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:37.152676 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 340/685] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:37.153577 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12622ad9-a1e0-45ab-b6a9-a60f7ce8e5c6 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:37.178904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdbfee-aea5-42d2-ad3f-288822289c97 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:37.252897 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9effd8-802f-4c84-9a56-76a6aa8b1c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:37.253459 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9effd8-802f-4c84-9a56-76a6aa8b1c1e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:37.254263 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9effd8-802f-4c84-9a56-76a6aa8b1c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:37.254646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9effd8-802f-4c84-9a56-76a6aa8b1c1e None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:37.255446 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9effd8-802f-4c84-9a56-76a6aa8b1c1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:37.255755 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9effd8-802f-4c84-9a56-76a6aa8b1c1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:37.257250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9effd8-802f-4c84-9a56-76a6aa8b1c1e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:37.264416 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12622ad9-a1e0-45ab-b6a9-a60f7ce8e5c6 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:37.280141 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:37.286203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 346/686] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 13:59:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:37.301631 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9effd8-802f-4c84-9a56-76a6aa8b1c1e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:37.308880 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190314b-8f0b-4ccc-8c43-6a4333564c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:37.309554 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190314b-8f0b-4ccc-8c43-6a4333564c0e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:37.309834 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190314b-8f0b-4ccc-8c43-6a4333564c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:37.310156 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190314b-8f0b-4ccc-8c43-6a4333564c0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:37.321201 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190314b-8f0b-4ccc-8c43-6a4333564c0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:37.322832 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190314b-8f0b-4ccc-8c43-6a4333564c0e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:37.339105 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-9190314b-8f0b-4ccc-8c43-6a4333564c0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:37.339105 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:37.339105 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:37.339105 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:37.339105 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:37.339105 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:37.339105 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:37.339105 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:37.339105 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:37.339105 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:37.339105 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:37.339105 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:37.339105 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:37.339105 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:37.339105 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:37.339105 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:37.340047 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:37.340047 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:37.340047 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:37.340047 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:37.340047 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:37.340047 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:37.340047 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:37.340047 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:37.340047 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:37.340047 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:37.340047 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:37.340047 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:37.340047 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:37.340047 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:37.340047 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:37.340047 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:37.340047 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:37.340936 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:37.340936 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:37.340936 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:37.340936 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 341/687] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:37.352617 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190314b-8f0b-4ccc-8c43-6a4333564c0e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:37.442763 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:37.486265 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9effd8-802f-4c84-9a56-76a6aa8b1c1e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:37.506463 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190314b-8f0b-4ccc-8c43-6a4333564c0e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:37.526098 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6627b-c96f-465a-8252-a4092dc14318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:37.527040 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6627b-c96f-465a-8252-a4092dc14318 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:37.527825 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6627b-c96f-465a-8252-a4092dc14318 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:37.528292 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6627b-c96f-465a-8252-a4092dc14318 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:37.529569 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e6627b-c96f-465a-8252-a4092dc14318 None admin] RBAC: Adding query filter params (role.id=0c389f21d4434ae0a32fc453a8f2050a, scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086, user.id=cb992cf1a7a445119262b567ce345181) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:37.530441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e6627b-c96f-465a-8252-a4092dc14318 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:37.532089 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e6627b-c96f-465a-8252-a4092dc14318 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:37.539974 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 347/688] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:59:37 2022] GET /identity/v3/role_assignments?user.id=cb992cf1a7a445119262b567ce345181&scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086&role.id=0c389f21d4434ae0a32fc453a8f2050a => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:37.557435 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e42d0-bd2d-44f0-b12f-c5e53bfeea20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:37.558409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e42d0-bd2d-44f0-b12f-c5e53bfeea20 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:37.558878 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e42d0-bd2d-44f0-b12f-c5e53bfeea20 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:37.559349 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e42d0-bd2d-44f0-b12f-c5e53bfeea20 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:37.560252 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e42d0-bd2d-44f0-b12f-c5e53bfeea20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:37.560756 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e42d0-bd2d-44f0-b12f-c5e53bfeea20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:37.562349 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e42d0-bd2d-44f0-b12f-c5e53bfeea20 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:37.576300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 342/689] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:37.582905 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6627b-c96f-465a-8252-a4092dc14318 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:37.594456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e42d0-bd2d-44f0-b12f-c5e53bfeea20 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:37.623811 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:37.715047 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e42d0-bd2d-44f0-b12f-c5e53bfeea20 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:37.755405 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80dcfa-796f-463b-98a3-bc90f37c549d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:37.756404 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80dcfa-796f-463b-98a3-bc90f37c549d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:37.756995 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80dcfa-796f-463b-98a3-bc90f37c549d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:37.757442 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80dcfa-796f-463b-98a3-bc90f37c549d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:37.769948 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80dcfa-796f-463b-98a3-bc90f37c549d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:37.771659 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80dcfa-796f-463b-98a3-bc90f37c549d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:37.788376 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-4b80dcfa-796f-463b-98a3-bc90f37c549d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:37.788376 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:37.788376 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:37.788376 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:37.788376 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:37.788376 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:37.788376 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:37.788376 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:37.788376 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:37.788376 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:37.788376 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:37.788376 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:37.788376 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:37.788376 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:37.788376 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:37.788376 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:37.789559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:37.789559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:37.789559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:37.789559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:37.789559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:37.789559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:37.789559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:37.789559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:37.789559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:37.789559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:37.789559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:37.789559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:37.789559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:37.789559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:37.789559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:37.789559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:37.789559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:37.790657 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:37.790657 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:37.790657 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:37.790859 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6627b-c96f-465a-8252-a4092dc14318 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:37.792413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 343/690] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:37.798064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80dcfa-796f-463b-98a3-bc90f37c549d None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:37.836913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccf10e-4762-4777-aac7-6c063d92ca6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:37.838196 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccf10e-4762-4777-aac7-6c063d92ca6a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:37.838683 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccf10e-4762-4777-aac7-6c063d92ca6a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:37.839156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccf10e-4762-4777-aac7-6c063d92ca6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:37.847894 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fccf10e-4762-4777-aac7-6c063d92ca6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:37.849988 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fccf10e-4762-4777-aac7-6c063d92ca6a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:37.865018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-9fccf10e-4762-4777-aac7-6c063d92ca6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:37.865018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:37.865018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:37.865018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:37.865018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:37.865018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:37.865018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:37.865018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:37.865018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:37.865018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:37.865018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:37.865018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:37.865018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 13:59:37.865018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 13:59:37.865018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 13:59:37.865919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 13:59:37.865919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:37.865919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:37.865919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:37.865919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:37.865919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:37.865919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:37.865919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:37.865919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:37.865919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:37.865919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:37.865919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:37.865919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:37.865919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:37.865919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:37.865919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:37.865919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:37.866887 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 13:59:37.866887 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 13:59:37.866887 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 13:59:37.866887 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 13:59:37.866887 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 13:59:37.866887 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 13:59:37.866887 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:37.866887 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:37.869519 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 348/691] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:37.873146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:37.875210 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccf10e-4762-4777-aac7-6c063d92ca6a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:37.894879 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:37.927990 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80dcfa-796f-463b-98a3-bc90f37c549d None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:37.968279 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15876e6e-c085-4a58-9485-28cf02575bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:37.968887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15876e6e-c085-4a58-9485-28cf02575bfd None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:37.969196 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15876e6e-c085-4a58-9485-28cf02575bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:37.969468 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15876e6e-c085-4a58-9485-28cf02575bfd None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:37.970108 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15876e6e-c085-4a58-9485-28cf02575bfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:37.970407 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15876e6e-c085-4a58-9485-28cf02575bfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:37.972139 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15876e6e-c085-4a58-9485-28cf02575bfd None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:37.989849 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 344/692] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:37.995729 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15876e6e-c085-4a58-9485-28cf02575bfd None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:38.002733 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccf10e-4762-4777-aac7-6c063d92ca6a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:38.060355 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7d5ba-4e0e-4a98-abc0-35ffde60a8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:38.060884 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7d5ba-4e0e-4a98-abc0-35ffde60a8ee None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:38.061200 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7d5ba-4e0e-4a98-abc0-35ffde60a8ee None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:38.061475 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7d5ba-4e0e-4a98-abc0-35ffde60a8ee None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:38.062171 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7d5ba-4e0e-4a98-abc0-35ffde60a8ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:38.062471 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7d5ba-4e0e-4a98-abc0-35ffde60a8ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:38.063906 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7d5ba-4e0e-4a98-abc0-35ffde60a8ee None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:38.087103 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 349/693] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 13:59:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:38.094060 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7d5ba-4e0e-4a98-abc0-35ffde60a8ee None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:38.170528 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15876e6e-c085-4a58-9485-28cf02575bfd None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:38.200505 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:38.242094 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcad2f6-603e-4a51-b5cf-7d14596ee48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:38.242699 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcad2f6-603e-4a51-b5cf-7d14596ee48e None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:38.242973 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcad2f6-603e-4a51-b5cf-7d14596ee48e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:38.243238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcad2f6-603e-4a51-b5cf-7d14596ee48e None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:38.243886 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcad2f6-603e-4a51-b5cf-7d14596ee48e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:38.245332 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcad2f6-603e-4a51-b5cf-7d14596ee48e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:38.264217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:38.274589 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7d5ba-4e0e-4a98-abc0-35ffde60a8ee None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:38.295918 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 345/694] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 13 13:59:37 2022] POST /identity/v3/users => generated 254 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 13:59:38.313382 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb15ac7-ec07-41ac-84d1-1c3cc33061bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:38.314364 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb15ac7-ec07-41ac-84d1-1c3cc33061bb None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:38.314875 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb15ac7-ec07-41ac-84d1-1c3cc33061bb None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:38.315356 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb15ac7-ec07-41ac-84d1-1c3cc33061bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:38.316614 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb15ac7-ec07-41ac-84d1-1c3cc33061bb None admin] RBAC: Adding query filter params (role.id=0c389f21d4434ae0a32fc453a8f2050a, scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086, user.id=97c27e930f604bd38634ca08e56cf8cd) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:38.317171 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb15ac7-ec07-41ac-84d1-1c3cc33061bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:38.319139 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb15ac7-ec07-41ac-84d1-1c3cc33061bb None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:38.326243 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 350/695] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:59:38 2022] GET /identity/v3/role_assignments?user.id=97c27e930f604bd38634ca08e56cf8cd&scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086&role.id=0c389f21d4434ae0a32fc453a8f2050a => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:38.608156 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d60288-f871-4e21-a2f2-51fa55baae45 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:38.608493 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d60288-f871-4e21-a2f2-51fa55baae45 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:38.608666 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d60288-f871-4e21-a2f2-51fa55baae45 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:38.610291 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 346/696] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:38.619538 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170763c-20d2-45e7-99c2-648fb17db8a4 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:38.624883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170763c-20d2-45e7-99c2-648fb17db8a4 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:38.627129 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170763c-20d2-45e7-99c2-648fb17db8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:38.647832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-6170763c-20d2-45e7-99c2-648fb17db8a4 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:38.649041 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6170763c-20d2-45e7-99c2-648fb17db8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:38.730134 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 351/697] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:39.175574 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d60288-f871-4e21-a2f2-51fa55baae45 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:39.304066 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d60288-f871-4e21-a2f2-51fa55baae45 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:39.347350 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593c2c5-9502-4128-b727-e5baa036e026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:39.348004 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593c2c5-9502-4128-b727-e5baa036e026 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:39.348281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593c2c5-9502-4128-b727-e5baa036e026 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:39.348548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593c2c5-9502-4128-b727-e5baa036e026 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:39.360134 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2593c2c5-9502-4128-b727-e5baa036e026 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:39.367536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-2593c2c5-9502-4128-b727-e5baa036e026 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:59:39.367536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:39.367536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:39.367536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:39.367536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:39.367536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:39.367536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:39.367536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:39.367536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:39.367536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:39.367536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:39.367536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:39.367536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:39.367536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:39.367536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:39.367536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:39.368450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:39.368450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:39.368450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:39.368450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:39.368450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:39.368450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:39.368450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:39.368450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:39.368450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:39.368450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:39.368450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:39.368450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:39.368450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:39.368450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:39.368450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:39.368450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:39.369318 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:39.369318 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:39.369318 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:39.369318 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:39.369318 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:39.369318 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:39.369318 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:39.369318 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:39.369318 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:39.369318 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:39.369318 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:59:39.369318 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:39.369318 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 347/698] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 13:59:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:39.374525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170763c-20d2-45e7-99c2-648fb17db8a4 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:39.452658 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:39.525463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170763c-20d2-45e7-99c2-648fb17db8a4 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:39.528133 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63cdc7-ecaf-4473-a5a7-d1bffa0e9945 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:39.528409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63cdc7-ecaf-4473-a5a7-d1bffa0e9945 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:39.528680 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63cdc7-ecaf-4473-a5a7-d1bffa0e9945 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:39.530088 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 348/699] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 13:59:39.537129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92426838-418a-483a-b440-2d3f8d0f6293 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:39.537681 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92426838-418a-483a-b440-2d3f8d0f6293 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:39.538145 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92426838-418a-483a-b440-2d3f8d0f6293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:39.577919 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-92426838-418a-483a-b440-2d3f8d0f6293 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:39.579119 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-92426838-418a-483a-b440-2d3f8d0f6293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:39.599489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7216c3-f29e-4a9f-8e11-167fd07178ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:39.600140 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7216c3-f29e-4a9f-8e11-167fd07178ca None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:39.600421 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7216c3-f29e-4a9f-8e11-167fd07178ca None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:39.600691 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7216c3-f29e-4a9f-8e11-167fd07178ca None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:39.601376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7216c3-f29e-4a9f-8e11-167fd07178ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:39.601677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7216c3-f29e-4a9f-8e11-167fd07178ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:39.603053 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7216c3-f29e-4a9f-8e11-167fd07178ca None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:39.629964 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 352/700] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:59:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:39.636710 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7216c3-f29e-4a9f-8e11-167fd07178ca None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:39.681515 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:39.711783 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 349/701] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:39.775930 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7216c3-f29e-4a9f-8e11-167fd07178ca None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:39.790482 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:39.819224 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642569cc-cd3a-4c3a-bbea-39a7f83be79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:39.819861 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642569cc-cd3a-4c3a-bbea-39a7f83be79a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:39.820143 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642569cc-cd3a-4c3a-bbea-39a7f83be79a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:39.820416 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642569cc-cd3a-4c3a-bbea-39a7f83be79a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:39.831605 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642569cc-cd3a-4c3a-bbea-39a7f83be79a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:39.833639 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642569cc-cd3a-4c3a-bbea-39a7f83be79a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:39.855577 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-642569cc-cd3a-4c3a-bbea-39a7f83be79a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:39.855577 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:39.855577 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:39.855577 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:39.855577 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:39.855577 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:39.855577 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:39.855577 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:39.855577 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:39.855577 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:39.855577 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:39.855577 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:39.855577 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:39.855577 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:39.855577 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:39.855577 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:39.856595 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:39.856595 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:39.856595 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:39.856595 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:39.856595 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:39.856595 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:39.856595 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:39.856595 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:39.856595 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:39.856595 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:39.856595 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:39.856595 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:39.856595 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:39.856595 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:39.856595 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:39.856595 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:39.856595 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:39.857535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:39.857535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:39.857535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:39.857535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 353/702] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:59:39.863878 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92426838-418a-483a-b440-2d3f8d0f6293 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:39.989548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92426838-418a-483a-b440-2d3f8d0f6293 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:40.035220 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dec1f3-7934-4ca6-bd34-93088902755a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:40.035823 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dec1f3-7934-4ca6-bd34-93088902755a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:40.036099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dec1f3-7934-4ca6-bd34-93088902755a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:40.036367 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dec1f3-7934-4ca6-bd34-93088902755a None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:40.037012 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dec1f3-7934-4ca6-bd34-93088902755a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:40.037344 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dec1f3-7934-4ca6-bd34-93088902755a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:40.038707 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dec1f3-7934-4ca6-bd34-93088902755a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:40.055329 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 350/703] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:40.060739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642569cc-cd3a-4c3a-bbea-39a7f83be79a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:40.126369 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dec1f3-7934-4ca6-bd34-93088902755a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:40.176116 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:40.235978 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642569cc-cd3a-4c3a-bbea-39a7f83be79a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:40.242502 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dec1f3-7934-4ca6-bd34-93088902755a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:40.282246 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72909271-e1f6-4d48-befc-9c3ae4f0aa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:40.284254 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72909271-e1f6-4d48-befc-9c3ae4f0aa19 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:40.284754 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72909271-e1f6-4d48-befc-9c3ae4f0aa19 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:40.286078 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72909271-e1f6-4d48-befc-9c3ae4f0aa19 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:40.287422 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72909271-e1f6-4d48-befc-9c3ae4f0aa19 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:40.289497 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72909271-e1f6-4d48-befc-9c3ae4f0aa19 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:40.303217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-72909271-e1f6-4d48-befc-9c3ae4f0aa19 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 13:59:40.303217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:40.303217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 13:59:40.303217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 13:59:40.303217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 13:59:40.303217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 13:59:40.303217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 13:59:40.303217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 13:59:40.303217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 13:59:40.303217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:40.303217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 13:59:40.303217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:40.303217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:40.303217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:40.303217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:40.303217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:40.303217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:40.304781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:40.304781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:40.304781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:40.304781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:40.304781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:40.304781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:40.304781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 13:59:40.304781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 13:59:40.304781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 13:59:40.304781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 13:59:40.304781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:40.304781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:40.304781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:40.304781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:40.304781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:40.304781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:40.305643 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:40.305643 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:40.305643 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:40.305643 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:40.305643 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:40.305643 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:40.305643 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:40.305643 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:40.305643 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:40.305643 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:40.305643 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 13:59:40.305643 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 13:59:40.305643 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 13:59:40.305643 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:40.308645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 351/704] 10.222.0.26 () {56 vars in 1129 bytes} [Tue Sep 13 13:59:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:40.312637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086abfcb-7dea-4717-8bad-acc9cd7d1656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:40.312637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086abfcb-7dea-4717-8bad-acc9cd7d1656 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:40.312637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086abfcb-7dea-4717-8bad-acc9cd7d1656 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:40.312637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086abfcb-7dea-4717-8bad-acc9cd7d1656 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:40.315031 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72909271-e1f6-4d48-befc-9c3ae4f0aa19 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:40.326495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086abfcb-7dea-4717-8bad-acc9cd7d1656 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:40.327980 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086abfcb-7dea-4717-8bad-acc9cd7d1656 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:40.351209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-086abfcb-7dea-4717-8bad-acc9cd7d1656 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 13:59:40.351209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:40.351209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:40.351209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:40.351209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:40.351209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:40.351209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:40.351209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:40.351209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:40.351209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:40.351209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:40.351209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:40.351209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 13:59:40.351209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 13:59:40.351209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 13:59:40.351209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 13:59:40.352194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:40.352194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:40.352194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 13:59:40.352194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:40.352194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 13:59:40.352194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:40.352194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:40.352194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:40.352194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:40.352194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:40.352194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:40.352194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:40.352194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:40.352194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:40.352194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:40.352194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:40.352194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:40.352194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:40.357571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:40.357571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:40.357571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 13:59:40.357571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 13:59:40.357571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 13:59:40.357571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 13:59:40.357571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 13:59:40.357571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 13:59:40.357571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 13:59:40.357571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:40.357571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 354/705] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Sep 13 13:59:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:40.366573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086abfcb-7dea-4717-8bad-acc9cd7d1656 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:40.430782 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:40.436008 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72909271-e1f6-4d48-befc-9c3ae4f0aa19 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:40.446442 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:40.478155 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a974ad6-ec5d-4c23-8302-f568969b87a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:40.479260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a974ad6-ec5d-4c23-8302-f568969b87a1 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:40.479759 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a974ad6-ec5d-4c23-8302-f568969b87a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:40.480224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a974ad6-ec5d-4c23-8302-f568969b87a1 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:40.481067 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a974ad6-ec5d-4c23-8302-f568969b87a1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:40.481704 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a974ad6-ec5d-4c23-8302-f568969b87a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:40.483353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a974ad6-ec5d-4c23-8302-f568969b87a1 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:40.488806 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 352/706] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Sep 13 13:59:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:40.494870 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a974ad6-ec5d-4c23-8302-f568969b87a1 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:40.547430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086abfcb-7dea-4717-8bad-acc9cd7d1656 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:40.583857 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5dc14-401c-4d2b-8462-02ca6cb4f271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:40.583857 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5dc14-401c-4d2b-8462-02ca6cb4f271 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:40.584158 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5dc14-401c-4d2b-8462-02ca6cb4f271 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:40.584398 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5dc14-401c-4d2b-8462-02ca6cb4f271 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:40.585148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5dc14-401c-4d2b-8462-02ca6cb4f271 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:40.585461 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5dc14-401c-4d2b-8462-02ca6cb4f271 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:40.586901 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5dc14-401c-4d2b-8462-02ca6cb4f271 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:40.605204 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 355/707] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Sep 13 13:59:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:40.606542 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d6bf7-2348-43b2-92a6-6011dd637e29 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:40.606832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d6bf7-2348-43b2-92a6-6011dd637e29 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:40.607109 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d6bf7-2348-43b2-92a6-6011dd637e29 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:40.612600 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 356/708] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:40.614025 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d6bf7-2348-43b2-92a6-6011dd637e29 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:40.622982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a974ad6-ec5d-4c23-8302-f568969b87a1 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:40.664134 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077ad28-4da8-45d7-929c-8e4c6dd6fdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:40.665298 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077ad28-4da8-45d7-929c-8e4c6dd6fdef None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:40.665576 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077ad28-4da8-45d7-929c-8e4c6dd6fdef None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:40.665847 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077ad28-4da8-45d7-929c-8e4c6dd6fdef None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:40.666569 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077ad28-4da8-45d7-929c-8e4c6dd6fdef None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:40.667288 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077ad28-4da8-45d7-929c-8e4c6dd6fdef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:40.669078 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077ad28-4da8-45d7-929c-8e4c6dd6fdef None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:40.676762 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 353/709] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Sep 13 13:59:40 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:40.678064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7569b-2a69-4e75-924d-2bc566d281c2 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:40.678339 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7569b-2a69-4e75-924d-2bc566d281c2 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:40.678608 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7569b-2a69-4e75-924d-2bc566d281c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:40.701237 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-77c7569b-2a69-4e75-924d-2bc566d281c2 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:40.702436 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-77c7569b-2a69-4e75-924d-2bc566d281c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:40.715045 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:40.734171 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d6bf7-2348-43b2-92a6-6011dd637e29 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:40.740300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:40.808930 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ac555-4c8e-4d3a-9389-51637ca63535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:40.809503 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ac555-4c8e-4d3a-9389-51637ca63535 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:40.809782 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ac555-4c8e-4d3a-9389-51637ca63535 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:40.810056 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ac555-4c8e-4d3a-9389-51637ca63535 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:40.835221 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 354/710] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:40.931798 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ac555-4c8e-4d3a-9389-51637ca63535 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:40.933310 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ac555-4c8e-4d3a-9389-51637ca63535 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:41.008466 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544ebd1-1d50-46b3-89a7-ee4c2991624c None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:41.008750 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544ebd1-1d50-46b3-89a7-ee4c2991624c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:41.009026 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544ebd1-1d50-46b3-89a7-ee4c2991624c None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:41.010401 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 355/711] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 13:59:41.015549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1cc78-39ef-4fe4-a8ab-07132e142368 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:41.015825 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1cc78-39ef-4fe4-a8ab-07132e142368 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:41.016097 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1cc78-39ef-4fe4-a8ab-07132e142368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:41.049514 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-19e1cc78-39ef-4fe4-a8ab-07132e142368 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:41.050771 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-19e1cc78-39ef-4fe4-a8ab-07132e142368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:41.064587 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:41.087000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 357/712] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:59:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:59:41.088279 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53040049-e5cf-44fb-9a17-9c84e1c2e49d None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:41.088563 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53040049-e5cf-44fb-9a17-9c84e1c2e49d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:41.088833 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53040049-e5cf-44fb-9a17-9c84e1c2e49d None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:41.090398 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 358/713] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:41.094023 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53040049-e5cf-44fb-9a17-9c84e1c2e49d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:41.142862 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 356/714] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:41.144217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d74477-0f16-4aee-820d-8edc47800c0a None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:41.145082 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d74477-0f16-4aee-820d-8edc47800c0a None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:41.145384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d74477-0f16-4aee-820d-8edc47800c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:41.167976 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-c7d74477-0f16-4aee-820d-8edc47800c0a None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:41.169677 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c7d74477-0f16-4aee-820d-8edc47800c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:41.238936 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53040049-e5cf-44fb-9a17-9c84e1c2e49d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:41.248890 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 357/715] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:41.254963 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d74477-0f16-4aee-820d-8edc47800c0a None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:41.296989 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:41.298166 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016fb7d-ff96-47d5-be79-96968f62ec4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:41.299107 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016fb7d-ff96-47d5-be79-96968f62ec4c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:41.299623 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016fb7d-ff96-47d5-be79-96968f62ec4c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:41.301324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016fb7d-ff96-47d5-be79-96968f62ec4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:41.315647 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016fb7d-ff96-47d5-be79-96968f62ec4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:41.324614 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016fb7d-ff96-47d5-be79-96968f62ec4c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:41.354501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-8016fb7d-ff96-47d5-be79-96968f62ec4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:41.354501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:41.354501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:41.354501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:41.354501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:41.354501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:41.354501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:41.354501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:41.354501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:41.354501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:41.354501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:41.354501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:41.354501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:41.354501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:41.354501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:41.354501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:41.355504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:41.355504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:41.355504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:41.355504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:41.355504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:41.355504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:41.355504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:41.355504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:41.355504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:41.355504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:41.355504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:41.355504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:41.355504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:41.355504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:41.355504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:41.355504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:41.355504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:41.356394 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:41.356394 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:41.356394 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:41.361205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 359/716] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:41.366008 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016fb7d-ff96-47d5-be79-96968f62ec4c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:41.383128 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d74477-0f16-4aee-820d-8edc47800c0a None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:41.420831 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465f13a-4d17-420d-be17-f426b150b626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:41.421860 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465f13a-4d17-420d-be17-f426b150b626 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:41.422433 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465f13a-4d17-420d-be17-f426b150b626 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:41.422915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465f13a-4d17-420d-be17-f426b150b626 None admin] PATH_INFO: `/v3/services/network` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:41.423735 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c465f13a-4d17-420d-be17-f426b150b626 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:41.425325 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c465f13a-4d17-420d-be17-f426b150b626 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:41.427649 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:41.446296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-c465f13a-4d17-420d-be17-f426b150b626 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 13:59:41.446296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:41.446296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 13:59:41.446296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 13:59:41.446296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 13:59:41.446296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 13:59:41.446296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 13:59:41.446296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 13:59:41.446296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 13:59:41.446296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:41.446296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 13:59:41.446296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:41.446296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:41.446296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:41.446296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:41.446296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:41.446296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:41.447328 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:41.447328 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:41.447328 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:41.447328 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:41.447328 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:41.447328 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:41.447328 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 13:59:41.447328 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 13:59:41.447328 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 13:59:41.447328 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 13:59:41.447328 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:41.447328 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:41.447328 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:41.447328 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:41.447328 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:41.447328 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:41.448163 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:41.448163 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:41.448163 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:41.448163 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:41.448163 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:41.448163 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:41.448163 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:41.448163 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:41.448163 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:41.448163 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:41.448163 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 13:59:41.448163 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 13:59:41.448163 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 13:59:41.448163 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:41.450746 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 358/717] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:41 2022] GET /identity/v3/services/network => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:41.451697 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465f13a-4d17-420d-be17-f426b150b626 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:41.496473 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016fb7d-ff96-47d5-be79-96968f62ec4c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:41.533999 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe8358-9831-4834-9d68-df7d8af8e256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:41.535586 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe8358-9831-4834-9d68-df7d8af8e256 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:41.536113 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe8358-9831-4834-9d68-df7d8af8e256 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:41.536579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe8358-9831-4834-9d68-df7d8af8e256 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:41.537606 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe8358-9831-4834-9d68-df7d8af8e256 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:41.538104 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe8358-9831-4834-9d68-df7d8af8e256 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:41.539788 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe8358-9831-4834-9d68-df7d8af8e256 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:41.552183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:41.553773 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 360/718] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:41.555856 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe8358-9831-4834-9d68-df7d8af8e256 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:41.569665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465f13a-4d17-420d-be17-f426b150b626 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:41.615324 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654dd69-30aa-41a0-bb60-c3538e813a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:41.615324 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654dd69-30aa-41a0-bb60-c3538e813a0f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:41.615324 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654dd69-30aa-41a0-bb60-c3538e813a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:41.615324 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654dd69-30aa-41a0-bb60-c3538e813a0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:41.629111 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654dd69-30aa-41a0-bb60-c3538e813a0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:41.634545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-e654dd69-30aa-41a0-bb60-c3538e813a0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:41.634545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:41.634545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:41.634545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:41.634545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:41.634545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:41.634545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:41.634545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:41.634545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:41.634545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:41.634545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:41.634545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:41.634545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:41.634545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:41.634545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:41.634545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:41.635631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:41.635631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:41.635631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:41.635631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:41.635631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:41.635631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:41.635631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:41.635631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:41.635631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:41.635631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:41.635631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:41.635631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:41.635631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:41.635631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:41.635631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:41.635631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:41.641335 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:41.641335 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:41.641335 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:41.641335 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:41.641335 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:41.641335 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:41.641335 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:41.641335 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:41.641335 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:41.641335 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:41.641335 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:41.641335 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:41.641335 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 359/719] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 13 13:59:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:41.641335 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654dd69-30aa-41a0-bb60-c3538e813a0f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:41.670683 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:41.678113 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe8358-9831-4834-9d68-df7d8af8e256 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:41.714299 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af6a19-c6e4-45e4-95db-3195b9ae970e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:41.714897 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af6a19-c6e4-45e4-95db-3195b9ae970e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:41.715172 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af6a19-c6e4-45e4-95db-3195b9ae970e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:41.715442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af6a19-c6e4-45e4-95db-3195b9ae970e None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:41.716063 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af6a19-c6e4-45e4-95db-3195b9ae970e None admin] RBAC: Adding query filter params (name=network) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:41.716383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af6a19-c6e4-45e4-95db-3195b9ae970e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:41.717905 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af6a19-c6e4-45e4-95db-3195b9ae970e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:41.727332 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 361/720] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Sep 13 13:59:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:41.727332 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af6a19-c6e4-45e4-95db-3195b9ae970e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:41.746545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654dd69-30aa-41a0-bb60-c3538e813a0f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:41.782099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ac20f-39d9-44d0-ae7a-46875b594c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:41.783079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ac20f-39d9-44d0-ae7a-46875b594c58 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:41.783356 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ac20f-39d9-44d0-ae7a-46875b594c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:41.783621 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ac20f-39d9-44d0-ae7a-46875b594c58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:41.790448 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ac20f-39d9-44d0-ae7a-46875b594c58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:41.791872 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ac20f-39d9-44d0-ae7a-46875b594c58 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:41.803124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-745ac20f-39d9-44d0-ae7a-46875b594c58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:41.803124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:41.803124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:41.803124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:41.803124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:41.803124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:41.803124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:41.803124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:41.803124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:41.803124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:41.803124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:41.803124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:41.803124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 13:59:41.803124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 13:59:41.803124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 13:59:41.804021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 13:59:41.804021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:41.804021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:41.804021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:41.804021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:41.804021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:41.804021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:41.804021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:41.804021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:41.804021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:41.804021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:41.804021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:41.804021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:41.804021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:41.804021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:41.804021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:41.804021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:41.804892 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 13:59:41.804892 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 13:59:41.804892 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 13:59:41.804892 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 13:59:41.804892 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 13:59:41.804892 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 13:59:41.804892 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:41.804892 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:41.809019 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 360/721] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:41.809882 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ac20f-39d9-44d0-ae7a-46875b594c58 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:41.822725 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:41.837836 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af6a19-c6e4-45e4-95db-3195b9ae970e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:41.872117 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75f49c-a495-46b3-8ba8-b731d83dbec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:41.872732 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75f49c-a495-46b3-8ba8-b731d83dbec4 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:41.873005 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75f49c-a495-46b3-8ba8-b731d83dbec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:41.873302 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75f49c-a495-46b3-8ba8-b731d83dbec4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:41.883937 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75f49c-a495-46b3-8ba8-b731d83dbec4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:41.889159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-3e75f49c-a495-46b3-8ba8-b731d83dbec4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:59:41.889159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:41.889159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:41.889159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:41.889159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:41.889159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:41.889159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:41.889159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:41.889159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:41.889159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:41.889159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:41.889159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:41.889159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:41.889159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:41.889159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:41.889159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:41.890069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:41.890069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:41.890069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:41.890069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:41.890069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:41.890069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:41.890069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:41.890069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:41.890069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:41.890069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:41.890069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:41.890069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:41.890069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:41.890069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:41.890069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:41.890069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:41.890898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:41.890898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:41.890898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:41.890898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:41.890898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:41.890898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:41.890898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:41.890898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:41.890898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:41.890898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:41.890898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:59:41.890898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:41.895259 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 362/722] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 13:59:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:41.895895 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75f49c-a495-46b3-8ba8-b731d83dbec4 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:41.918043 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:41.918663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ac20f-39d9-44d0-ae7a-46875b594c58 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:41.954343 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975568b2-e49d-49e8-8970-5baed244cd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:41.954936 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975568b2-e49d-49e8-8970-5baed244cd6b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:41.955215 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975568b2-e49d-49e8-8970-5baed244cd6b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:41.955484 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975568b2-e49d-49e8-8970-5baed244cd6b None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:41.956141 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975568b2-e49d-49e8-8970-5baed244cd6b None admin] RBAC: Adding query filter params (name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:41.956439 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975568b2-e49d-49e8-8970-5baed244cd6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:41.957903 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975568b2-e49d-49e8-8970-5baed244cd6b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:41.970578 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 361/723] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 13 13:59:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:41.971438 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975568b2-e49d-49e8-8970-5baed244cd6b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:41.999652 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75f49c-a495-46b3-8ba8-b731d83dbec4 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:42.033673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58343e0a-8c64-4b99-afb9-0381271b61a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:42.034554 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58343e0a-8c64-4b99-afb9-0381271b61a2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:42.034936 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58343e0a-8c64-4b99-afb9-0381271b61a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:42.035656 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58343e0a-8c64-4b99-afb9-0381271b61a2 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:42.036286 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58343e0a-8c64-4b99-afb9-0381271b61a2 None admin] RBAC: Adding query filter params (type=network) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:42.036590 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58343e0a-8c64-4b99-afb9-0381271b61a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:42.037994 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58343e0a-8c64-4b99-afb9-0381271b61a2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:42.053130 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 363/724] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Sep 13 13:59:41 2022] GET /identity/v3/services?type=network => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:42.053130 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58343e0a-8c64-4b99-afb9-0381271b61a2 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:42.058070 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:42.100529 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975568b2-e49d-49e8-8970-5baed244cd6b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:42.148232 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6fc271-2522-4841-b756-0fbd80d494b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:42.148984 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fc271-2522-4841-b756-0fbd80d494b1 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:42.149390 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fc271-2522-4841-b756-0fbd80d494b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:42.149724 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fc271-2522-4841-b756-0fbd80d494b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:42.151221 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6fc271-2522-4841-b756-0fbd80d494b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:42.151606 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6fc271-2522-4841-b756-0fbd80d494b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:42.153804 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6fc271-2522-4841-b756-0fbd80d494b1 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:42.162074 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:42.177284 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 362/725] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 13:59:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:42.178224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6fc271-2522-4841-b756-0fbd80d494b1 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:42.187603 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58343e0a-8c64-4b99-afb9-0381271b61a2 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:42.239350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb38d12-daa7-42e1-b267-7f65cb1a003a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:42.240096 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb38d12-daa7-42e1-b267-7f65cb1a003a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:42.240442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb38d12-daa7-42e1-b267-7f65cb1a003a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:42.240778 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb38d12-daa7-42e1-b267-7f65cb1a003a None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:42.241585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb38d12-daa7-42e1-b267-7f65cb1a003a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:42.241953 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb38d12-daa7-42e1-b267-7f65cb1a003a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:42.245179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb38d12-daa7-42e1-b267-7f65cb1a003a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:42.256251 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 364/726] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:59:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:42.256903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb38d12-daa7-42e1-b267-7f65cb1a003a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:42.305041 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6fc271-2522-4841-b756-0fbd80d494b1 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:42.348491 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:42.351359 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145116a-634e-43c8-a7a7-3f15c2165fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:42.352308 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145116a-634e-43c8-a7a7-3f15c2165fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:42.352779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145116a-634e-43c8-a7a7-3f15c2165fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:42.353266 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145116a-634e-43c8-a7a7-3f15c2165fe2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:42.363875 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145116a-634e-43c8-a7a7-3f15c2165fe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:42.365638 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145116a-634e-43c8-a7a7-3f15c2165fe2 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:42.373642 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb38d12-daa7-42e1-b267-7f65cb1a003a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:42.381316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-b145116a-634e-43c8-a7a7-3f15c2165fe2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:42.381316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:42.381316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:42.381316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:42.381316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:42.381316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:42.381316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:42.381316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:42.381316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:42.381316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:42.381316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:42.381316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:42.381316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:42.381316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:42.381316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:42.381316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:42.382260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:42.382260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:42.382260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:42.382260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:42.382260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:42.382260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:42.382260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:42.382260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:42.382260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:42.382260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:42.382260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:42.382260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:42.382260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:42.382260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:42.382260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:42.382260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:42.382260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:42.383125 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:42.383125 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:42.383125 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:42.385665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 363/727] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:42.386641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145116a-634e-43c8-a7a7-3f15c2165fe2 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:42.414680 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044cd1a-04d0-4344-bb4e-6cc36dd2d897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:42.415289 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044cd1a-04d0-4344-bb4e-6cc36dd2d897 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:42.415559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044cd1a-04d0-4344-bb4e-6cc36dd2d897 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:42.415830 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044cd1a-04d0-4344-bb4e-6cc36dd2d897 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:42.416636 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044cd1a-04d0-4344-bb4e-6cc36dd2d897 None admin] RBAC: Adding query filter params (role.id=6dcc8495d2b24b3eab63dd656eb4eb6d, scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086, user.id=1b3533d0a24e4e7bbf5c7137d3511b13) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:42.416913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044cd1a-04d0-4344-bb4e-6cc36dd2d897 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:42.418448 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044cd1a-04d0-4344-bb4e-6cc36dd2d897 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:42.429258 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 365/728] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:59:42 2022] GET /identity/v3/role_assignments?user.id=1b3533d0a24e4e7bbf5c7137d3511b13&scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086&role.id=6dcc8495d2b24b3eab63dd656eb4eb6d => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:42.430403 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044cd1a-04d0-4344-bb4e-6cc36dd2d897 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:42.453634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:42.500579 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145116a-634e-43c8-a7a7-3f15c2165fe2 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:42.539248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc37e5-b546-4170-904e-41033dffbbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:42.540232 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc37e5-b546-4170-904e-41033dffbbee None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:42.540741 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc37e5-b546-4170-904e-41033dffbbee None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:42.541366 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc37e5-b546-4170-904e-41033dffbbee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:42.561252 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc37e5-b546-4170-904e-41033dffbbee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:42.562737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc37e5-b546-4170-904e-41033dffbbee None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:42.593213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-04bc37e5-b546-4170-904e-41033dffbbee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:42.593213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:42.593213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:42.593213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:42.593213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:42.593213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:42.593213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:42.593213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:42.593213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:42.593213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:42.593213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:42.593213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:42.593213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:42.593213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:42.593213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:42.593213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:42.594300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:42.594300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:42.594300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:42.594300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:42.594300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:42.594300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:42.594300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:42.594300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:42.594300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:42.594300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:42.594300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:42.594300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:42.594300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:42.594300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:42.594300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:42.594300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:42.594300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:42.595323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:42.595323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:42.595323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:42.595323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 364/729] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:42.602151 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc37e5-b546-4170-904e-41033dffbbee None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:42.652183 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044cd1a-04d0-4344-bb4e-6cc36dd2d897 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:42.682987 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:42.721274 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d9fc3-6f45-4fb8-96c5-d3ad96846fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:42.721893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d9fc3-6f45-4fb8-96c5-d3ad96846fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:42.722169 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d9fc3-6f45-4fb8-96c5-d3ad96846fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:42.722973 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d9fc3-6f45-4fb8-96c5-d3ad96846fa4 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:42.723627 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d9fc3-6f45-4fb8-96c5-d3ad96846fa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:42.723928 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d9fc3-6f45-4fb8-96c5-d3ad96846fa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:42.726535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d9fc3-6f45-4fb8-96c5-d3ad96846fa4 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:42.752178 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 366/730] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:42.760018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d9fc3-6f45-4fb8-96c5-d3ad96846fa4 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:42.779149 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc37e5-b546-4170-904e-41033dffbbee None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:42.845457 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:42.848597 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccce5d-3df3-41e3-97f6-d6e6206dc06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:42.849244 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccce5d-3df3-41e3-97f6-d6e6206dc06e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:42.849522 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccce5d-3df3-41e3-97f6-d6e6206dc06e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:42.849795 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccce5d-3df3-41e3-97f6-d6e6206dc06e None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:42.850444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ccce5d-3df3-41e3-97f6-d6e6206dc06e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:42.850743 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ccce5d-3df3-41e3-97f6-d6e6206dc06e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:42.852115 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ccce5d-3df3-41e3-97f6-d6e6206dc06e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:42.882213 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d9fc3-6f45-4fb8-96c5-d3ad96846fa4 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:42.883336 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 365/731] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:42.890099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccce5d-3df3-41e3-97f6-d6e6206dc06e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:42.971204 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080df17-ed52-4e51-b40c-814c67e3f4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:42.971853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080df17-ed52-4e51-b40c-814c67e3f4b2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:42.972133 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080df17-ed52-4e51-b40c-814c67e3f4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:42.972458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080df17-ed52-4e51-b40c-814c67e3f4b2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:42.990179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080df17-ed52-4e51-b40c-814c67e3f4b2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:42.991644 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080df17-ed52-4e51-b40c-814c67e3f4b2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:42.999414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:43.007795 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccce5d-3df3-41e3-97f6-d6e6206dc06e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:43.018649 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-0080df17-ed52-4e51-b40c-814c67e3f4b2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 13:59:43.018649 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:43.018649 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:43.018649 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:43.018649 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:43.018649 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:43.018649 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:43.018649 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:43.018649 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:43.018649 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:43.018649 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:43.018649 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:43.018649 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 13:59:43.018649 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 13:59:43.018649 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 13:59:43.018649 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 13:59:43.019646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:43.019646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:43.019646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 13:59:43.019646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:43.019646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 13:59:43.019646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:43.019646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:43.019646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:43.019646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:43.019646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:43.019646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:43.019646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:43.019646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:43.019646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:43.019646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:43.019646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:43.019646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:43.019646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:43.020570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:43.020570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:43.020570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 13:59:43.020570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 13:59:43.020570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 13:59:43.020570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 13:59:43.020570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 13:59:43.020570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 13:59:43.020570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 13:59:43.020570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:43.025184 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 367/732] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Sep 13 13:59:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:59:43.026076 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080df17-ed52-4e51-b40c-814c67e3f4b2 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:43.044351 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ea0ee-e0da-4d52-9d79-e0b5f718260e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:43.045033 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ea0ee-e0da-4d52-9d79-e0b5f718260e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:43.045359 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ea0ee-e0da-4d52-9d79-e0b5f718260e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:43.045638 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ea0ee-e0da-4d52-9d79-e0b5f718260e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:43.055260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ea0ee-e0da-4d52-9d79-e0b5f718260e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:43.056807 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ea0ee-e0da-4d52-9d79-e0b5f718260e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:43.072327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-460ea0ee-e0da-4d52-9d79-e0b5f718260e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 13:59:43.072327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:43.072327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:43.072327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:43.072327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:43.072327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:43.072327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:43.072327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:43.072327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:43.072327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:43.072327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:43.072327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:43.072327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 13:59:43.072327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 13:59:43.072327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 13:59:43.072327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 13:59:43.074648 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:43.074648 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:43.074648 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 13:59:43.074648 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:43.074648 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 13:59:43.074648 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:43.074648 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:43.074648 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:43.074648 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:43.074648 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:43.074648 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:43.074648 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:43.074648 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:43.074648 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:43.074648 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:43.074648 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:43.074648 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:43.074648 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:43.076829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:43.076829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:43.076829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 13:59:43.076829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 13:59:43.076829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 13:59:43.076829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 13:59:43.076829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 13:59:43.076829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 13:59:43.076829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 13:59:43.076829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:43.081128 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 366/733] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 13:59:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:59:43.081128 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ea0ee-e0da-4d52-9d79-e0b5f718260e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:43.200812 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ea0ee-e0da-4d52-9d79-e0b5f718260e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:43.209683 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080df17-ed52-4e51-b40c-814c67e3f4b2 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:43.242946 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7591d0a-7c76-4988-aae8-3b3e16dfeff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:43.243852 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7591d0a-7c76-4988-aae8-3b3e16dfeff4 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:43.244306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7591d0a-7c76-4988-aae8-3b3e16dfeff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:43.244751 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7591d0a-7c76-4988-aae8-3b3e16dfeff4 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:43.245685 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7591d0a-7c76-4988-aae8-3b3e16dfeff4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:43.246184 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7591d0a-7c76-4988-aae8-3b3e16dfeff4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:43.247788 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7591d0a-7c76-4988-aae8-3b3e16dfeff4 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:43.248138 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:43.257278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee639cfc-85c5-43b6-ab5f-f8e07209a40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:43.258180 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee639cfc-85c5-43b6-ab5f-f8e07209a40e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:43.258463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee639cfc-85c5-43b6-ab5f-f8e07209a40e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:43.258737 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee639cfc-85c5-43b6-ab5f-f8e07209a40e None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:43.260434 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee639cfc-85c5-43b6-ab5f-f8e07209a40e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:43.260746 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee639cfc-85c5-43b6-ab5f-f8e07209a40e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:43.262220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee639cfc-85c5-43b6-ab5f-f8e07209a40e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:43.268537 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 367/734] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Sep 13 13:59:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:43.270647 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286aec65-fcc9-4aa7-af38-03d272471719 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:43.271108 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286aec65-fcc9-4aa7-af38-03d272471719 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:43.271601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286aec65-fcc9-4aa7-af38-03d272471719 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:43.277478 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 368/735] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:43.278827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37060811-6f6d-4adb-b054-f3653caec26c None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:43.279104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37060811-6f6d-4adb-b054-f3653caec26c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:43.279377 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37060811-6f6d-4adb-b054-f3653caec26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:43.289054 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 368/736] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Sep 13 13:59:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:43.290248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee639cfc-85c5-43b6-ab5f-f8e07209a40e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:43.298076 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-37060811-6f6d-4adb-b054-f3653caec26c None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:43.299257 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-37060811-6f6d-4adb-b054-f3653caec26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:43.307420 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:43.377446 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 369/737] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 13:59:43.378415 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37060811-6f6d-4adb-b054-f3653caec26c None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:43.430683 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee639cfc-85c5-43b6-ab5f-f8e07209a40e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:43.497381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20981c1-dacc-429b-92b5-8a8d0fc2fd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:43.497910 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20981c1-dacc-429b-92b5-8a8d0fc2fd46 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:43.500219 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20981c1-dacc-429b-92b5-8a8d0fc2fd46 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:43.500507 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20981c1-dacc-429b-92b5-8a8d0fc2fd46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:43.571631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37060811-6f6d-4adb-b054-f3653caec26c None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:43.609897 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:43.628156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20981c1-dacc-429b-92b5-8a8d0fc2fd46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:43.630797 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20981c1-dacc-429b-92b5-8a8d0fc2fd46 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:43.633010 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081581d-ee89-4a4c-b8f1-27bcd78ef27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:43.633714 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081581d-ee89-4a4c-b8f1-27bcd78ef27d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:43.633990 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081581d-ee89-4a4c-b8f1-27bcd78ef27d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:43.634318 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081581d-ee89-4a4c-b8f1-27bcd78ef27d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:43.653777 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:43.724657 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081581d-ee89-4a4c-b8f1-27bcd78ef27d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:43.726445 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081581d-ee89-4a4c-b8f1-27bcd78ef27d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:43.742860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 369/738] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:59:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:59:43.744290 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20981c1-dacc-429b-92b5-8a8d0fc2fd46 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:43.846456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 370/739] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:59:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 13:59:43.847773 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081581d-ee89-4a4c-b8f1-27bcd78ef27d None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:43.849475 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:43.869226 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20981c1-dacc-429b-92b5-8a8d0fc2fd46 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:43.900422 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:43.916173 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510228f2-35b6-421c-9912-409d95acfbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:43.916792 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510228f2-35b6-421c-9912-409d95acfbc3 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:43.917551 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510228f2-35b6-421c-9912-409d95acfbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:43.917828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510228f2-35b6-421c-9912-409d95acfbc3 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:43.918494 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510228f2-35b6-421c-9912-409d95acfbc3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:43.920179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510228f2-35b6-421c-9912-409d95acfbc3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:43.949190 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 370/740] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Sep 13 13:59:43 2022] POST /identity/v3/services => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 13:59:43.950661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510228f2-35b6-421c-9912-409d95acfbc3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:44.044678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081581d-ee89-4a4c-b8f1-27bcd78ef27d None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:44.122633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510228f2-35b6-421c-9912-409d95acfbc3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:44.135370 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb5756-9cb9-4dc9-a4e6-6db4d361b345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:44.136010 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb5756-9cb9-4dc9-a4e6-6db4d361b345 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:44.136285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb5756-9cb9-4dc9-a4e6-6db4d361b345 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:44.136552 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb5756-9cb9-4dc9-a4e6-6db4d361b345 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:44.160968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb5756-9cb9-4dc9-a4e6-6db4d361b345 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:44.162900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb5756-9cb9-4dc9-a4e6-6db4d361b345 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:44.172484 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f05fcc-c110-444a-9e9b-f0c892aaf60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:44.173153 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f05fcc-c110-444a-9e9b-f0c892aaf60e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:44.173414 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f05fcc-c110-444a-9e9b-f0c892aaf60e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:44.173685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f05fcc-c110-444a-9e9b-f0c892aaf60e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:44.183595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-71bb5756-9cb9-4dc9-a4e6-6db4d361b345 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:44.183595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:44.183595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:44.183595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:44.183595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:44.183595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:44.183595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:44.183595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:44.183595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:44.183595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:44.183595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:44.183595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:44.183595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:44.183595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:44.183595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:44.183595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:44.184536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:44.184536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:44.184536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:44.184536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:44.184536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:44.184536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:44.184536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:44.184536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:44.184536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:44.184536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:44.184536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:44.184536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:44.184536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:44.184536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:44.184536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:44.184536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:44.184536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:44.185501 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:44.185501 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:44.185501 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:44.185684 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f05fcc-c110-444a-9e9b-f0c892aaf60e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:44.186841 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f05fcc-c110-444a-9e9b-f0c892aaf60e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:44.192741 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 371/741] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:44.194178 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb5756-9cb9-4dc9-a4e6-6db4d361b345 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:44.194649 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:44.204546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-d2f05fcc-c110-444a-9e9b-f0c892aaf60e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:44.204546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:44.204546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:44.204546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:44.204546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:44.204546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:44.204546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:44.204546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:44.204546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:44.204546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:44.204546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:44.204546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:44.204546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:44.204546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:44.204546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:44.204546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:44.205544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:44.205544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:44.205544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:44.205544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:44.205544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:44.205544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:44.205544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:44.205544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:44.205544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:44.205544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:44.205544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:44.205544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:44.205544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:44.205544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:44.205544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:44.205544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:44.205544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:44.206971 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:44.206971 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:44.206971 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:44.206971 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 371/742] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:44.210995 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f05fcc-c110-444a-9e9b-f0c892aaf60e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:44.301527 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:44.312081 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb5756-9cb9-4dc9-a4e6-6db4d361b345 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:44.321853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f05fcc-c110-444a-9e9b-f0c892aaf60e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:44.350136 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735b8ab-0296-4715-90f5-b570836af9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:44.351016 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735b8ab-0296-4715-90f5-b570836af9a0 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:44.351446 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735b8ab-0296-4715-90f5-b570836af9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:44.351866 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735b8ab-0296-4715-90f5-b570836af9a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:44.352723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735b8ab-0296-4715-90f5-b570836af9a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:44.353217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735b8ab-0296-4715-90f5-b570836af9a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:44.354997 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735b8ab-0296-4715-90f5-b570836af9a0 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:44.361067 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374a72a-0621-4fc0-9a11-ab0c7c60f208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:44.361900 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374a72a-0621-4fc0-9a11-ab0c7c60f208 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:44.362280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374a72a-0621-4fc0-9a11-ab0c7c60f208 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:44.362650 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374a72a-0621-4fc0-9a11-ab0c7c60f208 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:44.364038 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374a72a-0621-4fc0-9a11-ab0c7c60f208 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:44.364450 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374a72a-0621-4fc0-9a11-ab0c7c60f208 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:44.366366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374a72a-0621-4fc0-9a11-ab0c7c60f208 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:44.376737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 372/743] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:44.378366 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735b8ab-0296-4715-90f5-b570836af9a0 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:44.383342 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 372/744] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:44.388814 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374a72a-0621-4fc0-9a11-ab0c7c60f208 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:44.470336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:44.513325 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735b8ab-0296-4715-90f5-b570836af9a0 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:44.528739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374a72a-0621-4fc0-9a11-ab0c7c60f208 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:44.554564 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d76b0-278d-4a98-b1ea-6810459b7020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:44.555280 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d76b0-278d-4a98-b1ea-6810459b7020 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:44.555619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d76b0-278d-4a98-b1ea-6810459b7020 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:44.555947 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d76b0-278d-4a98-b1ea-6810459b7020 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:44.563194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d76b0-278d-4a98-b1ea-6810459b7020 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:44.564841 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d76b0-278d-4a98-b1ea-6810459b7020 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:44.573428 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a8d69-5db7-4a66-a08a-420e863bf227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:44.574262 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a8d69-5db7-4a66-a08a-420e863bf227 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:44.574713 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a8d69-5db7-4a66-a08a-420e863bf227 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:44.575129 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a8d69-5db7-4a66-a08a-420e863bf227 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:44.576430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-e77d76b0-278d-4a98-b1ea-6810459b7020 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:44.576430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:44.576430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:44.576430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:44.576430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:44.576430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:44.576430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:44.576430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:44.576430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:44.576430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:44.576430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:44.576430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:44.576430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 13:59:44.576430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 13:59:44.576430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 13:59:44.581028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 13:59:44.581028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:44.581028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:44.581028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:44.581028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:44.581028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:44.581028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:44.581028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:44.581028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:44.581028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:44.581028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:44.581028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:44.581028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:44.581028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:44.581028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:44.581028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:44.581028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:44.584078 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 13:59:44.584078 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 13:59:44.584078 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 13:59:44.584078 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 13:59:44.584078 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 13:59:44.584078 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 13:59:44.584078 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:44.584078 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:44.584078 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 373/745] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:59:44.584078 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf53df-9413-4912-8cc1-18b2acedf31c None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:44.584078 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf53df-9413-4912-8cc1-18b2acedf31c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:44.584861 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf53df-9413-4912-8cc1-18b2acedf31c None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:44.584861 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 374/746] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:44.587069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54169e-8abc-4879-a0fa-1ebf5da263ec None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:44.587609 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54169e-8abc-4879-a0fa-1ebf5da263ec None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:44.587740 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54169e-8abc-4879-a0fa-1ebf5da263ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:44.592745 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a8d69-5db7-4a66-a08a-420e863bf227 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:44.594623 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a8d69-5db7-4a66-a08a-420e863bf227 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:44.609160 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-5f54169e-8abc-4879-a0fa-1ebf5da263ec None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:44.609515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-501a8d69-5db7-4a66-a08a-420e863bf227 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:44.609515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:44.609515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:44.609515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:44.609515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:44.609515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:44.609515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:44.609515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:44.609515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:44.609515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:44.609515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:44.609515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:44.609515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 13:59:44.609515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 13:59:44.609515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 13:59:44.610594 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 13:59:44.610594 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:44.610594 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:44.610594 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:44.610594 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:44.610594 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:44.610594 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:44.610594 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:44.610594 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:44.610594 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:44.610594 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:44.610594 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:44.610594 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:44.610594 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:44.610594 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:44.610594 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:44.610594 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:44.611873 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 13:59:44.611873 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 13:59:44.611873 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 13:59:44.611873 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 13:59:44.611873 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 13:59:44.611873 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 13:59:44.611873 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:44.611873 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:44.611873 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 373/747] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:44.611873 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a8d69-5db7-4a66-a08a-420e863bf227 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:44.614825 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5f54169e-8abc-4879-a0fa-1ebf5da263ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:44.627171 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:44.715701 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 375/748] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:44 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 13:59:44.717541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54169e-8abc-4879-a0fa-1ebf5da263ec None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:44.759997 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a8d69-5db7-4a66-a08a-420e863bf227 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:44.780408 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:44.802393 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198139d8-a36c-43d0-8f5a-5cde829ba9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:44.803148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198139d8-a36c-43d0-8f5a-5cde829ba9c7 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:44.803433 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198139d8-a36c-43d0-8f5a-5cde829ba9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:44.803706 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198139d8-a36c-43d0-8f5a-5cde829ba9c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:44.804399 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198139d8-a36c-43d0-8f5a-5cde829ba9c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:44.804703 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198139d8-a36c-43d0-8f5a-5cde829ba9c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:44.806340 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198139d8-a36c-43d0-8f5a-5cde829ba9c7 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:44.826077 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 374/749] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 13:59:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:44.827491 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198139d8-a36c-43d0-8f5a-5cde829ba9c7 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:44.958472 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54169e-8abc-4879-a0fa-1ebf5da263ec None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:45.013014 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29c5e1-d1bb-4e3d-a8b6-221263075b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:45.014190 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29c5e1-d1bb-4e3d-a8b6-221263075b8a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:45.014473 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29c5e1-d1bb-4e3d-a8b6-221263075b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:45.014749 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29c5e1-d1bb-4e3d-a8b6-221263075b8a None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:45.015742 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29c5e1-d1bb-4e3d-a8b6-221263075b8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:45.016080 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29c5e1-d1bb-4e3d-a8b6-221263075b8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:45.018459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29c5e1-d1bb-4e3d-a8b6-221263075b8a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:45.030626 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:45.036256 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 376/750] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 13:59:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:45.037982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323859a3-bab8-452c-959b-ca894eb091b1 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:45.038267 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323859a3-bab8-452c-959b-ca894eb091b1 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:45.038543 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323859a3-bab8-452c-959b-ca894eb091b1 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:45.040399 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 377/751] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:45.041185 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323859a3-bab8-452c-959b-ca894eb091b1 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:45.066874 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198139d8-a36c-43d0-8f5a-5cde829ba9c7 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:45.104551 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1343c2-02e5-45c6-b0a0-1859b3cbcfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:45.105182 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1343c2-02e5-45c6-b0a0-1859b3cbcfde None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:45.105488 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1343c2-02e5-45c6-b0a0-1859b3cbcfde None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:45.105735 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1343c2-02e5-45c6-b0a0-1859b3cbcfde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:45.106457 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1343c2-02e5-45c6-b0a0-1859b3cbcfde None admin] RBAC: Adding query filter params (role.id=6dcc8495d2b24b3eab63dd656eb4eb6d, scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086, user.id=97c27e930f604bd38634ca08e56cf8cd) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:45.106769 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1343c2-02e5-45c6-b0a0-1859b3cbcfde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:45.108207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1343c2-02e5-45c6-b0a0-1859b3cbcfde None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:45.114612 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 375/752] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:59:44 2022] GET /identity/v3/role_assignments?user.id=97c27e930f604bd38634ca08e56cf8cd&scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086&role.id=6dcc8495d2b24b3eab63dd656eb4eb6d => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:45.115401 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1343c2-02e5-45c6-b0a0-1859b3cbcfde None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:45.177048 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323859a3-bab8-452c-959b-ca894eb091b1 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:45.181238 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:45.240603 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c096526-ff25-4745-ba6b-ca0613487d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:45.241204 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c096526-ff25-4745-ba6b-ca0613487d4b None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:45.241490 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c096526-ff25-4745-ba6b-ca0613487d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:45.241765 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c096526-ff25-4745-ba6b-ca0613487d4b None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:45.242459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c096526-ff25-4745-ba6b-ca0613487d4b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:45.244044 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c096526-ff25-4745-ba6b-ca0613487d4b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:45.264022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 378/753] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Sep 13 13:59:45 2022] POST /identity/v3/services => generated 240 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 13:59:45.265567 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ac8f3-0104-4d72-ada3-5f343e2281c5 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:45.265851 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ac8f3-0104-4d72-ada3-5f343e2281c5 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:45.266172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ac8f3-0104-4d72-ada3-5f343e2281c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:45.268876 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1343c2-02e5-45c6-b0a0-1859b3cbcfde None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:45.299230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-5b3ac8f3-0104-4d72-ada3-5f343e2281c5 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:45.301267 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5b3ac8f3-0104-4d72-ada3-5f343e2281c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:45.331524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5515adf-a00d-4a64-a82d-9964d462d803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:45.332691 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5515adf-a00d-4a64-a82d-9964d462d803 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:45.332965 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5515adf-a00d-4a64-a82d-9964d462d803 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:45.333263 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5515adf-a00d-4a64-a82d-9964d462d803 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:45.336695 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5515adf-a00d-4a64-a82d-9964d462d803 None admin] RBAC: Adding query filter params (role.id=0c389f21d4434ae0a32fc453a8f2050a, scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086, user.id=0c41b4ecb17a43fdb05e586cce43b5a5) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:45.336695 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5515adf-a00d-4a64-a82d-9964d462d803 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:45.340109 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5515adf-a00d-4a64-a82d-9964d462d803 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:45.353293 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 376/754] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:59:45 2022] GET /identity/v3/role_assignments?user.id=0c41b4ecb17a43fdb05e586cce43b5a5&scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086&role.id=0c389f21d4434ae0a32fc453a8f2050a => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:45.397391 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:45.413485 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 379/755] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 13:59:45.744336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5515adf-a00d-4a64-a82d-9964d462d803 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:45.862267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:45.866782 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5515adf-a00d-4a64-a82d-9964d462d803 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:45.901694 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38566943-2117-46f1-ac77-1f6c52622f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:45.902241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38566943-2117-46f1-ac77-1f6c52622f85 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:45.902517 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38566943-2117-46f1-ac77-1f6c52622f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:45.902786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38566943-2117-46f1-ac77-1f6c52622f85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:45.913579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38566943-2117-46f1-ac77-1f6c52622f85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:45.918360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-38566943-2117-46f1-ac77-1f6c52622f85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:59:45.918360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:45.918360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:45.918360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:45.918360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:45.918360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:45.918360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:45.918360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:45.918360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:45.918360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:45.918360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:45.918360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:45.918360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:45.918360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:45.918360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:45.918360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:45.919252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:45.919252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:45.919252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:45.919252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:45.919252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:45.919252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:45.919252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:45.919252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:45.919252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:45.919252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:45.919252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:45.919252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:45.919252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:45.919252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:45.919252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:45.919252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:45.920062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:45.920062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:45.920062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:45.920062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:45.920062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:45.920062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:45.920062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:45.920062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:45.920062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:45.920062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:45.920062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:59:45.920062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:45.920062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 377/756] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 13:59:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:45.927034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ac8f3-0104-4d72-ada3-5f343e2281c5 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:46.085210 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ac8f3-0104-4d72-ada3-5f343e2281c5 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:46.132120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d1d64-d334-4660-8e6c-2e4c4c834a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:46.132723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d1d64-d334-4660-8e6c-2e4c4c834a86 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:46.133005 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d1d64-d334-4660-8e6c-2e4c4c834a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:46.133316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d1d64-d334-4660-8e6c-2e4c4c834a86 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:46.133985 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d1d64-d334-4660-8e6c-2e4c4c834a86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:46.134280 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d1d64-d334-4660-8e6c-2e4c4c834a86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:46.135642 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d1d64-d334-4660-8e6c-2e4c4c834a86 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:46.144436 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 380/757] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:59:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:46.151357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38566943-2117-46f1-ac77-1f6c52622f85 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:46.299193 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38566943-2117-46f1-ac77-1f6c52622f85 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:46.345345 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43dbed-81a3-47e2-a888-c2a5771317b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:46.345976 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43dbed-81a3-47e2-a888-c2a5771317b6 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:46.346250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43dbed-81a3-47e2-a888-c2a5771317b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:46.346517 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43dbed-81a3-47e2-a888-c2a5771317b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:46.360779 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43dbed-81a3-47e2-a888-c2a5771317b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:46.362271 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43dbed-81a3-47e2-a888-c2a5771317b6 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:46.379811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-8e43dbed-81a3-47e2-a888-c2a5771317b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:46.379811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:46.379811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:46.379811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:46.379811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:46.379811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:46.379811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:46.379811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:46.379811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:46.379811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:46.379811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:46.379811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:46.379811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:46.379811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:46.379811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:46.379811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:46.380795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:46.380795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:46.380795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:46.380795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:46.380795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:46.380795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:46.380795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:46.380795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:46.380795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:46.380795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:46.380795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:46.380795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:46.380795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:46.380795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:46.380795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:46.380795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:46.380795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:46.381690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:46.381690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:46.381690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:46.381690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 378/758] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:46.386743 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d1d64-d334-4660-8e6c-2e4c4c834a86 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:46.484991 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:46.549311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d1d64-d334-4660-8e6c-2e4c4c834a86 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:46.599006 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ead9f9-e2de-43df-84af-7d3586808ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:46.599613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ead9f9-e2de-43df-84af-7d3586808ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:46.599896 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ead9f9-e2de-43df-84af-7d3586808ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:46.600167 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ead9f9-e2de-43df-84af-7d3586808ab7 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:46.600819 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ead9f9-e2de-43df-84af-7d3586808ab7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:46.601138 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ead9f9-e2de-43df-84af-7d3586808ab7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:46.602513 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ead9f9-e2de-43df-84af-7d3586808ab7 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:46.632760 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 381/759] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:46.637882 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43dbed-81a3-47e2-a888-c2a5771317b6 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:46.663985 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:46.756364 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6c7c1-4c95-4d3d-8f38-62d8095f4765 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:46.756696 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6c7c1-4c95-4d3d-8f38-62d8095f4765 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:46.756915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6c7c1-4c95-4d3d-8f38-62d8095f4765 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:46.758294 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 382/760] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:46.765986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0f750-045b-4507-9cbd-e7da98181545 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:46.766261 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0f750-045b-4507-9cbd-e7da98181545 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:46.766534 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0f750-045b-4507-9cbd-e7da98181545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:46.785829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-84b0f750-045b-4507-9cbd-e7da98181545 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:46.787056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-84b0f750-045b-4507-9cbd-e7da98181545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:46.793352 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43dbed-81a3-47e2-a888-c2a5771317b6 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:46.857043 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 383/761] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 13:59:46.863908 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3b0fe-28a8-476e-832b-acd2c4cd8fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:46.864601 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3b0fe-28a8-476e-832b-acd2c4cd8fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:46.864887 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3b0fe-28a8-476e-832b-acd2c4cd8fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:46.865186 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3b0fe-28a8-476e-832b-acd2c4cd8fc1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:46.882172 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3b0fe-28a8-476e-832b-acd2c4cd8fc1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:46.883629 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3b0fe-28a8-476e-832b-acd2c4cd8fc1 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:46.901661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-79a3b0fe-28a8-476e-832b-acd2c4cd8fc1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 13:59:46.901661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:46.901661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:46.901661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:46.901661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:46.901661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:46.901661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:46.901661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:46.901661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:46.901661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:46.901661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:46.901661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:46.901661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 13:59:46.901661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 13:59:46.901661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 13:59:46.901661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 13:59:46.902634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:46.902634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:46.902634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 13:59:46.902634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:46.902634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 13:59:46.902634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:46.902634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:46.902634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:46.902634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:46.902634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:46.902634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:46.902634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:46.902634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:46.902634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:46.902634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:46.902634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:46.902634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:46.902634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:46.903565 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:46.903565 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:46.903565 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 13:59:46.903565 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 13:59:46.903565 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 13:59:46.903565 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 13:59:46.903565 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 13:59:46.903565 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 13:59:46.903565 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 13:59:46.903565 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:46.907072 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 379/762] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Sep 13 13:59:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:46.909207 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0f750-045b-4507-9cbd-e7da98181545 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:46.981512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:47.059533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0f750-045b-4507-9cbd-e7da98181545 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:47.106172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b6a23-6c66-4dd9-ab5e-5a39cd7667e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:47.106781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b6a23-6c66-4dd9-ab5e-5a39cd7667e0 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:47.107119 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b6a23-6c66-4dd9-ab5e-5a39cd7667e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:47.107331 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b6a23-6c66-4dd9-ab5e-5a39cd7667e0 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:47.108063 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b6a23-6c66-4dd9-ab5e-5a39cd7667e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:47.108369 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b6a23-6c66-4dd9-ab5e-5a39cd7667e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:47.109826 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b6a23-6c66-4dd9-ab5e-5a39cd7667e0 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:47.137274 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 384/763] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Sep 13 13:59:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:47.142488 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3b0fe-28a8-476e-832b-acd2c4cd8fc1 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:47.215609 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:47.257020 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3b0fe-28a8-476e-832b-acd2c4cd8fc1 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:47.293479 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b6a23-6c66-4dd9-ab5e-5a39cd7667e0 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:47.325668 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b478e3-29ec-40d5-8456-a4029568f49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:47.326303 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b478e3-29ec-40d5-8456-a4029568f49b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:47.326582 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b478e3-29ec-40d5-8456-a4029568f49b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:47.326853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b478e3-29ec-40d5-8456-a4029568f49b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:47.341615 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b478e3-29ec-40d5-8456-a4029568f49b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:47.343077 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b478e3-29ec-40d5-8456-a4029568f49b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:47.357863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-99b478e3-29ec-40d5-8456-a4029568f49b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:47.357863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:47.357863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:47.357863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:47.357863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:47.357863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:47.357863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:47.357863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:47.357863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:47.357863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:47.357863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:47.357863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:47.357863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:47.357863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:47.357863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:47.357863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:47.358805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:47.358805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:47.358805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:47.358805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:47.358805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:47.358805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:47.358805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:47.358805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:47.358805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:47.358805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:47.358805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:47.358805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:47.358805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:47.358805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:47.358805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:47.358805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:47.358805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:47.359684 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:47.359684 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:47.359684 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:47.359684 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 380/764] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:47.367149 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b478e3-29ec-40d5-8456-a4029568f49b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:47.490466 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:47.495000 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b6a23-6c66-4dd9-ab5e-5a39cd7667e0 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:47.507352 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b478e3-29ec-40d5-8456-a4029568f49b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:47.553459 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:47.556767 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8e45c-dcf2-4cad-b4df-2fe07a7971a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:47.557431 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8e45c-dcf2-4cad-b4df-2fe07a7971a7 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:47.557711 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8e45c-dcf2-4cad-b4df-2fe07a7971a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:47.558037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8e45c-dcf2-4cad-b4df-2fe07a7971a7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:47.558634 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8e45c-dcf2-4cad-b4df-2fe07a7971a7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:47.560008 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8e45c-dcf2-4cad-b4df-2fe07a7971a7 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:47.575541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-0bf8e45c-dcf2-4cad-b4df-2fe07a7971a7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 13:59:47.575541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:47.575541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 13:59:47.575541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 13:59:47.575541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 13:59:47.575541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 13:59:47.575541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 13:59:47.575541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 13:59:47.575541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 13:59:47.575541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:47.575541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 13:59:47.575541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:47.575541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:47.575541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:47.575541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:47.575541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:47.575541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:47.576541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:47.576541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:47.576541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:47.576541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:47.576541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:47.576541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:47.576541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 13:59:47.576541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 13:59:47.576541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 13:59:47.576541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 13:59:47.576541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:47.576541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:47.576541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:47.576541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:47.576541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:47.576541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:47.577384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:47.577384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:47.577384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:47.577384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:47.577384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:47.577384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:47.577384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:47.577384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:47.577384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:47.577384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:47.577384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 13:59:47.577384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 13:59:47.577384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 13:59:47.577384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:47.578597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62860f64-b752-4f9f-ad0c-991d9e42133b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:47.581127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62860f64-b752-4f9f-ad0c-991d9e42133b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:47.581127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62860f64-b752-4f9f-ad0c-991d9e42133b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:47.581127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62860f64-b752-4f9f-ad0c-991d9e42133b None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:47.581127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62860f64-b752-4f9f-ad0c-991d9e42133b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:47.581127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62860f64-b752-4f9f-ad0c-991d9e42133b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:47.583427 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62860f64-b752-4f9f-ad0c-991d9e42133b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:47.585181 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 385/765] 10.222.0.26 () {56 vars in 1129 bytes} [Tue Sep 13 13:59:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:59:47.586021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8e45c-dcf2-4cad-b4df-2fe07a7971a7 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:47.623872 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 381/766] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:47.630560 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62860f64-b752-4f9f-ad0c-991d9e42133b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:47.804042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8e45c-dcf2-4cad-b4df-2fe07a7971a7 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:47.816832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62860f64-b752-4f9f-ad0c-991d9e42133b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:47.854002 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70702ab2-4669-4b6a-8045-08087837ba42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:47.854502 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70702ab2-4669-4b6a-8045-08087837ba42 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:47.854764 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70702ab2-4669-4b6a-8045-08087837ba42 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:47.855029 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70702ab2-4669-4b6a-8045-08087837ba42 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:47.855660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70702ab2-4669-4b6a-8045-08087837ba42 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:47.855956 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70702ab2-4669-4b6a-8045-08087837ba42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:47.857354 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70702ab2-4669-4b6a-8045-08087837ba42 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:47.862263 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 386/767] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Sep 13 13:59:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:47.864027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082cea3-aace-4d6b-8715-c573a3d27619 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:47.864305 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082cea3-aace-4d6b-8715-c573a3d27619 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:47.864577 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082cea3-aace-4d6b-8715-c573a3d27619 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:47.867270 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b7d93-1658-4124-836d-d9d882a4ef9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:47.868440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b7d93-1658-4124-836d-d9d882a4ef9a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:47.868907 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b7d93-1658-4124-836d-d9d882a4ef9a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:47.869414 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b7d93-1658-4124-836d-d9d882a4ef9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:47.869924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 387/768] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:47.870688 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082cea3-aace-4d6b-8715-c573a3d27619 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:47.877762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b7d93-1658-4124-836d-d9d882a4ef9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:47.879837 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b7d93-1658-4124-836d-d9d882a4ef9a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:47.892137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-db6b7d93-1658-4124-836d-d9d882a4ef9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:47.892137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:47.892137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:47.892137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:47.892137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:47.892137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:47.892137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:47.892137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:47.892137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:47.892137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:47.892137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:47.892137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:47.892137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 13:59:47.892137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 13:59:47.892137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 13:59:47.893001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 13:59:47.893001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:47.893001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:47.893001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:47.893001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:47.893001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:47.893001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:47.893001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:47.893001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:47.893001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:47.893001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:47.893001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:47.893001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:47.893001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:47.893001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:47.893001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:47.893001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:47.893916 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 13:59:47.893916 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 13:59:47.893916 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 13:59:47.893916 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 13:59:47.893916 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 13:59:47.893916 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 13:59:47.893916 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:47.893916 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:47.896307 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 382/769] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:47.902161 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:47.903550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e2e7f-2f4c-48d2-bb21-cfe8bb2bbeaf None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:47.904093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e2e7f-2f4c-48d2-bb21-cfe8bb2bbeaf None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:47.904912 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e2e7f-2f4c-48d2-bb21-cfe8bb2bbeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:47.926806 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e00e2e7f-2f4c-48d2-bb21-cfe8bb2bbeaf None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:47.928456 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e00e2e7f-2f4c-48d2-bb21-cfe8bb2bbeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:47.976800 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:47.978268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082cea3-aace-4d6b-8715-c573a3d27619 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:48.012652 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 383/770] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 13:59:48.014164 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e2e7f-2f4c-48d2-bb21-cfe8bb2bbeaf None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:48.030617 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70827117-e3a2-4a11-b39f-5499bc57b7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:48.031344 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70827117-e3a2-4a11-b39f-5499bc57b7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:48.031509 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70827117-e3a2-4a11-b39f-5499bc57b7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:48.031781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70827117-e3a2-4a11-b39f-5499bc57b7a9 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:48.032431 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70827117-e3a2-4a11-b39f-5499bc57b7a9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:48.032990 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70827117-e3a2-4a11-b39f-5499bc57b7a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:48.034456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70827117-e3a2-4a11-b39f-5499bc57b7a9 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:48.049601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 388/771] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Sep 13 13:59:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:48.055522 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70827117-e3a2-4a11-b39f-5499bc57b7a9 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:48.132029 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e2e7f-2f4c-48d2-bb21-cfe8bb2bbeaf None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:48.168831 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f153f-9713-4ef1-af81-37e48ad6894e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:48.169458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f153f-9713-4ef1-af81-37e48ad6894e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:48.169731 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f153f-9713-4ef1-af81-37e48ad6894e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:48.169996 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f153f-9713-4ef1-af81-37e48ad6894e None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:48.170723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f153f-9713-4ef1-af81-37e48ad6894e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:48.171030 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f153f-9713-4ef1-af81-37e48ad6894e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:48.171835 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:48.172519 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f153f-9713-4ef1-af81-37e48ad6894e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:48.183865 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70827117-e3a2-4a11-b39f-5499bc57b7a9 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:48.184599 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 384/772] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 13:59:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:48.190446 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f74b6-f0fe-459f-b07a-9fdd2ec8ea11 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:48.190750 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f74b6-f0fe-459f-b07a-9fdd2ec8ea11 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:48.191053 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f74b6-f0fe-459f-b07a-9fdd2ec8ea11 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:48.192969 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 385/773] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:48.197131 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4244705-3215-4db7-8c18-e90d23e2eee8 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:48.197131 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4244705-3215-4db7-8c18-e90d23e2eee8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:48.197131 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4244705-3215-4db7-8c18-e90d23e2eee8 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:48.200688 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 386/774] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:48.201675 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4244705-3215-4db7-8c18-e90d23e2eee8 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:48.225431 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaabd98-4806-4f90-a45d-4617213d9ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:48.226264 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaabd98-4806-4f90-a45d-4617213d9ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:48.226700 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaabd98-4806-4f90-a45d-4617213d9ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:48.227280 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaabd98-4806-4f90-a45d-4617213d9ba8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:48.228439 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaabd98-4806-4f90-a45d-4617213d9ba8 None admin] RBAC: Adding query filter params (interface=public, service_id=df4ef3f3182041c2942e796a9dfd9e8d, region_id=RegionOne) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:48.229166 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaabd98-4806-4f90-a45d-4617213d9ba8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:48.230663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaabd98-4806-4f90-a45d-4617213d9ba8 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:48.237919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:48.243559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 389/775] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Sep 13 13:59:48 2022] GET /identity/v3/endpoints?service_id=df4ef3f3182041c2942e796a9dfd9e8d&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:48.243559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc800ce3-c674-4edf-b4d6-504b60b01c71 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:48.243559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc800ce3-c674-4edf-b4d6-504b60b01c71 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:48.243559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc800ce3-c674-4edf-b4d6-504b60b01c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:48.260466 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-dc800ce3-c674-4edf-b4d6-504b60b01c71 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:48.261827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-dc800ce3-c674-4edf-b4d6-504b60b01c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:48.310967 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4244705-3215-4db7-8c18-e90d23e2eee8 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:48.334492 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 390/776] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 13:59:48.335791 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2d505-e913-4e85-8e40-79fa4f2c6543 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:48.336179 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2d505-e913-4e85-8e40-79fa4f2c6543 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:48.336577 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2d505-e913-4e85-8e40-79fa4f2c6543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:48.346517 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9e73e-ed18-4f05-969e-19ca9aca6e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:48.347198 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9e73e-ed18-4f05-969e-19ca9aca6e59 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:48.347470 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9e73e-ed18-4f05-969e-19ca9aca6e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:48.347737 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9e73e-ed18-4f05-969e-19ca9aca6e59 None admin] PATH_INFO: `/v3/projects/17ba27c26bf34daa91cf8f7cc25bf086/users/1b3533d0a24e4e7bbf5c7137d3511b13/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:48.349652 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9e73e-ed18-4f05-969e-19ca9aca6e59 None admin] RBAC: Authorizing `identity:create_grant(project_id=17ba27c26bf34daa91cf8f7cc25bf086, user_id=1b3533d0a24e4e7bbf5c7137d3511b13, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:48.351066 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9e73e-ed18-4f05-969e-19ca9aca6e59 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:48.355105 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-27d2d505-e913-4e85-8e40-79fa4f2c6543 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:48.356506 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-27d2d505-e913-4e85-8e40-79fa4f2c6543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:48.377127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 387/777] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 13 13:59:48 2022] PUT /identity/v3/projects/17ba27c26bf34daa91cf8f7cc25bf086/users/1b3533d0a24e4e7bbf5c7137d3511b13/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 13:59:48.377127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9e73e-ed18-4f05-969e-19ca9aca6e59 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:48.437618 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 391/778] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 13:59:48.438563 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2d505-e913-4e85-8e40-79fa4f2c6543 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:48.491269 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:48.501668 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:48.512814 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9e73e-ed18-4f05-969e-19ca9aca6e59 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:48.580559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae48299-1d30-43e8-8aa1-7909ac7eb3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:48.581456 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae48299-1d30-43e8-8aa1-7909ac7eb3d3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:48.581598 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae48299-1d30-43e8-8aa1-7909ac7eb3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:48.581834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae48299-1d30-43e8-8aa1-7909ac7eb3d3 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:48.582439 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae48299-1d30-43e8-8aa1-7909ac7eb3d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:48.583812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae48299-1d30-43e8-8aa1-7909ac7eb3d3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:48.591089 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 388/779] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Sep 13 13:59:48 2022] GET /identity/v3/services => generated 772 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:48.608659 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae48299-1d30-43e8-8aa1-7909ac7eb3d3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:48.679387 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2d505-e913-4e85-8e40-79fa4f2c6543 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:48.733698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae48299-1d30-43e8-8aa1-7909ac7eb3d3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:48.761842 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f4020-ad65-4267-a10c-ae41acce58e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:48.762523 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f4020-ad65-4267-a10c-ae41acce58e1 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:48.762799 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f4020-ad65-4267-a10c-ae41acce58e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:48.763117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f4020-ad65-4267-a10c-ae41acce58e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:48.773299 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3c6af-06c0-4be0-86e6-c3f60b137ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:48.774324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3c6af-06c0-4be0-86e6-c3f60b137ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:48.774819 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3c6af-06c0-4be0-86e6-c3f60b137ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:48.775323 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3c6af-06c0-4be0-86e6-c3f60b137ae2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:48.776122 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3c6af-06c0-4be0-86e6-c3f60b137ae2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:48.776319 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f4020-ad65-4267-a10c-ae41acce58e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:48.777947 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3c6af-06c0-4be0-86e6-c3f60b137ae2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:48.781781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-136f4020-ad65-4267-a10c-ae41acce58e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:59:48.781781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:48.781781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:48.781781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:48.781781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:48.781781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:48.781781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:48.781781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:48.781781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:48.781781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:48.781781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:48.781781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:48.781781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:48.781781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:48.781781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:48.781781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:48.783042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:48.783042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:48.783042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:48.783042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:48.783042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:48.783042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:48.783042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:48.783042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:48.783042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:48.783042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:48.783042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:48.783042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:48.783042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:48.783042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:48.783042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:48.783042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:48.783864 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:48.783864 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:48.783864 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:48.783864 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:48.783864 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:48.783864 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:48.783864 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:48.783864 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:48.783864 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:48.783864 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:48.783864 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:59:48.783864 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:48.783864 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 392/780] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 13:59:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:48.784710 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f4020-ad65-4267-a10c-ae41acce58e1 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:48.794515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-70f3c6af-06c0-4be0-86e6-c3f60b137ae2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 13:59:48.794515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:48.794515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 13:59:48.794515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 13:59:48.794515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 13:59:48.794515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 13:59:48.794515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 13:59:48.794515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 13:59:48.794515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 13:59:48.794515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:48.794515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 13:59:48.794515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:48.794515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:48.794515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:48.794515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:48.794515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:48.794515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:48.795574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:48.795574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:48.795574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:48.795574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:48.795574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:48.795574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:48.795574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 13:59:48.795574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 13:59:48.795574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 13:59:48.795574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 13:59:48.795574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:48.795574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:48.795574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:48.795574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:48.795574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:48.795574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:48.796429 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:48.796429 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:48.796429 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:48.796429 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:48.796429 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:48.796429 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:48.796429 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:48.796429 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:48.796429 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:48.796429 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:48.796429 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 13:59:48.796429 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 13:59:48.796429 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 13:59:48.796429 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:48.799354 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 389/781] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:48 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:59:48.801192 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3c6af-06c0-4be0-86e6-c3f60b137ae2 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:48.828262 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:48.885437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:48.920420 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f4020-ad65-4267-a10c-ae41acce58e1 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:48.923953 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3c6af-06c0-4be0-86e6-c3f60b137ae2 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:48.960933 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7c8d6-23e7-4926-9c3c-7a531c5b15a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:48.961587 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7c8d6-23e7-4926-9c3c-7a531c5b15a5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:48.961867 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7c8d6-23e7-4926-9c3c-7a531c5b15a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:48.962141 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7c8d6-23e7-4926-9c3c-7a531c5b15a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:48.962812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7c8d6-23e7-4926-9c3c-7a531c5b15a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:48.963118 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7c8d6-23e7-4926-9c3c-7a531c5b15a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:48.964501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7c8d6-23e7-4926-9c3c-7a531c5b15a5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:48.965393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272476e5-a78d-43bb-9145-f38a292d74a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:48.966474 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272476e5-a78d-43bb-9145-f38a292d74a7 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:48.967371 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272476e5-a78d-43bb-9145-f38a292d74a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:48.967791 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272476e5-a78d-43bb-9145-f38a292d74a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:48.978206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 390/782] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:59:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:48.979114 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7c8d6-23e7-4926-9c3c-7a531c5b15a5 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:48.980179 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272476e5-a78d-43bb-9145-f38a292d74a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:48.985613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-272476e5-a78d-43bb-9145-f38a292d74a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:48.985613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:48.985613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:48.985613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:48.985613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:48.985613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:48.985613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:48.985613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:48.985613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:48.985613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:48.985613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:48.985613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:48.985613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:48.985613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:48.985613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:48.985613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:48.986717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:48.986717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:48.986717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:48.986717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:48.986717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:48.986717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:48.986717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:48.986717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:48.986717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:48.986717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:48.986717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:48.986717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:48.986717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:48.986717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:48.986717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:48.986717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:48.988250 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:48.988250 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:48.988250 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:48.988250 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:48.988250 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:48.988250 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:48.988250 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:48.988250 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:48.988250 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:48.988250 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:48.988250 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:48.988250 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:48.995088 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 393/783] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 13 13:59:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:48.996831 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272476e5-a78d-43bb-9145-f38a292d74a7 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:49.069208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:49.095661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7c8d6-23e7-4926-9c3c-7a531c5b15a5 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:49.120320 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272476e5-a78d-43bb-9145-f38a292d74a7 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:49.143540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42eb95-a2a5-4284-ae8e-b3a30f1023b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:49.144696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42eb95-a2a5-4284-ae8e-b3a30f1023b9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:49.145528 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42eb95-a2a5-4284-ae8e-b3a30f1023b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:49.146220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42eb95-a2a5-4284-ae8e-b3a30f1023b9 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:49.147018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42eb95-a2a5-4284-ae8e-b3a30f1023b9 None admin] RBAC: Adding query filter params (name=network) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:49.147679 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42eb95-a2a5-4284-ae8e-b3a30f1023b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:49.149915 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42eb95-a2a5-4284-ae8e-b3a30f1023b9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:49.156162 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 391/784] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Sep 13 13:59:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:49.157147 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42eb95-a2a5-4284-ae8e-b3a30f1023b9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:49.162121 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459c0d6-93de-4bbd-b2cd-9c6998a0f033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:49.162325 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459c0d6-93de-4bbd-b2cd-9c6998a0f033 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:49.162620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459c0d6-93de-4bbd-b2cd-9c6998a0f033 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:49.162881 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459c0d6-93de-4bbd-b2cd-9c6998a0f033 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:49.166583 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:49.177467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459c0d6-93de-4bbd-b2cd-9c6998a0f033 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:49.178942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459c0d6-93de-4bbd-b2cd-9c6998a0f033 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:49.198539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-7459c0d6-93de-4bbd-b2cd-9c6998a0f033 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:49.198539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:49.198539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:49.198539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:49.198539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:49.198539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:49.198539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:49.198539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:49.198539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:49.198539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:49.198539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:49.198539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:49.198539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:49.198539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:49.198539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:49.198539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:49.199740 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:49.199740 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:49.199740 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:49.199740 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:49.199740 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:49.199740 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:49.199740 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:49.199740 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:49.199740 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:49.199740 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:49.199740 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:49.199740 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:49.199740 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:49.199740 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:49.199740 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:49.199740 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:49.199740 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:49.200670 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:49.200670 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:49.200670 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:49.200670 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 394/785] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:49.200909 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459c0d6-93de-4bbd-b2cd-9c6998a0f033 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:49.280879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42eb95-a2a5-4284-ae8e-b3a30f1023b9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:49.323331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eded1ed-4f91-4a6b-a6ae-3df1e9c84bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:49.324491 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eded1ed-4f91-4a6b-a6ae-3df1e9c84bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:49.325214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eded1ed-4f91-4a6b-a6ae-3df1e9c84bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:49.325636 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eded1ed-4f91-4a6b-a6ae-3df1e9c84bb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:49.326442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eded1ed-4f91-4a6b-a6ae-3df1e9c84bb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:49.326890 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eded1ed-4f91-4a6b-a6ae-3df1e9c84bb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:49.327003 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459c0d6-93de-4bbd-b2cd-9c6998a0f033 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:49.328691 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eded1ed-4f91-4a6b-a6ae-3df1e9c84bb8 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:49.338685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 392/786] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 13 13:59:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:49.343527 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eded1ed-4f91-4a6b-a6ae-3df1e9c84bb8 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:49.360063 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:49.382322 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534b12f-5cda-461d-be7e-5a9ddf82da18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:49.383013 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534b12f-5cda-461d-be7e-5a9ddf82da18 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:49.383296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534b12f-5cda-461d-be7e-5a9ddf82da18 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:49.383619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534b12f-5cda-461d-be7e-5a9ddf82da18 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:49.384820 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534b12f-5cda-461d-be7e-5a9ddf82da18 None admin] RBAC: Adding query filter params (type=network) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:49.385164 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534b12f-5cda-461d-be7e-5a9ddf82da18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:49.386725 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534b12f-5cda-461d-be7e-5a9ddf82da18 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:49.394357 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 395/787] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Sep 13 13:59:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:49.394853 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534b12f-5cda-461d-be7e-5a9ddf82da18 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:49.456004 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:49.480698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eded1ed-4f91-4a6b-a6ae-3df1e9c84bb8 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:49.518043 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76813529-546d-439c-9b63-653ef5b7428a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:49.518677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76813529-546d-439c-9b63-653ef5b7428a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:49.518993 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76813529-546d-439c-9b63-653ef5b7428a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:49.519308 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76813529-546d-439c-9b63-653ef5b7428a None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:49.519946 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76813529-546d-439c-9b63-653ef5b7428a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:49.520213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534b12f-5cda-461d-be7e-5a9ddf82da18 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:49.520330 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76813529-546d-439c-9b63-653ef5b7428a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:49.521737 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76813529-546d-439c-9b63-653ef5b7428a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:49.536079 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 393/788] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:49.536907 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76813529-546d-439c-9b63-653ef5b7428a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:49.562714 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccdcb8-6aab-4910-b6dc-1498300435d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:49.563711 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccdcb8-6aab-4910-b6dc-1498300435d6 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:49.564188 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccdcb8-6aab-4910-b6dc-1498300435d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:49.564655 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccdcb8-6aab-4910-b6dc-1498300435d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:49.577530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ccdcb8-6aab-4910-b6dc-1498300435d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:49.579243 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ccdcb8-6aab-4910-b6dc-1498300435d6 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:49.598137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-f2ccdcb8-6aab-4910-b6dc-1498300435d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:49.598137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:49.598137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:49.598137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:49.598137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:49.598137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:49.598137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:49.598137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:49.598137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:49.598137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:49.598137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:49.598137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:49.598137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:49.598137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:49.598137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:49.598137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:49.599129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:49.599129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:49.599129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:49.599129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:49.599129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:49.599129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:49.599129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:49.599129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:49.599129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:49.599129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:49.599129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:49.599129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:49.599129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:49.599129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:49.599129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:49.599129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:49.599129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:49.600114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:49.600114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:49.600114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:49.602048 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 396/789] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:49.603756 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccdcb8-6aab-4910-b6dc-1498300435d6 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:49.615919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:49.650923 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76813529-546d-439c-9b63-653ef5b7428a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:49.688694 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd318290-d5d8-4f41-8a98-fbfb7863c41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:49.689378 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd318290-d5d8-4f41-8a98-fbfb7863c41d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:49.689659 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd318290-d5d8-4f41-8a98-fbfb7863c41d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:49.689928 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd318290-d5d8-4f41-8a98-fbfb7863c41d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:49.690622 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd318290-d5d8-4f41-8a98-fbfb7863c41d None admin] RBAC: Adding query filter params (interface=public, service_id=22aa9a5f7068464e96c744d37f1b5a16, region_id=RegionOne) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:49.690956 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd318290-d5d8-4f41-8a98-fbfb7863c41d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:49.692316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd318290-d5d8-4f41-8a98-fbfb7863c41d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:49.700871 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 394/790] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Sep 13 13:59:49 2022] GET /identity/v3/endpoints?service_id=22aa9a5f7068464e96c744d37f1b5a16&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:49.701927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd318290-d5d8-4f41-8a98-fbfb7863c41d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:49.721260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccdcb8-6aab-4910-b6dc-1498300435d6 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:49.724842 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:49.763671 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bfb7b-70c9-4c54-bed8-644b67533903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:49.764293 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bfb7b-70c9-4c54-bed8-644b67533903 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:49.764583 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bfb7b-70c9-4c54-bed8-644b67533903 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:49.764987 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bfb7b-70c9-4c54-bed8-644b67533903 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:49.773902 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bfb7b-70c9-4c54-bed8-644b67533903 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:49.775489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bfb7b-70c9-4c54-bed8-644b67533903 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:49.788057 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-4c2bfb7b-70c9-4c54-bed8-644b67533903 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 13:59:49.788057 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:49.788057 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:49.788057 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:49.788057 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:49.788057 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:49.788057 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:49.788057 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:49.788057 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:49.788057 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:49.788057 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:49.788057 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:49.788057 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 13:59:49.788057 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 13:59:49.788057 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 13:59:49.788057 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 13:59:49.788982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:49.788982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:49.788982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 13:59:49.788982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:49.788982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 13:59:49.788982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:49.788982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:49.788982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:49.788982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:49.788982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:49.788982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:49.788982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:49.788982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:49.788982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:49.788982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:49.788982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:49.788982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:49.788982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:49.789952 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:49.789952 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:49.789952 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 13:59:49.789952 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 13:59:49.789952 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 13:59:49.789952 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 13:59:49.789952 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 13:59:49.789952 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 13:59:49.789952 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 13:59:49.789952 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:49.789952 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 397/791] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 13:59:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:49.790531 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bfb7b-70c9-4c54-bed8-644b67533903 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:49.825001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd318290-d5d8-4f41-8a98-fbfb7863c41d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:49.868641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f44e46-1d5c-458b-b3cc-c760229ccb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:49.869450 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f44e46-1d5c-458b-b3cc-c760229ccb6d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:49.869857 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f44e46-1d5c-458b-b3cc-c760229ccb6d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:49.870221 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f44e46-1d5c-458b-b3cc-c760229ccb6d None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:49.870967 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f44e46-1d5c-458b-b3cc-c760229ccb6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:49.871371 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f44e46-1d5c-458b-b3cc-c760229ccb6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:49.873272 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f44e46-1d5c-458b-b3cc-c760229ccb6d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:49.874837 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:49.888669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 395/792] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:49.889790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f44e46-1d5c-458b-b3cc-c760229ccb6d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:49.906205 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bfb7b-70c9-4c54-bed8-644b67533903 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:49.950828 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601f19d-1e27-4feb-bb85-6b97ae7d9694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:49.951600 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601f19d-1e27-4feb-bb85-6b97ae7d9694 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:49.951983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601f19d-1e27-4feb-bb85-6b97ae7d9694 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:49.952364 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601f19d-1e27-4feb-bb85-6b97ae7d9694 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:49.953219 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601f19d-1e27-4feb-bb85-6b97ae7d9694 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:49.954814 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601f19d-1e27-4feb-bb85-6b97ae7d9694 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:49.960874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 398/793] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Sep 13 13:59:49 2022] GET /identity/v3/services => generated 772 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:49.961886 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601f19d-1e27-4feb-bb85-6b97ae7d9694 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:50.012641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:50.022649 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f44e46-1d5c-458b-b3cc-c760229ccb6d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:50.106249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbd05e-f8e1-4b02-8efd-ac6be3ae85fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:50.106782 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbd05e-f8e1-4b02-8efd-ac6be3ae85fe None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:50.107055 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbd05e-f8e1-4b02-8efd-ac6be3ae85fe None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:50.107320 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbd05e-f8e1-4b02-8efd-ac6be3ae85fe None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:50.108205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbd05e-f8e1-4b02-8efd-ac6be3ae85fe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:50.108509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbd05e-f8e1-4b02-8efd-ac6be3ae85fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:50.110000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbd05e-f8e1-4b02-8efd-ac6be3ae85fe None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:50.144412 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 396/794] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Sep 13 13:59:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:50.158505 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbd05e-f8e1-4b02-8efd-ac6be3ae85fe None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:50.165003 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601f19d-1e27-4feb-bb85-6b97ae7d9694 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:50.201837 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e3570-b521-45d9-a290-5d5ad583184c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:50.202790 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e3570-b521-45d9-a290-5d5ad583184c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:50.203242 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e3570-b521-45d9-a290-5d5ad583184c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:50.203682 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e3570-b521-45d9-a290-5d5ad583184c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:50.215313 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e3570-b521-45d9-a290-5d5ad583184c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:50.217146 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e3570-b521-45d9-a290-5d5ad583184c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:50.236589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-569e3570-b521-45d9-a290-5d5ad583184c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 13:59:50.236589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:50.236589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:50.236589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:50.236589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:50.236589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:50.236589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:50.236589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:50.236589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:50.236589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:50.236589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:50.236589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:50.236589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 13:59:50.236589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 13:59:50.236589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 13:59:50.236589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 13:59:50.237589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:50.237589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:50.237589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 13:59:50.237589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:50.237589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 13:59:50.237589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:50.237589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:50.237589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:50.237589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:50.237589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:50.237589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:50.237589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:50.237589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:50.237589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:50.237589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:50.237589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:50.237589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:50.237589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:50.239429 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:50.239429 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:50.239429 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 13:59:50.239429 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 13:59:50.239429 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 13:59:50.239429 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 13:59:50.239429 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 13:59:50.239429 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 13:59:50.239429 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 13:59:50.239429 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:50.239429 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 399/795] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Sep 13 13:59:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:50.244274 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e3570-b521-45d9-a290-5d5ad583184c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:50.255368 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:50.357731 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbd05e-f8e1-4b02-8efd-ac6be3ae85fe None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:50.420206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ead82-0cc7-4a02-bd43-3ca29e30497c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:50.420848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ead82-0cc7-4a02-bd43-3ca29e30497c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:50.424259 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ead82-0cc7-4a02-bd43-3ca29e30497c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:50.424544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ead82-0cc7-4a02-bd43-3ca29e30497c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:50.427271 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:50.448215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ead82-0cc7-4a02-bd43-3ca29e30497c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:50.449722 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ead82-0cc7-4a02-bd43-3ca29e30497c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:50.450577 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e3570-b521-45d9-a290-5d5ad583184c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:50.479179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-6d2ead82-0cc7-4a02-bd43-3ca29e30497c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:50.479179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:50.479179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:50.479179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:50.479179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:50.479179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:50.479179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:50.479179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:50.479179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:50.479179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:50.479179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:50.479179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:50.479179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:50.479179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:50.479179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:50.479179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:50.480175 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:50.480175 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:50.480175 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:50.480175 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:50.480175 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:50.480175 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:50.480175 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:50.480175 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:50.480175 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:50.480175 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:50.480175 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:50.480175 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:50.480175 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:50.480175 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:50.480175 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:50.480175 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:50.480175 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:50.481077 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:50.481077 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:50.481077 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:50.481770 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 397/796] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:50.487325 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ead82-0cc7-4a02-bd43-3ca29e30497c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:50.525287 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c690bf3-8846-4915-bb8a-cb2434809094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:50.525893 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c690bf3-8846-4915-bb8a-cb2434809094 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:50.526167 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c690bf3-8846-4915-bb8a-cb2434809094 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:50.526434 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c690bf3-8846-4915-bb8a-cb2434809094 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:50.527169 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c690bf3-8846-4915-bb8a-cb2434809094 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:50.527469 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c690bf3-8846-4915-bb8a-cb2434809094 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:50.528905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c690bf3-8846-4915-bb8a-cb2434809094 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:50.554239 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 400/797] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Sep 13 13:59:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:50.557653 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c690bf3-8846-4915-bb8a-cb2434809094 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:50.677546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ead82-0cc7-4a02-bd43-3ca29e30497c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:50.681433 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:50.749743 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965221dd-be79-4c69-81e2-92ef611b6c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:50.750353 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965221dd-be79-4c69-81e2-92ef611b6c0a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:50.750635 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965221dd-be79-4c69-81e2-92ef611b6c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:50.750906 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965221dd-be79-4c69-81e2-92ef611b6c0a None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:50.751553 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965221dd-be79-4c69-81e2-92ef611b6c0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:50.751855 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965221dd-be79-4c69-81e2-92ef611b6c0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:50.753778 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965221dd-be79-4c69-81e2-92ef611b6c0a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:50.764854 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c690bf3-8846-4915-bb8a-cb2434809094 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:50.786314 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 398/798] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:50.791796 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965221dd-be79-4c69-81e2-92ef611b6c0a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:50.813121 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e924698-8091-4c5b-b799-c4b468f3a566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:50.814655 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e924698-8091-4c5b-b799-c4b468f3a566 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:50.815134 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e924698-8091-4c5b-b799-c4b468f3a566 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:50.815625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e924698-8091-4c5b-b799-c4b468f3a566 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:50.826965 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e924698-8091-4c5b-b799-c4b468f3a566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:50.828735 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e924698-8091-4c5b-b799-c4b468f3a566 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:50.836297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:50.845042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-2e924698-8091-4c5b-b799-c4b468f3a566 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:50.845042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:50.845042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:50.845042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:50.845042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:50.845042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:50.845042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:50.845042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:50.845042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:50.845042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:50.845042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:50.845042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:50.845042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:50.845042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:50.845042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:50.845042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:50.846007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:50.846007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:50.846007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:50.846007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:50.846007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:50.846007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:50.846007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:50.846007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:50.846007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:50.846007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:50.846007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:50.846007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:50.846007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:50.846007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:50.846007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:50.846007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:50.846007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:50.846866 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:50.846866 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:50.846866 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:50.849535 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 401/799] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:59:50.851042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41348c41-eeb1-4cba-8db0-c7af19e5299a None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:50.851547 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41348c41-eeb1-4cba-8db0-c7af19e5299a None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:50.852021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41348c41-eeb1-4cba-8db0-c7af19e5299a None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:50.857692 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 402/800] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:50.858721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41348c41-eeb1-4cba-8db0-c7af19e5299a None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:50.914929 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965221dd-be79-4c69-81e2-92ef611b6c0a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:50.963063 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c7c04-8409-41f1-b4fc-1bbf3a4a2632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:50.963728 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c7c04-8409-41f1-b4fc-1bbf3a4a2632 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:50.964008 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c7c04-8409-41f1-b4fc-1bbf3a4a2632 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:50.964281 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c7c04-8409-41f1-b4fc-1bbf3a4a2632 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:50.971347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41348c41-eeb1-4cba-8db0-c7af19e5299a None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:50.974470 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c7c04-8409-41f1-b4fc-1bbf3a4a2632 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:50.977072 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c7c04-8409-41f1-b4fc-1bbf3a4a2632 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:50.994024 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-b52c7c04-8409-41f1-b4fc-1bbf3a4a2632 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:50.994024 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:50.994024 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:50.994024 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:50.994024 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:50.994024 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:50.994024 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:50.994024 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:50.994024 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:50.994024 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:50.994024 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:50.994024 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:50.994024 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 13:59:50.994024 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 13:59:50.994024 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 13:59:50.994985 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 13:59:50.994985 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:50.994985 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:50.994985 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:50.994985 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:50.994985 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:50.994985 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:50.994985 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:50.994985 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:50.994985 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:50.994985 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:50.994985 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:50.994985 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:50.994985 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:50.994985 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:50.994985 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:50.994985 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:51.000893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 13:59:51.000893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 13:59:51.000893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 13:59:51.000893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 13:59:51.000893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 13:59:51.000893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 13:59:51.000893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:51.000893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:51.000893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 399/801] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:51.000893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7c732-a165-4c31-a3de-734a21698e65 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:51.000893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7c732-a165-4c31-a3de-734a21698e65 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:51.001655 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7c732-a165-4c31-a3de-734a21698e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:51.021597 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ea26f-d850-42c4-a5ae-d884db1f014c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:51.021954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d6f7c732-a165-4c31-a3de-734a21698e65 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:51.022713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ea26f-d850-42c4-a5ae-d884db1f014c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:51.023193 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ea26f-d850-42c4-a5ae-d884db1f014c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:51.023466 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d6f7c732-a165-4c31-a3de-734a21698e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:51.024091 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ea26f-d850-42c4-a5ae-d884db1f014c None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:51.024910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ea26f-d850-42c4-a5ae-d884db1f014c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:51.025421 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ea26f-d850-42c4-a5ae-d884db1f014c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:51.026998 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ea26f-d850-42c4-a5ae-d884db1f014c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:51.040715 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 403/802] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:51.043424 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ea26f-d850-42c4-a5ae-d884db1f014c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:51.053886 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:51.113144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 400/803] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 13:59:51.113144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7c732-a165-4c31-a3de-734a21698e65 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:51.117529 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:51.162661 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ea26f-d850-42c4-a5ae-d884db1f014c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:51.199504 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7322de-f058-4b4a-a07b-87b5df649856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:51.200204 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7322de-f058-4b4a-a07b-87b5df649856 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:51.200496 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7322de-f058-4b4a-a07b-87b5df649856 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:51.200779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7322de-f058-4b4a-a07b-87b5df649856 None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:51.201511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7322de-f058-4b4a-a07b-87b5df649856 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:51.201825 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7322de-f058-4b4a-a07b-87b5df649856 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:51.203464 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7322de-f058-4b4a-a07b-87b5df649856 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:51.212469 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7c732-a165-4c31-a3de-734a21698e65 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:51.217272 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 404/804] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 13:59:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:51.219173 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08ea90-ae28-4ddc-87b4-ee13947bed36 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:51.219460 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08ea90-ae28-4ddc-87b4-ee13947bed36 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:51.219737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08ea90-ae28-4ddc-87b4-ee13947bed36 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:51.221427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 405/805] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:51.226085 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08ea90-ae28-4ddc-87b4-ee13947bed36 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:51.252821 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32e3b1-06f3-449c-98e7-35ac1cd8a63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:51.253517 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32e3b1-06f3-449c-98e7-35ac1cd8a63f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:51.253796 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32e3b1-06f3-449c-98e7-35ac1cd8a63f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:51.254068 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32e3b1-06f3-449c-98e7-35ac1cd8a63f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:51.260846 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32e3b1-06f3-449c-98e7-35ac1cd8a63f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:51.262356 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32e3b1-06f3-449c-98e7-35ac1cd8a63f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:51.274477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-7b32e3b1-06f3-449c-98e7-35ac1cd8a63f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:51.274477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:51.274477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:51.274477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:51.274477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:51.274477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:51.274477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:51.274477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:51.274477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:51.274477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:51.274477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:51.274477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:51.274477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 13:59:51.274477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 13:59:51.274477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 13:59:51.275349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 13:59:51.275349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:51.275349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:51.275349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:51.275349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:51.275349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:51.275349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:51.275349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:51.275349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:51.275349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:51.275349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:51.275349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:51.275349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:51.275349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:51.275349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:51.275349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:51.275349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:51.277271 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 13:59:51.277271 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 13:59:51.277271 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 13:59:51.277271 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 13:59:51.277271 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 13:59:51.277271 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 13:59:51.277271 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:51.277271 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:51.277271 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 401/806] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:51.277271 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93cad8-4867-4474-a735-8972c1177368 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:51.277271 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93cad8-4867-4474-a735-8972c1177368 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:51.277878 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93cad8-4867-4474-a735-8972c1177368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:51.295950 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-2b93cad8-4867-4474-a735-8972c1177368 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:51.297151 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2b93cad8-4867-4474-a735-8972c1177368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:51.307681 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:51.350545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08ea90-ae28-4ddc-87b4-ee13947bed36 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:51.377360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 402/807] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 13:59:51.378379 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93cad8-4867-4474-a735-8972c1177368 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:51.381473 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:51.397846 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83f4d7-a65c-4c97-a27b-3b2a3e5d80f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:51.399741 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83f4d7-a65c-4c97-a27b-3b2a3e5d80f3 None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:51.400799 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83f4d7-a65c-4c97-a27b-3b2a3e5d80f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:51.401503 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83f4d7-a65c-4c97-a27b-3b2a3e5d80f3 None admin] PATH_INFO: `/v3/projects/17ba27c26bf34daa91cf8f7cc25bf086/users/97c27e930f604bd38634ca08e56cf8cd/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:51.405805 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83f4d7-a65c-4c97-a27b-3b2a3e5d80f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=17ba27c26bf34daa91cf8f7cc25bf086, user_id=97c27e930f604bd38634ca08e56cf8cd, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:51.408814 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83f4d7-a65c-4c97-a27b-3b2a3e5d80f3 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:51.437383 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 406/808] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 13 13:59:51 2022] PUT /identity/v3/projects/17ba27c26bf34daa91cf8f7cc25bf086/users/97c27e930f604bd38634ca08e56cf8cd/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 13:59:51.439001 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83f4d7-a65c-4c97-a27b-3b2a3e5d80f3 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:51.585355 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93cad8-4867-4474-a735-8972c1177368 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:51.624899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f56ece-e453-4ee1-a17a-8a5abf0789ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:51.625788 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f56ece-e453-4ee1-a17a-8a5abf0789ca None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:51.626199 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f56ece-e453-4ee1-a17a-8a5abf0789ca None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:51.626579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f56ece-e453-4ee1-a17a-8a5abf0789ca None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:51.633116 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f56ece-e453-4ee1-a17a-8a5abf0789ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:51.633116 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f56ece-e453-4ee1-a17a-8a5abf0789ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:51.633116 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f56ece-e453-4ee1-a17a-8a5abf0789ca None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:51.646894 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 403/809] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 13:59:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:51.653967 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f56ece-e453-4ee1-a17a-8a5abf0789ca None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:51.663709 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83f4d7-a65c-4c97-a27b-3b2a3e5d80f3 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:51.667851 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:51.712733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed72de-1993-49ac-af37-cd5fe0e89d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:51.713432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed72de-1993-49ac-af37-cd5fe0e89d9f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:51.713709 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed72de-1993-49ac-af37-cd5fe0e89d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:51.713983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed72de-1993-49ac-af37-cd5fe0e89d9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:51.729067 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed72de-1993-49ac-af37-cd5fe0e89d9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:51.792318 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f56ece-e453-4ee1-a17a-8a5abf0789ca None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:51.835235 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f0652-0e50-4eef-8b8d-010ac1f8e9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:51.836373 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f0652-0e50-4eef-8b8d-010ac1f8e9ce None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:51.836876 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f0652-0e50-4eef-8b8d-010ac1f8e9ce None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:51.837382 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f0652-0e50-4eef-8b8d-010ac1f8e9ce None admin] PATH_INFO: `/v3/projects/17ba27c26bf34daa91cf8f7cc25bf086/users/0c41b4ecb17a43fdb05e586cce43b5a5/roles/0c389f21d4434ae0a32fc453a8f2050a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:51.850019 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-a8ed72de-1993-49ac-af37-cd5fe0e89d9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:59:51.850019 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:51.850019 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:51.850019 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:51.850019 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:51.850019 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:51.850019 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:51.850019 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:51.850019 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:51.850019 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:51.850019 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:51.850019 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:51.850019 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:51.850019 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:51.850019 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:51.850019 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:51.851028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:51.851028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:51.851028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:51.851028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:51.851028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:51.851028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:51.851028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:51.851028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:51.851028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:51.851028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:51.851028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:51.851028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:51.851028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:51.851028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:51.851028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:51.851028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:51.851881 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:51.851881 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:51.851881 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:51.851881 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:51.851881 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:51.851881 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:51.851881 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:51.851881 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:51.851881 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:51.851881 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:51.851881 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:59:51.851881 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:51.851881 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 407/810] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 13:59:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:51.852599 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed72de-1993-49ac-af37-cd5fe0e89d9f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:51.858354 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f0652-0e50-4eef-8b8d-010ac1f8e9ce None admin] RBAC: Authorizing `identity:create_grant(project_id=17ba27c26bf34daa91cf8f7cc25bf086, user_id=0c41b4ecb17a43fdb05e586cce43b5a5, role_id=0c389f21d4434ae0a32fc453a8f2050a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:51.859932 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f0652-0e50-4eef-8b8d-010ac1f8e9ce None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:51.876854 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 404/811] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 13 13:59:51 2022] PUT /identity/v3/projects/17ba27c26bf34daa91cf8f7cc25bf086/users/0c41b4ecb17a43fdb05e586cce43b5a5/roles/0c389f21d4434ae0a32fc453a8f2050a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 13:59:51.886450 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f0652-0e50-4eef-8b8d-010ac1f8e9ce None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:51.905915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:52.017137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:52.030818 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed72de-1993-49ac-af37-cd5fe0e89d9f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:52.079916 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f0652-0e50-4eef-8b8d-010ac1f8e9ce None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:52.091175 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf2061-2739-429e-ac2b-12d150779c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:52.092042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf2061-2739-429e-ac2b-12d150779c40 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:52.092469 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf2061-2739-429e-ac2b-12d150779c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:52.092886 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf2061-2739-429e-ac2b-12d150779c40 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:52.093778 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf2061-2739-429e-ac2b-12d150779c40 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:52.095326 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf2061-2739-429e-ac2b-12d150779c40 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:52.106268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-0dbf2061-2739-429e-ac2b-12d150779c40 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 13:59:52.106268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:52.106268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 13:59:52.106268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 13:59:52.106268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 13:59:52.106268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 13:59:52.106268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 13:59:52.106268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 13:59:52.106268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 13:59:52.106268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:52.106268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 13:59:52.106268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:52.106268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:52.106268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:52.106268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:52.106268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:52.106268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:52.107304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:52.107304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:52.107304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:52.107304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:52.107304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:52.107304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:52.107304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 13:59:52.107304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 13:59:52.107304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 13:59:52.107304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 13:59:52.107304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:52.107304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:52.107304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:52.107304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:52.107304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:52.107304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:52.108146 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:52.108146 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:52.108146 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:52.108146 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:52.108146 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:52.108146 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:52.108146 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:52.108146 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:52.108146 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:52.108146 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:52.108146 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 13:59:52.108146 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 13:59:52.108146 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 13:59:52.108146 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:52.110939 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 408/812] 10.222.0.26 () {56 vars in 1129 bytes} [Tue Sep 13 13:59:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:52.118164 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf2061-2739-429e-ac2b-12d150779c40 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:52.124265 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab3292-fa1c-425c-a1b5-7d1b040bc9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:52.126025 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab3292-fa1c-425c-a1b5-7d1b040bc9c9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:52.126678 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab3292-fa1c-425c-a1b5-7d1b040bc9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:52.127159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab3292-fa1c-425c-a1b5-7d1b040bc9c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:52.128559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab3292-fa1c-425c-a1b5-7d1b040bc9c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:52.129054 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab3292-fa1c-425c-a1b5-7d1b040bc9c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:52.131069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab3292-fa1c-425c-a1b5-7d1b040bc9c9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:52.142462 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 405/813] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:59:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:52.148044 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab3292-fa1c-425c-a1b5-7d1b040bc9c9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:52.294323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf2061-2739-429e-ac2b-12d150779c40 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:52.296101 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:52.339739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab3292-fa1c-425c-a1b5-7d1b040bc9c9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:52.348069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e000222-3208-4ac7-a8f1-1277234e2609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:52.348607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e000222-3208-4ac7-a8f1-1277234e2609 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:52.348880 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e000222-3208-4ac7-a8f1-1277234e2609 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:52.349163 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e000222-3208-4ac7-a8f1-1277234e2609 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:52.349795 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e000222-3208-4ac7-a8f1-1277234e2609 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:52.350090 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e000222-3208-4ac7-a8f1-1277234e2609 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:52.351443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e000222-3208-4ac7-a8f1-1277234e2609 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:52.357249 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 409/814] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Sep 13 13:59:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:52.357544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:52.358429 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa700038-f049-43d2-a2cc-776980212490 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:52.358711 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa700038-f049-43d2-a2cc-776980212490 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:52.358956 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa700038-f049-43d2-a2cc-776980212490 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:52.364963 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 410/815] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:52.365790 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa700038-f049-43d2-a2cc-776980212490 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:52.382479 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbdcaa-0dff-41cc-9786-6e6e7e26cf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:52.383132 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbdcaa-0dff-41cc-9786-6e6e7e26cf4f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:52.383850 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbdcaa-0dff-41cc-9786-6e6e7e26cf4f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:52.384127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbdcaa-0dff-41cc-9786-6e6e7e26cf4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:52.398778 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbdcaa-0dff-41cc-9786-6e6e7e26cf4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:52.400898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbdcaa-0dff-41cc-9786-6e6e7e26cf4f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:52.419579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-e0cbdcaa-0dff-41cc-9786-6e6e7e26cf4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:52.419579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:52.419579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:52.419579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:52.419579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:52.419579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:52.419579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:52.419579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:52.419579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:52.419579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:52.419579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:52.419579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:52.419579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:52.419579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:52.419579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:52.419579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:52.420572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:52.420572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:52.420572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:52.420572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:52.420572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:52.420572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:52.420572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:52.420572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:52.420572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:52.420572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:52.420572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:52.420572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:52.420572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:52.420572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:52.420572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:52.420572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:52.420572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:52.421501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:52.421501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:52.421501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:52.421675 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 406/816] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:59:52.423189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae610e-7f6f-4acc-b881-e1b2950b38ac None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:52.423385 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae610e-7f6f-4acc-b881-e1b2950b38ac None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:52.423663 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae610e-7f6f-4acc-b881-e1b2950b38ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:52.449432 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e5ae610e-7f6f-4acc-b881-e1b2950b38ac None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:52.450625 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e5ae610e-7f6f-4acc-b881-e1b2950b38ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:52.487497 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa700038-f049-43d2-a2cc-776980212490 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:52.524395 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 407/817] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 13:59:52.525059 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae610e-7f6f-4acc-b881-e1b2950b38ac None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:52.526859 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3f6c1-9cf2-4c39-a96c-7ff50f81ec85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:52.527620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3f6c1-9cf2-4c39-a96c-7ff50f81ec85 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:52.528087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3f6c1-9cf2-4c39-a96c-7ff50f81ec85 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:52.528498 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3f6c1-9cf2-4c39-a96c-7ff50f81ec85 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:52.529347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e3f6c1-9cf2-4c39-a96c-7ff50f81ec85 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:52.529857 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e3f6c1-9cf2-4c39-a96c-7ff50f81ec85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:52.531459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e3f6c1-9cf2-4c39-a96c-7ff50f81ec85 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:52.537715 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 411/818] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Sep 13 13:59:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:52.543203 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3f6c1-9cf2-4c39-a96c-7ff50f81ec85 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:52.598606 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:52.720028 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:52.722685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae610e-7f6f-4acc-b881-e1b2950b38ac None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:52.739072 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3f6c1-9cf2-4c39-a96c-7ff50f81ec85 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:52.788218 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf3480-0ca4-4272-a6b7-0db4747aff54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:52.788816 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf3480-0ca4-4272-a6b7-0db4747aff54 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:52.789085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf3480-0ca4-4272-a6b7-0db4747aff54 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:52.789370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf3480-0ca4-4272-a6b7-0db4747aff54 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:52.790008 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf3480-0ca4-4272-a6b7-0db4747aff54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:52.790303 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf3480-0ca4-4272-a6b7-0db4747aff54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:52.791679 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf3480-0ca4-4272-a6b7-0db4747aff54 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:52.801132 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67daa0-821f-413c-a64f-37b7c533036d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:52.801734 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67daa0-821f-413c-a64f-37b7c533036d None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:52.802004 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67daa0-821f-413c-a64f-37b7c533036d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:52.802278 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67daa0-821f-413c-a64f-37b7c533036d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:52.802986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67daa0-821f-413c-a64f-37b7c533036d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:52.804470 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67daa0-821f-413c-a64f-37b7c533036d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:52.815511 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 408/819] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:52.821023 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf3480-0ca4-4272-a6b7-0db4747aff54 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:52.845048 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 412/820] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 13:59:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 13:59:52.879413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67daa0-821f-413c-a64f-37b7c533036d None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:52.961199 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf3480-0ca4-4272-a6b7-0db4747aff54 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:53.043226 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a9f95-5131-42f2-b5ac-b55ed2ac7b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:53.043674 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:53.045324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a9f95-5131-42f2-b5ac-b55ed2ac7b11 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:53.045682 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a9f95-5131-42f2-b5ac-b55ed2ac7b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:53.046003 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a9f95-5131-42f2-b5ac-b55ed2ac7b11 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:53.059450 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a9f95-5131-42f2-b5ac-b55ed2ac7b11 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:53.060915 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a9f95-5131-42f2-b5ac-b55ed2ac7b11 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:53.075883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-b31a9f95-5131-42f2-b5ac-b55ed2ac7b11 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 13:59:53.075883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:53.075883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:53.075883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:53.075883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:53.075883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:53.075883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:53.075883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:53.075883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:53.075883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:53.075883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:53.075883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:53.075883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 13:59:53.075883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 13:59:53.075883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 13:59:53.075883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 13:59:53.076899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:53.076899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:53.076899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 13:59:53.076899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:53.076899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 13:59:53.076899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:53.076899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:53.076899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:53.076899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:53.076899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:53.076899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:53.076899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:53.076899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:53.076899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:53.076899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:53.076899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:53.076899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:53.076899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:53.077881 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:53.077881 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:53.077881 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 13:59:53.077881 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 13:59:53.077881 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 13:59:53.077881 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 13:59:53.077881 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 13:59:53.077881 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 13:59:53.077881 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 13:59:53.077881 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:53.078419 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 409/821] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Sep 13 13:59:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:59:53.080424 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67daa0-821f-413c-a64f-37b7c533036d None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:53.085056 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a9f95-5131-42f2-b5ac-b55ed2ac7b11 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:53.102920 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:53.128688 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfa264-6bd1-4a73-855c-31ca9c426ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:53.129706 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfa264-6bd1-4a73-855c-31ca9c426ebd None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:53.130138 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfa264-6bd1-4a73-855c-31ca9c426ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:53.130553 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfa264-6bd1-4a73-855c-31ca9c426ebd None admin] PATH_INFO: `/v3/services/network` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:53.131372 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfa264-6bd1-4a73-855c-31ca9c426ebd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:53.133000 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfa264-6bd1-4a73-855c-31ca9c426ebd None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:53.142632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-32bfa264-6bd1-4a73-855c-31ca9c426ebd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 13:59:53.142632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:53.142632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 13:59:53.142632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 13:59:53.142632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 13:59:53.142632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 13:59:53.142632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 13:59:53.142632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 13:59:53.142632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 13:59:53.142632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:53.142632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 13:59:53.142632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:53.142632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:53.142632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:53.142632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:53.142632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:53.142632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:53.143601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:53.143601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:53.143601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:53.143601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:53.143601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:53.143601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:53.143601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 13:59:53.143601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 13:59:53.143601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 13:59:53.143601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 13:59:53.143601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:53.143601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:53.143601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:53.143601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:53.143601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:53.143601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:53.144997 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:53.144997 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:53.144997 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:53.144997 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:53.144997 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:53.144997 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:53.144997 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:53.144997 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:53.144997 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:53.144997 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:53.144997 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 13:59:53.144997 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 13:59:53.144997 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 13:59:53.144997 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:53.147847 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 413/822] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:52 2022] GET /identity/v3/services/network => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:59:53.158565 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfa264-6bd1-4a73-855c-31ca9c426ebd None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:53.215531 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a9f95-5131-42f2-b5ac-b55ed2ac7b11 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:53.277648 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d145fe8-b0d7-4511-95af-ef5c35be6409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:53.278264 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d145fe8-b0d7-4511-95af-ef5c35be6409 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:53.278543 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d145fe8-b0d7-4511-95af-ef5c35be6409 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:53.278814 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d145fe8-b0d7-4511-95af-ef5c35be6409 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:53.279551 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d145fe8-b0d7-4511-95af-ef5c35be6409 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:53.279857 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d145fe8-b0d7-4511-95af-ef5c35be6409 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:53.287956 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d145fe8-b0d7-4511-95af-ef5c35be6409 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:53.312116 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 410/823] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Sep 13 13:59:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:53.317569 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d145fe8-b0d7-4511-95af-ef5c35be6409 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:53.351679 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfa264-6bd1-4a73-855c-31ca9c426ebd None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:53.417399 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e3993-dba5-4711-af31-c15b4dc3a1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:53.417921 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e3993-dba5-4711-af31-c15b4dc3a1e3 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:53.418199 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e3993-dba5-4711-af31-c15b4dc3a1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:53.418469 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e3993-dba5-4711-af31-c15b4dc3a1e3 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:53.419105 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e3993-dba5-4711-af31-c15b4dc3a1e3 None admin] RBAC: Adding query filter params (name=network) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:53.419406 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e3993-dba5-4711-af31-c15b4dc3a1e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:53.420767 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e3993-dba5-4711-af31-c15b4dc3a1e3 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:53.436036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 414/824] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Sep 13 13:59:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:53.442001 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e3993-dba5-4711-af31-c15b4dc3a1e3 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:53.442567 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:53.474430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d145fe8-b0d7-4511-95af-ef5c35be6409 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:53.476084 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:53.539834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47596e63-e65c-4bef-bbec-aa0306c5deb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:53.540449 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47596e63-e65c-4bef-bbec-aa0306c5deb9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:53.540727 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47596e63-e65c-4bef-bbec-aa0306c5deb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:53.540998 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47596e63-e65c-4bef-bbec-aa0306c5deb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:53.657081 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e3993-dba5-4711-af31-c15b4dc3a1e3 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:53.669660 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47596e63-e65c-4bef-bbec-aa0306c5deb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:53.671850 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47596e63-e65c-4bef-bbec-aa0306c5deb9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:53.732024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d937a-9705-4bd9-8e6a-97d244453b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:53.733662 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d937a-9705-4bd9-8e6a-97d244453b80 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:53.734718 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d937a-9705-4bd9-8e6a-97d244453b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:53.735309 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d937a-9705-4bd9-8e6a-97d244453b80 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:53.737049 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d937a-9705-4bd9-8e6a-97d244453b80 None admin] RBAC: Adding query filter params (type=network) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:53.737786 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d937a-9705-4bd9-8e6a-97d244453b80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:53.740662 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d937a-9705-4bd9-8e6a-97d244453b80 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:53.749284 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 415/825] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Sep 13 13:59:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:53.755413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d937a-9705-4bd9-8e6a-97d244453b80 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:53.817437 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:53.882742 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 411/826] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:59:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 13:59:53.888889 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47596e63-e65c-4bef-bbec-aa0306c5deb9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:53.917856 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:53.962445 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d937a-9705-4bd9-8e6a-97d244453b80 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:54.011804 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64174e63-44ff-4bbb-aa87-b7680911da82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:54.012979 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64174e63-44ff-4bbb-aa87-b7680911da82 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:54.012979 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64174e63-44ff-4bbb-aa87-b7680911da82 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:54.012979 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64174e63-44ff-4bbb-aa87-b7680911da82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:54.013821 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64174e63-44ff-4bbb-aa87-b7680911da82 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:54.015267 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64174e63-44ff-4bbb-aa87-b7680911da82 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:54.041485 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 416/827] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 13:59:53 2022] POST /identity/v3/endpoints => generated 337 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 13:59:54.043078 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9de17b-1c37-4552-9b8c-1726bc3cf2c0 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:54.043572 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9de17b-1c37-4552-9b8c-1726bc3cf2c0 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:54.044048 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9de17b-1c37-4552-9b8c-1726bc3cf2c0 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:54.047330 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47596e63-e65c-4bef-bbec-aa0306c5deb9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:54.050833 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 417/828] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:54.052579 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe71b2d-cf3e-4ea1-8b2e-e6d5092b3317 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:54.052861 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe71b2d-cf3e-4ea1-8b2e-e6d5092b3317 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:54.053144 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe71b2d-cf3e-4ea1-8b2e-e6d5092b3317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:54.075935 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-ebe71b2d-cf3e-4ea1-8b2e-e6d5092b3317 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:54.077176 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ebe71b2d-cf3e-4ea1-8b2e-e6d5092b3317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:54.131877 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea309f-67c7-47cc-94bf-cbc4dcf4949d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:54.133340 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea309f-67c7-47cc-94bf-cbc4dcf4949d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:54.133893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea309f-67c7-47cc-94bf-cbc4dcf4949d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:54.134374 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea309f-67c7-47cc-94bf-cbc4dcf4949d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:54.161865 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea309f-67c7-47cc-94bf-cbc4dcf4949d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:54.163709 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea309f-67c7-47cc-94bf-cbc4dcf4949d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:54.198545 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-e0ea309f-67c7-47cc-94bf-cbc4dcf4949d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:54.198545 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:54.198545 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:54.198545 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:54.198545 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:54.198545 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:54.198545 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:54.198545 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:54.198545 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:54.198545 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:54.198545 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:54.198545 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:54.198545 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:54.198545 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:54.198545 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:54.198545 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:54.199552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:54.199552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:54.199552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:54.199552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:54.199552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:54.199552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:54.199552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:54.199552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:54.199552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:54.199552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:54.199552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:54.199552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:54.199552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:54.199552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:54.199552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:54.199552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:54.199552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:54.200442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:54.200442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:54.200442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:54.202370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 412/829] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:54.208638 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea309f-67c7-47cc-94bf-cbc4dcf4949d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:54.229810 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 418/830] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 13:59:54.247212 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:54.342722 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea309f-67c7-47cc-94bf-cbc4dcf4949d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:54.378625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7c56a-02eb-46da-ad82-ccba0a45ebf6 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:54.379157 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7c56a-02eb-46da-ad82-ccba0a45ebf6 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:54.379157 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7c56a-02eb-46da-ad82-ccba0a45ebf6 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:54.380703 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 419/831] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 13:59:54.382157 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1936ff-4262-4bdd-ba23-7ffa5739501c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:54.383006 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1936ff-4262-4bdd-ba23-7ffa5739501c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:54.383545 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1936ff-4262-4bdd-ba23-7ffa5739501c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:54.384018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1936ff-4262-4bdd-ba23-7ffa5739501c None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:54.385045 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1936ff-4262-4bdd-ba23-7ffa5739501c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:54.385583 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1936ff-4262-4bdd-ba23-7ffa5739501c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:54.385690 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d819cb-f8cc-4198-a871-84fcd51b52f7 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:54.385942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d819cb-f8cc-4198-a871-84fcd51b52f7 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:54.386179 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d819cb-f8cc-4198-a871-84fcd51b52f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:54.387711 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1936ff-4262-4bdd-ba23-7ffa5739501c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:54.403781 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 413/832] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:54.408276 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e0d819cb-f8cc-4198-a871-84fcd51b52f7 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:54.408782 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e0d819cb-f8cc-4198-a871-84fcd51b52f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:54.409703 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1936ff-4262-4bdd-ba23-7ffa5739501c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:54.482103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:54.493251 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 420/833] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 13:59:54.521284 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:54.538731 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d819cb-f8cc-4198-a871-84fcd51b52f7 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:54.544480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1936ff-4262-4bdd-ba23-7ffa5739501c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:54.589140 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268dff2-ed18-4add-89f1-ccbde5e583d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:54.590304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268dff2-ed18-4add-89f1-ccbde5e583d1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:54.591054 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268dff2-ed18-4add-89f1-ccbde5e583d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:54.591540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268dff2-ed18-4add-89f1-ccbde5e583d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:54.601228 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268dff2-ed18-4add-89f1-ccbde5e583d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:54.603358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268dff2-ed18-4add-89f1-ccbde5e583d1 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:54.623206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-7268dff2-ed18-4add-89f1-ccbde5e583d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:54.623206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:54.623206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:54.623206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:54.623206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:54.623206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:54.623206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:54.623206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:54.623206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:54.623206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:54.623206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:54.623206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:54.623206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 13:59:54.623206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 13:59:54.623206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 13:59:54.624111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 13:59:54.624111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:54.624111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:54.624111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:54.624111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:54.624111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:54.624111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:54.624111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:54.624111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:54.624111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:54.624111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:54.624111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:54.624111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:54.624111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:54.624111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:54.624111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:54.624111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:54.625002 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 13:59:54.625002 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 13:59:54.625002 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 13:59:54.625002 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 13:59:54.625002 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 13:59:54.625002 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 13:59:54.625002 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:54.625002 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:54.625479 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 414/834] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:54.630413 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268dff2-ed18-4add-89f1-ccbde5e583d1 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:54.659902 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d819cb-f8cc-4198-a871-84fcd51b52f7 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:54.699750 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bb096-0f0d-4aca-aec4-75480f020435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:54.700384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bb096-0f0d-4aca-aec4-75480f020435 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:54.700659 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bb096-0f0d-4aca-aec4-75480f020435 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:54.700889 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bb096-0f0d-4aca-aec4-75480f020435 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:54.712222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245bb096-0f0d-4aca-aec4-75480f020435 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:54.717337 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-245bb096-0f0d-4aca-aec4-75480f020435 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:59:54.717337 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:54.717337 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:54.717337 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:54.717337 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:54.717337 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:54.717337 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:54.717337 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:54.717337 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:54.717337 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:54.717337 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:54.717337 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:54.717337 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:54.717337 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:54.717337 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:54.717337 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:54.718253 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:54.718253 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:54.718253 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:54.718253 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:54.718253 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:54.718253 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:54.718253 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:54.718253 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:54.718253 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:54.718253 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:54.718253 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:54.718253 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:54.718253 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:54.718253 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:54.718253 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:54.718253 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:54.719117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:54.719117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:54.719117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:54.719117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:54.719117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:54.719117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:54.719117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:54.719117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:54.719117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:54.719117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:54.719117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 13:59:54.719117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:54.723537 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 421/835] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 13:59:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:54.724514 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bb096-0f0d-4aca-aec4-75480f020435 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:54.755045 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268dff2-ed18-4add-89f1-ccbde5e583d1 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:54.793350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c161d-c79b-4193-8c55-f76e264ccc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:54.793962 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c161d-c79b-4193-8c55-f76e264ccc80 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:54.794242 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c161d-c79b-4193-8c55-f76e264ccc80 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:54.794457 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:54.794586 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c161d-c79b-4193-8c55-f76e264ccc80 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:54.795194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c161d-c79b-4193-8c55-f76e264ccc80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:54.795598 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c161d-c79b-4193-8c55-f76e264ccc80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:54.796999 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c161d-c79b-4193-8c55-f76e264ccc80 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:54.806988 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:54.813302 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 415/836] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 13:59:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:54.813302 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c161d-c79b-4193-8c55-f76e264ccc80 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:54.845286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bb096-0f0d-4aca-aec4-75480f020435 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:54.882190 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef3873-3710-444b-a5a8-8f7c553f5019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:54.882791 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef3873-3710-444b-a5a8-8f7c553f5019 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:54.883143 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef3873-3710-444b-a5a8-8f7c553f5019 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:54.883414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef3873-3710-444b-a5a8-8f7c553f5019 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:54.884098 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef3873-3710-444b-a5a8-8f7c553f5019 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:54.884396 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef3873-3710-444b-a5a8-8f7c553f5019 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:54.885782 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef3873-3710-444b-a5a8-8f7c553f5019 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:54.893971 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 422/837] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 13:59:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:54.894774 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef3873-3710-444b-a5a8-8f7c553f5019 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:54.924782 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c161d-c79b-4193-8c55-f76e264ccc80 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:54.960617 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc0aa9-147b-4e76-b9fe-b2ff0028721c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:54.961291 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc0aa9-147b-4e76-b9fe-b2ff0028721c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:54.961572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc0aa9-147b-4e76-b9fe-b2ff0028721c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:54.961843 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc0aa9-147b-4e76-b9fe-b2ff0028721c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:54.972567 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc0aa9-147b-4e76-b9fe-b2ff0028721c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 13:59:54.977909 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-cabc0aa9-147b-4e76-b9fe-b2ff0028721c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:54.977909 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:54.977909 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:54.977909 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:54.977909 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:54.977909 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:54.977909 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:54.977909 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:54.977909 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:54.977909 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:54.977909 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:54.977909 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:54.977909 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 13:59:54.977909 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 13:59:54.977909 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 13:59:54.977909 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 13:59:54.978820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 13:59:54.978820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 13:59:54.978820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 13:59:54.978820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 13:59:54.978820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:54.978820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:54.978820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:54.978820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:54.978820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:54.978820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:54.978820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:54.978820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:54.978820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:54.978820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:54.978820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:54.978820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:54.979653 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:54.979653 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:54.979653 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:54.979653 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:54.979653 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 13:59:54.979653 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 13:59:54.979653 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 13:59:54.979653 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 13:59:54.979653 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 13:59:54.979653 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 13:59:54.979653 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 13:59:54.979653 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:54.979653 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 416/838] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 13 13:59:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:54.980333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc0aa9-147b-4e76-b9fe-b2ff0028721c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:55.014270 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef3873-3710-444b-a5a8-8f7c553f5019 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:55.031259 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:55.044905 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:55.051906 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a6aaa-d054-4cbb-b01f-5d214610bb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:55.052516 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a6aaa-d054-4cbb-b01f-5d214610bb1d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:55.052794 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a6aaa-d054-4cbb-b01f-5d214610bb1d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:55.053061 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a6aaa-d054-4cbb-b01f-5d214610bb1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:55.054251 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a6aaa-d054-4cbb-b01f-5d214610bb1d None admin] RBAC: Adding query filter params (role.id=6dcc8495d2b24b3eab63dd656eb4eb6d, scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086, user.id=1b3533d0a24e4e7bbf5c7137d3511b13) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:55.054251 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a6aaa-d054-4cbb-b01f-5d214610bb1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:55.055587 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a6aaa-d054-4cbb-b01f-5d214610bb1d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:55.069131 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 423/839] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:59:54 2022] GET /identity/v3/role_assignments?user.id=1b3533d0a24e4e7bbf5c7137d3511b13&scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086&role.id=6dcc8495d2b24b3eab63dd656eb4eb6d => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:55.069131 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a6aaa-d054-4cbb-b01f-5d214610bb1d None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:55.097326 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc0aa9-147b-4e76-b9fe-b2ff0028721c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:55.135261 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03feb3f9-986b-4867-ae8b-27fc7ef753c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:55.135984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03feb3f9-986b-4867-ae8b-27fc7ef753c9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:55.136352 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03feb3f9-986b-4867-ae8b-27fc7ef753c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:55.136688 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03feb3f9-986b-4867-ae8b-27fc7ef753c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:55.148477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03feb3f9-986b-4867-ae8b-27fc7ef753c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:55.150184 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03feb3f9-986b-4867-ae8b-27fc7ef753c9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:55.167388 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-03feb3f9-986b-4867-ae8b-27fc7ef753c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:55.167388 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:55.167388 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:55.167388 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:55.167388 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:55.167388 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:55.167388 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:55.167388 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:55.167388 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:55.167388 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:55.167388 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:55.167388 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:55.167388 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:55.167388 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:55.167388 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:55.167388 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:55.168559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:55.168559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:55.168559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:55.168559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:55.168559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:55.168559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:55.168559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:55.168559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:55.168559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:55.168559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:55.168559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:55.168559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:55.168559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:55.168559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:55.168559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:55.168559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:55.168559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:55.169692 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:55.169692 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:55.169692 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:55.170496 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 417/840] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:55.176062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03feb3f9-986b-4867-ae8b-27fc7ef753c9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:55.199267 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a6aaa-d054-4cbb-b01f-5d214610bb1d None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:55.240157 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be9a7d-fa93-4a6c-a719-24d18d3d3cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:55.241013 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be9a7d-fa93-4a6c-a719-24d18d3d3cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:55.241454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be9a7d-fa93-4a6c-a719-24d18d3d3cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:55.241773 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be9a7d-fa93-4a6c-a719-24d18d3d3cb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:55.242567 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be9a7d-fa93-4a6c-a719-24d18d3d3cb2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:55.243099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be9a7d-fa93-4a6c-a719-24d18d3d3cb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:55.244480 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be9a7d-fa93-4a6c-a719-24d18d3d3cb2 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:55.261191 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 424/841] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 13 13:59:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:55.263305 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be9a7d-fa93-4a6c-a719-24d18d3d3cb2 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:55.313139 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03feb3f9-986b-4867-ae8b-27fc7ef753c9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:55.323598 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:55.328980 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:55.357296 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18f90a-126c-4f80-ab7b-de4602592a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:55.358638 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18f90a-126c-4f80-ab7b-de4602592a9c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:55.358748 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18f90a-126c-4f80-ab7b-de4602592a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:55.358961 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18f90a-126c-4f80-ab7b-de4602592a9c None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:55.359950 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18f90a-126c-4f80-ab7b-de4602592a9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:55.360254 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18f90a-126c-4f80-ab7b-de4602592a9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:55.361870 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18f90a-126c-4f80-ab7b-de4602592a9c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:55.377751 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 418/842] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:55.384066 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18f90a-126c-4f80-ab7b-de4602592a9c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:55.398199 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be9a7d-fa93-4a6c-a719-24d18d3d3cb2 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:55.437025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf23f1e-7af1-4817-a356-67557337d70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:55.437694 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf23f1e-7af1-4817-a356-67557337d70f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:55.437972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf23f1e-7af1-4817-a356-67557337d70f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:55.438242 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf23f1e-7af1-4817-a356-67557337d70f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:55.450709 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf23f1e-7af1-4817-a356-67557337d70f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:55.452355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf23f1e-7af1-4817-a356-67557337d70f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:55.470761 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-6cf23f1e-7af1-4817-a356-67557337d70f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:55.470761 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:55.470761 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:55.470761 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:55.470761 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:55.470761 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:55.470761 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:55.470761 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:55.470761 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:55.470761 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:55.470761 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:55.470761 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:55.470761 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:55.470761 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:55.470761 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:55.470761 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:55.471737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:55.471737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:55.471737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:55.471737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:55.471737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:55.471737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:55.471737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:55.471737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:55.471737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:55.471737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:55.471737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:55.471737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:55.471737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:55.471737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:55.471737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:55.471737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:55.471737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:55.473673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:55.473673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:55.473673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:55.473673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 425/843] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:55.474182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0433c0-7885-4abe-bc3b-cafc58d5d730 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:55.474182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0433c0-7885-4abe-bc3b-cafc58d5d730 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:55.474454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0433c0-7885-4abe-bc3b-cafc58d5d730 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:55.475817 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 426/844] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:55.478430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0433c0-7885-4abe-bc3b-cafc58d5d730 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:55.510046 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18f90a-126c-4f80-ab7b-de4602592a9c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:55.552368 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be192b33-5cd0-4b5b-aa57-da80231ea9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:55.553703 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be192b33-5cd0-4b5b-aa57-da80231ea9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:55.553979 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be192b33-5cd0-4b5b-aa57-da80231ea9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:55.554243 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be192b33-5cd0-4b5b-aa57-da80231ea9b7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:55.562777 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be192b33-5cd0-4b5b-aa57-da80231ea9b7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:55.564954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be192b33-5cd0-4b5b-aa57-da80231ea9b7 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:55.578994 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:55.579304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-be192b33-5cd0-4b5b-aa57-da80231ea9b7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 13:59:55.579304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:55.579304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:55.579304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:55.579304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:55.579304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:55.579304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:55.579304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:55.579304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:55.579304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:55.579304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:55.579304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:55.579304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 13:59:55.579304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 13:59:55.579304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 13:59:55.579304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 13:59:55.580214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:55.580214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:55.580214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 13:59:55.580214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:55.580214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 13:59:55.580214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:55.580214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:55.580214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:55.580214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:55.580214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:55.580214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:55.580214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:55.580214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:55.580214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:55.580214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:55.580214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:55.580214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:55.580214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:55.581992 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:55.581992 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:55.581992 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 13:59:55.581992 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 13:59:55.581992 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 13:59:55.581992 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 13:59:55.581992 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 13:59:55.581992 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 13:59:55.581992 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 13:59:55.581992 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:55.581992 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 419/845] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 13:59:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:59:55.581992 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbff1f-7068-4472-b28d-5dbf067aca16 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:55.582630 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbff1f-7068-4472-b28d-5dbf067aca16 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:55.582630 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbff1f-7068-4472-b28d-5dbf067aca16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:55.594117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0433c0-7885-4abe-bc3b-cafc58d5d730 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:55.601012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-9ccbff1f-7068-4472-b28d-5dbf067aca16 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:55.602664 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9ccbff1f-7068-4472-b28d-5dbf067aca16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:55.633472 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:55.642245 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc261b-ed4e-42a5-8d77-66a63a932aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:55.642854 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc261b-ed4e-42a5-8d77-66a63a932aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:55.643133 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc261b-ed4e-42a5-8d77-66a63a932aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:55.643407 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc261b-ed4e-42a5-8d77-66a63a932aa0 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:55.644079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc261b-ed4e-42a5-8d77-66a63a932aa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:55.644382 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc261b-ed4e-42a5-8d77-66a63a932aa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:55.645795 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc261b-ed4e-42a5-8d77-66a63a932aa0 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:55.658537 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 427/846] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:55.659461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc261b-ed4e-42a5-8d77-66a63a932aa0 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:55.685072 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 420/847] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:55 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 13:59:55.686315 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbff1f-7068-4472-b28d-5dbf067aca16 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:55.780836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc261b-ed4e-42a5-8d77-66a63a932aa0 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:55.819979 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d772ba-6cff-4349-b3b3-4446de917055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:55.820847 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d772ba-6cff-4349-b3b3-4446de917055 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:55.821301 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d772ba-6cff-4349-b3b3-4446de917055 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:55.821762 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d772ba-6cff-4349-b3b3-4446de917055 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:55.822738 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d772ba-6cff-4349-b3b3-4446de917055 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:55.823188 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d772ba-6cff-4349-b3b3-4446de917055 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:55.824905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d772ba-6cff-4349-b3b3-4446de917055 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:55.837408 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbff1f-7068-4472-b28d-5dbf067aca16 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:55.844455 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 428/848] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Sep 13 13:59:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:55.850521 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d772ba-6cff-4349-b3b3-4446de917055 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:55.867189 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:55.886685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b32bf9-4111-47d8-9ef3-af6988bd705b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:55.887896 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b32bf9-4111-47d8-9ef3-af6988bd705b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:55.888776 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b32bf9-4111-47d8-9ef3-af6988bd705b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:55.889585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b32bf9-4111-47d8-9ef3-af6988bd705b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:55.903070 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b32bf9-4111-47d8-9ef3-af6988bd705b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:55.905477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b32bf9-4111-47d8-9ef3-af6988bd705b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:55.924094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-13b32bf9-4111-47d8-9ef3-af6988bd705b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 13:59:55.924094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:55.924094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:55.924094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:55.924094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:55.924094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:55.924094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:55.924094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:55.924094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:55.924094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:55.924094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:55.924094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:55.924094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 13:59:55.924094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 13:59:55.924094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 13:59:55.924094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 13:59:55.925438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:55.925438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:55.925438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 13:59:55.925438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:55.925438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 13:59:55.925438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 13:59:55.925438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:55.925438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:55.925438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:55.925438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:55.925438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:55.925438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:55.925438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:55.925438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:55.925438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:55.925438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:55.925438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:55.925438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:55.926389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:55.926389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:55.926389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 13:59:55.926389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 13:59:55.926389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 13:59:55.926389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 13:59:55.926389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 13:59:55.926389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 13:59:55.926389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 13:59:55.926389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:55.929521 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 421/849] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Sep 13 13:59:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:55.934909 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b32bf9-4111-47d8-9ef3-af6988bd705b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:55.968792 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:55.973339 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d772ba-6cff-4349-b3b3-4446de917055 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:56.010207 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f52d17-86d6-440a-ab1e-d72a62d6012f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:56.010840 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f52d17-86d6-440a-ab1e-d72a62d6012f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:56.011091 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f52d17-86d6-440a-ab1e-d72a62d6012f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:56.011362 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f52d17-86d6-440a-ab1e-d72a62d6012f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:56.050852 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b32bf9-4111-47d8-9ef3-af6988bd705b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:56.084909 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f52d17-86d6-440a-ab1e-d72a62d6012f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:56.086002 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b55160-7f49-4ed2-b980-186bff589ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:56.086335 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f52d17-86d6-440a-ab1e-d72a62d6012f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:56.086808 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b55160-7f49-4ed2-b980-186bff589ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:56.087152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b55160-7f49-4ed2-b980-186bff589ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:56.087489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b55160-7f49-4ed2-b980-186bff589ef4 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:56.088440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b55160-7f49-4ed2-b980-186bff589ef4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:56.088603 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b55160-7f49-4ed2-b980-186bff589ef4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:56.090529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b55160-7f49-4ed2-b980-186bff589ef4 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:56.104097 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:56.110855 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 422/850] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Sep 13 13:59:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:56.111829 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b55160-7f49-4ed2-b980-186bff589ef4 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:56.201650 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 429/851] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:59:55 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 13:59:56.202548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f52d17-86d6-440a-ab1e-d72a62d6012f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:56.205655 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:56.227555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b55160-7f49-4ed2-b980-186bff589ef4 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:56.263396 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0f5fe-d965-40d7-b24a-45e2c48db0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:56.264355 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0f5fe-d965-40d7-b24a-45e2c48db0e6 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:56.264784 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0f5fe-d965-40d7-b24a-45e2c48db0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:56.265251 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0f5fe-d965-40d7-b24a-45e2c48db0e6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:56.265976 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0f5fe-d965-40d7-b24a-45e2c48db0e6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:56.267612 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0f5fe-d965-40d7-b24a-45e2c48db0e6 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:56.277376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-0af0f5fe-d965-40d7-b24a-45e2c48db0e6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 13:59:56.277376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:56.277376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 13:59:56.277376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 13:59:56.277376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 13:59:56.277376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 13:59:56.277376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 13:59:56.277376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 13:59:56.277376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 13:59:56.277376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:56.277376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 13:59:56.277376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:56.277376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:56.277376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:56.277376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:56.277376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:56.277376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:56.278521 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:56.278521 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:56.278521 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:56.278521 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:56.278521 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:56.278521 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:56.278521 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 13:59:56.278521 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 13:59:56.278521 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 13:59:56.278521 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 13:59:56.278521 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:56.278521 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:56.278521 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:56.278521 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:56.278521 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:56.278521 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:56.279550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:56.279550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:56.279550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:56.279550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:56.279550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:56.279550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:56.279550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:56.279550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:56.279550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:56.279550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:56.279550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 13:59:56.279550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 13:59:56.279550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 13:59:56.279550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:56.287463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 423/852] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 13 13:59:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:56.288481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0f5fe-d965-40d7-b24a-45e2c48db0e6 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:56.303852 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f52d17-86d6-440a-ab1e-d72a62d6012f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:56.317394 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:56.339405 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eee90d-f739-43c5-9bf0-f12260750549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:56.339927 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eee90d-f739-43c5-9bf0-f12260750549 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:56.340364 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eee90d-f739-43c5-9bf0-f12260750549 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:56.340638 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eee90d-f739-43c5-9bf0-f12260750549 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:56.400766 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0f5fe-d965-40d7-b24a-45e2c48db0e6 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:56.415819 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eee90d-f739-43c5-9bf0-f12260750549 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:56.417291 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eee90d-f739-43c5-9bf0-f12260750549 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:56.439929 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f2a0b-6014-4391-b497-f341e9006146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:56.440605 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f2a0b-6014-4391-b497-f341e9006146 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:56.440862 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f2a0b-6014-4391-b497-f341e9006146 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:56.441152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f2a0b-6014-4391-b497-f341e9006146 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:56.452321 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f2a0b-6014-4391-b497-f341e9006146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:56.453805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f2a0b-6014-4391-b497-f341e9006146 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:56.457312 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:56.470358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-827f2a0b-6014-4391-b497-f341e9006146 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:56.470358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:56.470358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:56.470358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:56.470358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:56.470358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:56.470358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:56.470358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:56.470358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:56.470358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:56.470358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:56.470358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:56.470358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:56.470358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:56.470358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:56.470358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:56.471327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:56.471327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:56.471327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:56.471327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:56.471327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:56.471327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:56.471327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:56.471327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:56.471327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:56.471327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:56.471327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:56.471327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:56.471327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:56.471327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:56.471327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:56.471327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:56.471327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:56.472865 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:56.472865 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:56.472865 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:56.472865 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 424/853] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:56.474029 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f2a0b-6014-4391-b497-f341e9006146 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:56.536195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 430/854] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 13:59:56 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 13:59:56.537201 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eee90d-f739-43c5-9bf0-f12260750549 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:56.553770 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:56.579695 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f2a0b-6014-4391-b497-f341e9006146 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:56.615780 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4ab39-a70a-4305-81f5-32d7940ffa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:56.616323 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4ab39-a70a-4305-81f5-32d7940ffa47 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:56.616602 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4ab39-a70a-4305-81f5-32d7940ffa47 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:56.616870 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4ab39-a70a-4305-81f5-32d7940ffa47 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:56.617532 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb4ab39-a70a-4305-81f5-32d7940ffa47 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:56.618156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb4ab39-a70a-4305-81f5-32d7940ffa47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:56.619188 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb4ab39-a70a-4305-81f5-32d7940ffa47 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:56.628112 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 425/855] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 13 13:59:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:56.628112 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4ab39-a70a-4305-81f5-32d7940ffa47 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:56.658187 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eee90d-f739-43c5-9bf0-f12260750549 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:56.683734 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:56.697555 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381dcbb4-8b02-4e90-ab28-b5c7457d4cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:56.698163 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dcbb4-8b02-4e90-ab28-b5c7457d4cfa None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:56.698442 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dcbb4-8b02-4e90-ab28-b5c7457d4cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:56.698711 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dcbb4-8b02-4e90-ab28-b5c7457d4cfa None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:56.699356 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381dcbb4-8b02-4e90-ab28-b5c7457d4cfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:56.699652 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381dcbb4-8b02-4e90-ab28-b5c7457d4cfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:56.701440 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381dcbb4-8b02-4e90-ab28-b5c7457d4cfa None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:56.719873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 431/856] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:56.720730 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381dcbb4-8b02-4e90-ab28-b5c7457d4cfa None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:56.728132 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4ab39-a70a-4305-81f5-32d7940ffa47 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:56.764954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2e920-f368-4e64-8aca-76b1454cc6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:56.765927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2e920-f368-4e64-8aca-76b1454cc6b9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:56.766214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2e920-f368-4e64-8aca-76b1454cc6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:56.766653 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2e920-f368-4e64-8aca-76b1454cc6b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:56.777984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc2e920-f368-4e64-8aca-76b1454cc6b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:56.779441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc2e920-f368-4e64-8aca-76b1454cc6b9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:56.793383 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:56.794275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-9fc2e920-f368-4e64-8aca-76b1454cc6b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:56.794275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:56.794275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:56.794275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:56.794275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:56.794275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:56.794275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:56.794275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:56.794275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:56.794275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:56.794275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:56.794275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:56.794275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 13:59:56.794275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 13:59:56.794275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 13:59:56.794275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 13:59:56.795190 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:56.795190 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:56.795190 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:56.795190 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:56.795190 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:56.795190 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:56.795190 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:56.795190 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:56.795190 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:56.795190 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:56.795190 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:56.795190 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:56.795190 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:56.795190 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:56.795190 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:56.795190 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:56.795190 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 13:59:56.796078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 13:59:56.796078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 13:59:56.796078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:56.796078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 426/857] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 13:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:56.796699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2e920-f368-4e64-8aca-76b1454cc6b9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:56.832164 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381dcbb4-8b02-4e90-ab28-b5c7457d4cfa None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:56.868996 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1c6f9-17fa-4237-8e9e-2c63e155109d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:56.869634 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1c6f9-17fa-4237-8e9e-2c63e155109d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:56.869939 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1c6f9-17fa-4237-8e9e-2c63e155109d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:56.870211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1c6f9-17fa-4237-8e9e-2c63e155109d None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:56.870834 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1c6f9-17fa-4237-8e9e-2c63e155109d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:56.871131 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1c6f9-17fa-4237-8e9e-2c63e155109d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:56.872490 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1c6f9-17fa-4237-8e9e-2c63e155109d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:56.885126 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 432/858] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 13 13:59:56 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:56.885126 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1c6f9-17fa-4237-8e9e-2c63e155109d None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:56.916430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2e920-f368-4e64-8aca-76b1454cc6b9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:56.932529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:56.960609 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b76c1-6efe-43b9-b0de-d50f28d34c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:56.961415 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b76c1-6efe-43b9-b0de-d50f28d34c9b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:56.961766 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b76c1-6efe-43b9-b0de-d50f28d34c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:56.962044 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b76c1-6efe-43b9-b0de-d50f28d34c9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:56.973775 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b76c1-6efe-43b9-b0de-d50f28d34c9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:56.975216 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b76c1-6efe-43b9-b0de-d50f28d34c9b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:56.989357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-b34b76c1-6efe-43b9-b0de-d50f28d34c9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:56.989357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:56.989357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:56.989357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:56.989357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:56.989357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:56.989357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:56.989357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:56.989357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:56.989357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:56.989357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:56.989357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:56.989357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 13:59:56.989357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 13:59:56.989357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 13:59:56.990297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 13:59:56.990297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:56.990297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:56.990297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:56.990297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:56.990297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:56.990297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:56.990297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:56.990297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:56.990297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:56.990297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:56.990297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:56.990297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:56.990297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:56.990297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:56.990297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:56.990297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:56.991485 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 13:59:56.991485 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 13:59:56.991485 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 13:59:56.991485 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 13:59:56.991485 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 13:59:56.991485 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 13:59:56.991485 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:56.991485 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:56.991485 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 427/859] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:56.996470 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b76c1-6efe-43b9-b0de-d50f28d34c9b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:57.022237 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1c6f9-17fa-4237-8e9e-2c63e155109d None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:57.068134 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c643dc-787b-49bf-93f5-b0f54237b608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:57.068795 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c643dc-787b-49bf-93f5-b0f54237b608 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:57.069076 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c643dc-787b-49bf-93f5-b0f54237b608 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:57.069387 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c643dc-787b-49bf-93f5-b0f54237b608 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:57.070613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c643dc-787b-49bf-93f5-b0f54237b608 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:57.070931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c643dc-787b-49bf-93f5-b0f54237b608 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:57.072487 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c643dc-787b-49bf-93f5-b0f54237b608 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:57.075723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:57.091769 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 433/860] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 13:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:57.098120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c643dc-787b-49bf-93f5-b0f54237b608 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:57.141494 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b76c1-6efe-43b9-b0de-d50f28d34c9b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:57.186656 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e004e5-3adf-4207-aae7-cf6d12cca8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:57.187828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e004e5-3adf-4207-aae7-cf6d12cca8b2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:57.189069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e004e5-3adf-4207-aae7-cf6d12cca8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:57.189571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e004e5-3adf-4207-aae7-cf6d12cca8b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:57.190470 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e004e5-3adf-4207-aae7-cf6d12cca8b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:57.191546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e004e5-3adf-4207-aae7-cf6d12cca8b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:57.193227 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e004e5-3adf-4207-aae7-cf6d12cca8b2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:57.211829 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 428/861] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 13:59:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:57.217367 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e004e5-3adf-4207-aae7-cf6d12cca8b2 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:57.224180 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c643dc-787b-49bf-93f5-b0f54237b608 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:57.250992 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:57.272429 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2e58b-d54f-426c-a7dd-82128cac125f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:57.273733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2e58b-d54f-426c-a7dd-82128cac125f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:57.274775 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2e58b-d54f-426c-a7dd-82128cac125f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:57.275256 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2e58b-d54f-426c-a7dd-82128cac125f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:57.285476 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2e58b-d54f-426c-a7dd-82128cac125f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:57.287809 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2e58b-d54f-426c-a7dd-82128cac125f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:57.304315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-32c2e58b-d54f-426c-a7dd-82128cac125f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:57.304315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:57.304315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:57.304315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:57.304315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:57.304315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:57.304315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:57.304315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:57.304315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:57.304315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:57.304315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:57.304315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:57.304315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 13:59:57.304315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 13:59:57.304315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 13:59:57.305441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 13:59:57.305441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:57.305441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:57.305441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:57.305441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:57.305441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:57.305441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:57.305441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:57.305441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:57.305441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:57.305441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:57.305441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:57.305441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:57.305441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:57.305441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:57.305441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:57.305441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:57.306533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 13:59:57.306533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 13:59:57.306533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 13:59:57.306533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 13:59:57.306533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 13:59:57.306533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 13:59:57.306533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 13:59:57.306533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 13:59:57.313723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 434/862] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 13:59:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 13:59:57.315583 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2e58b-d54f-426c-a7dd-82128cac125f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:57.338026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e004e5-3adf-4207-aae7-cf6d12cca8b2 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:57.376522 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264765c-a535-48d5-8785-34ab0d08712d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:57.377154 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264765c-a535-48d5-8785-34ab0d08712d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:57.377436 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264765c-a535-48d5-8785-34ab0d08712d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:57.377709 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264765c-a535-48d5-8785-34ab0d08712d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:57.378572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a264765c-a535-48d5-8785-34ab0d08712d None admin] RBAC: Adding query filter params (role.id=6dcc8495d2b24b3eab63dd656eb4eb6d, scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086, user.id=97c27e930f604bd38634ca08e56cf8cd) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:57.378881 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a264765c-a535-48d5-8785-34ab0d08712d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:57.380315 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a264765c-a535-48d5-8785-34ab0d08712d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:57.386805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 429/863] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:59:57 2022] GET /identity/v3/role_assignments?user.id=97c27e930f604bd38634ca08e56cf8cd&scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086&role.id=6dcc8495d2b24b3eab63dd656eb4eb6d => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:57.387548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:57.389261 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec538170-233e-4418-8283-314ae3b99d8a None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:57.389261 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec538170-233e-4418-8283-314ae3b99d8a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:57.389261 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec538170-233e-4418-8283-314ae3b99d8a None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:57.389899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 430/864] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:57.402992 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ad6a8-5080-46d6-bd5d-6b37bc3fe82d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:57.403190 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ad6a8-5080-46d6-bd5d-6b37bc3fe82d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:57.403444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ad6a8-5080-46d6-bd5d-6b37bc3fe82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:57.428226 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d52ad6a8-5080-46d6-bd5d-6b37bc3fe82d None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:57.430753 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d52ad6a8-5080-46d6-bd5d-6b37bc3fe82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:57.453780 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2e58b-d54f-426c-a7dd-82128cac125f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:57.492753 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4fec5-9b2b-49ef-ad77-fa693eb30768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:57.493496 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4fec5-9b2b-49ef-ad77-fa693eb30768 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:57.493841 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4fec5-9b2b-49ef-ad77-fa693eb30768 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:57.494178 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4fec5-9b2b-49ef-ad77-fa693eb30768 None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:57.494967 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4fec5-9b2b-49ef-ad77-fa693eb30768 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:57.495342 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4fec5-9b2b-49ef-ad77-fa693eb30768 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:57.496902 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4fec5-9b2b-49ef-ad77-fa693eb30768 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:57.516199 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 435/865] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 13:59:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 13:59:57.517692 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4fec5-9b2b-49ef-ad77-fa693eb30768 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:57.541149 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 431/866] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 13:59:57.634243 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4fec5-9b2b-49ef-ad77-fa693eb30768 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:57.652756 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:57.672744 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43658c07-9d68-44ff-9e9e-4b4dfbee80fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:57.673349 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43658c07-9d68-44ff-9e9e-4b4dfbee80fc None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:57.673620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43658c07-9d68-44ff-9e9e-4b4dfbee80fc None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:57.673886 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43658c07-9d68-44ff-9e9e-4b4dfbee80fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:57.674608 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43658c07-9d68-44ff-9e9e-4b4dfbee80fc None admin] RBAC: Adding query filter params (role.id=0c389f21d4434ae0a32fc453a8f2050a, scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086, user.id=0c41b4ecb17a43fdb05e586cce43b5a5) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:57.674943 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43658c07-9d68-44ff-9e9e-4b4dfbee80fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:57.676378 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43658c07-9d68-44ff-9e9e-4b4dfbee80fc None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:57.683032 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 436/867] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 13:59:57 2022] GET /identity/v3/role_assignments?user.id=0c41b4ecb17a43fdb05e586cce43b5a5&scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086&role.id=0c389f21d4434ae0a32fc453a8f2050a => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:57.844000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ad6a8-5080-46d6-bd5d-6b37bc3fe82d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:57.873184 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:57.956335 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ad6a8-5080-46d6-bd5d-6b37bc3fe82d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:57.992990 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13c888-08d4-46d9-8df7-d1dfc0ad0990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:57.993654 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13c888-08d4-46d9-8df7-d1dfc0ad0990 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:57.993934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13c888-08d4-46d9-8df7-d1dfc0ad0990 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:57.994205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13c888-08d4-46d9-8df7-d1dfc0ad0990 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:57.994787 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13c888-08d4-46d9-8df7-d1dfc0ad0990 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:57.996167 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13c888-08d4-46d9-8df7-d1dfc0ad0990 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:58.005331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-6a13c888-08d4-46d9-8df7-d1dfc0ad0990 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 13:59:58.005331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:58.005331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 13:59:58.005331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 13:59:58.005331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 13:59:58.005331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 13:59:58.005331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 13:59:58.005331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 13:59:58.005331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 13:59:58.005331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:58.005331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 13:59:58.005331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:58.005331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 13:59:58.005331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 13:59:58.005331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 13:59:58.005331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 13:59:58.006278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 13:59:58.006278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 13:59:58.006278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 13:59:58.006278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 13:59:58.006278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 13:59:58.006278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 13:59:58.006278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 13:59:58.006278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 13:59:58.006278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 13:59:58.006278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 13:59:58.006278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 13:59:58.006278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 13:59:58.006278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 13:59:58.006278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 13:59:58.006278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 13:59:58.006278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 13:59:58.006278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 13:59:58.007161 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 13:59:58.007161 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 13:59:58.007161 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 13:59:58.007161 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 13:59:58.007161 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 13:59:58.007161 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 13:59:58.007161 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 13:59:58.007161 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 13:59:58.007161 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 13:59:58.007161 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 13:59:58.007161 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 13:59:58.007161 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 13:59:58.007161 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 13:59:58.007161 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 13:59:58.007161 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 432/868] 10.222.0.26 () {56 vars in 1132 bytes} [Tue Sep 13 13:59:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 13:59:58.012172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43658c07-9d68-44ff-9e9e-4b4dfbee80fc None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:58.121306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43658c07-9d68-44ff-9e9e-4b4dfbee80fc None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:58.159866 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928be07e-377f-489d-ade3-3b5257a54ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:58.160836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928be07e-377f-489d-ade3-3b5257a54ebd None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:58.161388 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928be07e-377f-489d-ade3-3b5257a54ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:58.161866 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928be07e-377f-489d-ade3-3b5257a54ebd None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:58.162702 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928be07e-377f-489d-ade3-3b5257a54ebd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:58.163206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928be07e-377f-489d-ade3-3b5257a54ebd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:58.164772 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928be07e-377f-489d-ade3-3b5257a54ebd None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:58.170168 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 437/869] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Sep 13 13:59:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:58.177140 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13c888-08d4-46d9-8df7-d1dfc0ad0990 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:58.270052 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:58.281825 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13c888-08d4-46d9-8df7-d1dfc0ad0990 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:58.320922 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187ee38-63cb-4a3a-a966-238524e380f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:58.321562 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187ee38-63cb-4a3a-a966-238524e380f9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:58.321845 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187ee38-63cb-4a3a-a966-238524e380f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:58.322121 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187ee38-63cb-4a3a-a966-238524e380f9 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:58.322763 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187ee38-63cb-4a3a-a966-238524e380f9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 13:59:58.323067 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187ee38-63cb-4a3a-a966-238524e380f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:58.324449 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187ee38-63cb-4a3a-a966-238524e380f9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:58.329435 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 433/870] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Sep 13 13:59:58 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 13:59:59.124733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0a878-8567-4720-bfb5-de96225bd964 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:59.125295 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0a878-8567-4720-bfb5-de96225bd964 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:59.125295 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0a878-8567-4720-bfb5-de96225bd964 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:59.126894 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 438/871] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:59.132729 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea630e0-875f-4c90-a4fa-da999843ed59 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:59.133017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea630e0-875f-4c90-a4fa-da999843ed59 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:59.133330 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea630e0-875f-4c90-a4fa-da999843ed59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:59.151632 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-bea630e0-875f-4c90-a4fa-da999843ed59 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:59.152822 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-bea630e0-875f-4c90-a4fa-da999843ed59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:59.226103 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 434/872] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 13:59:59.496729 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0a878-8567-4720-bfb5-de96225bd964 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 13:59:59.546445 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:59:59.610485 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0a878-8567-4720-bfb5-de96225bd964 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 13:59:59.653614 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf1a99-afba-49b4-ab26-f70392ef7450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 13:59:59.654225 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf1a99-afba-49b4-ab26-f70392ef7450 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:59.654503 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf1a99-afba-49b4-ab26-f70392ef7450 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:59.654774 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf1a99-afba-49b4-ab26-f70392ef7450 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:59.655435 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf1a99-afba-49b4-ab26-f70392ef7450 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 13:59:59.656804 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf1a99-afba-49b4-ab26-f70392ef7450 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 13:59:59.676172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 439/873] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Sep 13 13:59:59 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 13:59:59.801454 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63cf75-8c25-4919-a450-3d78354f50e7 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:59.801945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63cf75-8c25-4919-a450-3d78354f50e7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:59.801945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63cf75-8c25-4919-a450-3d78354f50e7 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:59.803516 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 435/874] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 13:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 13:59:59.809379 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdfedb-290f-4654-b5f1-6d2997736857 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 13:59:59.809973 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdfedb-290f-4654-b5f1-6d2997736857 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 13:59:59.810460 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdfedb-290f-4654-b5f1-6d2997736857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 13:59:59.831878 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-6fbdfedb-290f-4654-b5f1-6d2997736857 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 13:59:59.833601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-6fbdfedb-290f-4654-b5f1-6d2997736857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 13:59:59.916492 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 440/875] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 13:59:59 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:00:00.021228 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d99d73-3f12-41d2-9fab-bafb51fe20e5 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:00.021941 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d99d73-3f12-41d2-9fab-bafb51fe20e5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:00.022428 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d99d73-3f12-41d2-9fab-bafb51fe20e5 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:00.024305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 436/876] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:00:00.029809 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc56446-47df-48b8-b018-75b58bf00829 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:00.030099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc56446-47df-48b8-b018-75b58bf00829 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:00.030370 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc56446-47df-48b8-b018-75b58bf00829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:00.050660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-5fc56446-47df-48b8-b018-75b58bf00829 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:00.051902 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5fc56446-47df-48b8-b018-75b58bf00829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:00.076712 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:00.127849 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 441/877] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:00 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:00:00.197514 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d99d73-3f12-41d2-9fab-bafb51fe20e5 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:00.297044 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:00.318567 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d99d73-3f12-41d2-9fab-bafb51fe20e5 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:00.355197 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d4025-9184-4337-a423-843c58fdb3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:00.356185 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d4025-9184-4337-a423-843c58fdb3a4 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:00.356699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d4025-9184-4337-a423-843c58fdb3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:00.357214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d4025-9184-4337-a423-843c58fdb3a4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:00.358012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d4025-9184-4337-a423-843c58fdb3a4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:00.359725 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d4025-9184-4337-a423-843c58fdb3a4 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:00.370208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-1c0d4025-9184-4337-a423-843c58fdb3a4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 14:00:00.370208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:00.370208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 14:00:00.370208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 14:00:00.370208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 14:00:00.370208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 14:00:00.370208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 14:00:00.370208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:00.370208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 14:00:00.370208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:00.370208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 14:00:00.370208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:00.370208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:00.370208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:00.370208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:00.370208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:00.370208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:00.371381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:00.371381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:00.371381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:00.371381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:00.371381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:00.371381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:00.371381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 14:00:00.371381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 14:00:00.371381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 14:00:00.371381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 14:00:00.371381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:00.371381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:00.371381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:00.371381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:00.371381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:00.371381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:00.372275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:00.372275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:00.372275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:00.372275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:00.372275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:00.372275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:00.372275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:00.372275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:00.372275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:00.372275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:00.372275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 14:00:00.372275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:00.372275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 14:00:00.372275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:00.375357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 437/878] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Sep 13 14:00:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:00.385190 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc56446-47df-48b8-b018-75b58bf00829 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:00.405344 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d4025-9184-4337-a423-843c58fdb3a4 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:00.495578 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc56446-47df-48b8-b018-75b58bf00829 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:00.512380 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d4025-9184-4337-a423-843c58fdb3a4 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:00.532895 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3cc06-00ec-4f1b-ade4-36e8fbb6f981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:00.533817 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3cc06-00ec-4f1b-ade4-36e8fbb6f981 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:00.534800 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3cc06-00ec-4f1b-ade4-36e8fbb6f981 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:00.535252 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3cc06-00ec-4f1b-ade4-36e8fbb6f981 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:00.536047 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3cc06-00ec-4f1b-ade4-36e8fbb6f981 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:00.536534 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3cc06-00ec-4f1b-ade4-36e8fbb6f981 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:00.538103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3cc06-00ec-4f1b-ade4-36e8fbb6f981 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:00.542928 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 442/879] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Sep 13 14:00:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:00.544271 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab986856-3367-4010-8ae3-92c9059ccdfc None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:00.544619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab986856-3367-4010-8ae3-92c9059ccdfc None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:00.544887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab986856-3367-4010-8ae3-92c9059ccdfc None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:00.546228 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 443/880] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:00:00.551387 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab986856-3367-4010-8ae3-92c9059ccdfc None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:00.554363 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296ed0c-54d9-4522-a62f-f5cfd44eda2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:00.555847 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296ed0c-54d9-4522-a62f-f5cfd44eda2d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:00.556133 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296ed0c-54d9-4522-a62f-f5cfd44eda2d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:00.556409 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296ed0c-54d9-4522-a62f-f5cfd44eda2d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:00.568533 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296ed0c-54d9-4522-a62f-f5cfd44eda2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 14:00:00.573934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-0296ed0c-54d9-4522-a62f-f5cfd44eda2d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 14:00:00.573934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:00.573934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:00.573934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:00.573934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:00.573934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:00.573934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:00.573934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:00.573934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:00.573934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:00.573934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:00.573934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:00.573934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 14:00:00.573934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 14:00:00.573934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 14:00:00.573934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 14:00:00.574871 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 14:00:00.574871 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 14:00:00.574871 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 14:00:00.574871 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 14:00:00.574871 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:00.574871 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:00.574871 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:00.574871 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:00.574871 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:00.574871 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:00.574871 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:00.574871 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:00.574871 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:00.574871 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:00.574871 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:00.574871 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:00.575715 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:00.575715 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:00.575715 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:00.575715 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:00.575715 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 14:00:00.575715 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 14:00:00.575715 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 14:00:00.575715 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 14:00:00.575715 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 14:00:00.575715 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 14:00:00.575715 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 14:00:00.575715 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:00.575715 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 438/881] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Sep 13 14:00:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 14:00:00.579237 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:00.580877 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c12cd-854a-4739-8f8a-7741e8ad3c58 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:00.581294 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c12cd-854a-4739-8f8a-7741e8ad3c58 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:00.581602 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c12cd-854a-4739-8f8a-7741e8ad3c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:00.600244 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f32c12cd-854a-4739-8f8a-7741e8ad3c58 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:00.601265 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f32c12cd-854a-4739-8f8a-7741e8ad3c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:00.603356 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:00.672846 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab986856-3367-4010-8ae3-92c9059ccdfc None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:00.673535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 439/882] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:00 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:00:00.674221 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c12cd-854a-4739-8f8a-7741e8ad3c58 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:00.731573 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8ceb7-b07d-467a-8153-02b79bd0dea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:00.732173 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8ceb7-b07d-467a-8153-02b79bd0dea1 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:00.732446 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8ceb7-b07d-467a-8153-02b79bd0dea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:00.732717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8ceb7-b07d-467a-8153-02b79bd0dea1 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:00.733378 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8ceb7-b07d-467a-8153-02b79bd0dea1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:00.733730 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8ceb7-b07d-467a-8153-02b79bd0dea1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:00.735095 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8ceb7-b07d-467a-8153-02b79bd0dea1 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:00.753578 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 444/883] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Sep 13 14:00:00 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:00.809960 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c12cd-854a-4739-8f8a-7741e8ad3c58 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:00.850234 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1117e6-2b01-428e-9db5-a8403eab89a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:00.851223 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1117e6-2b01-428e-9db5-a8403eab89a6 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:00.851724 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1117e6-2b01-428e-9db5-a8403eab89a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:00.852201 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1117e6-2b01-428e-9db5-a8403eab89a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:00.853124 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1117e6-2b01-428e-9db5-a8403eab89a6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:00.853649 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1117e6-2b01-428e-9db5-a8403eab89a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:00.855267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1117e6-2b01-428e-9db5-a8403eab89a6 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:00.861706 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:00.869487 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 440/884] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Sep 13 14:00:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:00.871912 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8ceb7-b07d-467a-8153-02b79bd0dea1 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:00.972007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:00.984728 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8ceb7-b07d-467a-8153-02b79bd0dea1 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:00.988220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1117e6-2b01-428e-9db5-a8403eab89a6 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:01.027189 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff70eb6-e26d-46f7-884b-1bfe69d132cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:01.028144 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff70eb6-e26d-46f7-884b-1bfe69d132cf None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:01.028595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff70eb6-e26d-46f7-884b-1bfe69d132cf None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:01.029058 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff70eb6-e26d-46f7-884b-1bfe69d132cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:01.042548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff70eb6-e26d-46f7-884b-1bfe69d132cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:01.044606 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff70eb6-e26d-46f7-884b-1bfe69d132cf None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:01.065409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-3ff70eb6-e26d-46f7-884b-1bfe69d132cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:00:01.065409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:01.065409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:01.065409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:01.065409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:01.065409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:01.065409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:01.065409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:01.065409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:01.065409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:01.065409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:01.065409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:01.065409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 14:00:01.065409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 14:00:01.065409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 14:00:01.065409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 14:00:01.066443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:01.066443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:01.066443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:01.066443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:01.066443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:01.066443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:01.066443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:01.066443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:01.066443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:01.066443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:01.066443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:01.066443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:01.066443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:01.066443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:01.066443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:01.066443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:01.066443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 14:00:01.067307 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 14:00:01.067307 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:00:01.067307 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:01.069513 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 445/885] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:00:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:01.075331 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff70eb6-e26d-46f7-884b-1bfe69d132cf None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:01.106423 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1117e6-2b01-428e-9db5-a8403eab89a6 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:01.155305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d519a9f-40a6-4b26-8b05-64436470e72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:01.156575 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d519a9f-40a6-4b26-8b05-64436470e72a None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:01.157088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d519a9f-40a6-4b26-8b05-64436470e72a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:01.158242 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d519a9f-40a6-4b26-8b05-64436470e72a None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:01.159936 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d519a9f-40a6-4b26-8b05-64436470e72a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:01.161849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d519a9f-40a6-4b26-8b05-64436470e72a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:01.189675 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 441/886] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Sep 13 14:00:00 2022] POST /identity/v3/services => generated 269 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:00:01.207685 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff70eb6-e26d-46f7-884b-1bfe69d132cf None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:01.252250 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c52b3-5399-4907-a2ce-39ce8163563d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:01.253526 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c52b3-5399-4907-a2ce-39ce8163563d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:01.253803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c52b3-5399-4907-a2ce-39ce8163563d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:01.254068 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c52b3-5399-4907-a2ce-39ce8163563d None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:01.254718 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c52b3-5399-4907-a2ce-39ce8163563d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:01.255014 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c52b3-5399-4907-a2ce-39ce8163563d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:01.256413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c52b3-5399-4907-a2ce-39ce8163563d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:01.259263 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:01.271884 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 446/887] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 14:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:01.278263 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d519a9f-40a6-4b26-8b05-64436470e72a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:01.351166 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:01.400011 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d519a9f-40a6-4b26-8b05-64436470e72a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:01.434314 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd63215-75ca-483f-a86c-930e7f3cf0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:01.434943 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd63215-75ca-483f-a86c-930e7f3cf0c8 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:01.435276 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd63215-75ca-483f-a86c-930e7f3cf0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:01.435549 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd63215-75ca-483f-a86c-930e7f3cf0c8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:01.443973 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd63215-75ca-483f-a86c-930e7f3cf0c8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:01.445490 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd63215-75ca-483f-a86c-930e7f3cf0c8 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:01.457062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-bbd63215-75ca-483f-a86c-930e7f3cf0c8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 14:00:01.457062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:01.457062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:01.457062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:01.457062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:01.457062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:01.457062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:01.457062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:01.457062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:01.457062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:01.457062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:01.457062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:01.457062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 14:00:01.457062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 14:00:01.457062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 14:00:01.457062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 14:00:01.458096 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:01.458096 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:01.458096 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 14:00:01.458096 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 14:00:01.458096 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 14:00:01.458096 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 14:00:01.458096 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:01.458096 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:01.458096 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:01.458096 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:01.458096 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:01.458096 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:01.458096 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:01.458096 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:01.458096 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:01.458096 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:01.458096 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:01.458096 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:01.459026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:01.459026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:01.459026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 14:00:01.459026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 14:00:01.459026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 14:00:01.459026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 14:00:01.459026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 14:00:01.459026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 14:00:01.459026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 14:00:01.459026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:01.459026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 442/888] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Sep 13 14:00:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:01.464198 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c52b3-5399-4907-a2ce-39ce8163563d None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:01.569561 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c52b3-5399-4907-a2ce-39ce8163563d None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:01.604192 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4967fcd-a938-48c3-ac37-c9730a3c2242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:01.604792 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4967fcd-a938-48c3-ac37-c9730a3c2242 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:01.605063 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4967fcd-a938-48c3-ac37-c9730a3c2242 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:01.605357 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4967fcd-a938-48c3-ac37-c9730a3c2242 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:01.606085 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4967fcd-a938-48c3-ac37-c9730a3c2242 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:01.606382 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4967fcd-a938-48c3-ac37-c9730a3c2242 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:01.607864 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4967fcd-a938-48c3-ac37-c9730a3c2242 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:01.626949 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 447/889] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Sep 13 14:00:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:01.633529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd63215-75ca-483f-a86c-930e7f3cf0c8 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:01.744112 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd63215-75ca-483f-a86c-930e7f3cf0c8 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:01.769038 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:01.784539 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772497c-e28d-4862-94f1-055b6fc3eb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:01.785170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772497c-e28d-4862-94f1-055b6fc3eb53 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:01.785448 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772497c-e28d-4862-94f1-055b6fc3eb53 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:01.785717 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772497c-e28d-4862-94f1-055b6fc3eb53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:01.854714 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772497c-e28d-4862-94f1-055b6fc3eb53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:01.856159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772497c-e28d-4862-94f1-055b6fc3eb53 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:01.962421 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 443/890] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 14:00:01 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 14:00:01.968163 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4967fcd-a938-48c3-ac37-c9730a3c2242 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:01.986069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7f518-1152-41a6-b906-5db678877374 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:01.986373 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7f518-1152-41a6-b906-5db678877374 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:01.986624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7f518-1152-41a6-b906-5db678877374 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:01.988684 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 444/891] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 14:00:01.994376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e6b2d-bf11-43b3-bd2d-964face042ae None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:01.994630 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e6b2d-bf11-43b3-bd2d-964face042ae None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:01.994863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e6b2d-bf11-43b3-bd2d-964face042ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:02.018753 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-454e6b2d-bf11-43b3-bd2d-964face042ae None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:02.020037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-454e6b2d-bf11-43b3-bd2d-964face042ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:02.035861 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:02.058703 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:02.084132 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4967fcd-a938-48c3-ac37-c9730a3c2242 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:02.097441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 445/892] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:00:02.119942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce81518-c6c1-4fc5-b947-dd9b98286eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:02.120908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce81518-c6c1-4fc5-b947-dd9b98286eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:02.121413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce81518-c6c1-4fc5-b947-dd9b98286eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:02.122307 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce81518-c6c1-4fc5-b947-dd9b98286eb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:02.133237 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce81518-c6c1-4fc5-b947-dd9b98286eb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:02.134923 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce81518-c6c1-4fc5-b947-dd9b98286eb4 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:02.149758 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-2ce81518-c6c1-4fc5-b947-dd9b98286eb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:00:02.149758 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:02.149758 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:02.149758 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:02.149758 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:02.149758 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:02.149758 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:02.149758 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:02.149758 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:02.149758 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:02.149758 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:02.149758 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:02.149758 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 14:00:02.149758 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 14:00:02.149758 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 14:00:02.149758 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 14:00:02.150675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:02.150675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:02.150675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:02.150675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:02.150675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:02.150675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:02.150675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:02.150675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:02.150675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:02.150675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:02.150675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:02.150675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:02.150675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:02.150675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:02.150675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:02.150675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:02.150675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 14:00:02.151584 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 14:00:02.151584 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:00:02.151584 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:02.153589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 448/893] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:00:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:02.159047 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e6b2d-bf11-43b3-bd2d-964face042ae None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:02.264094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e6b2d-bf11-43b3-bd2d-964face042ae None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:02.303891 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0136b8a-0099-48d4-9815-164d56c3ef4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:02.304491 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0136b8a-0099-48d4-9815-164d56c3ef4d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:02.304767 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0136b8a-0099-48d4-9815-164d56c3ef4d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:02.305051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0136b8a-0099-48d4-9815-164d56c3ef4d None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:02.305710 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0136b8a-0099-48d4-9815-164d56c3ef4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:02.306006 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0136b8a-0099-48d4-9815-164d56c3ef4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:02.307364 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0136b8a-0099-48d4-9815-164d56c3ef4d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:02.319011 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 446/894] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 14:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:02.324459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce81518-c6c1-4fc5-b947-dd9b98286eb4 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:02.415526 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0136b8a-0099-48d4-9815-164d56c3ef4d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:02.429163 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:02.430610 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce81518-c6c1-4fc5-b947-dd9b98286eb4 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:02.461460 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:02.476278 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c11b0-f5b2-4f76-b096-2b525e849b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:02.476921 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c11b0-f5b2-4f76-b096-2b525e849b28 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:02.477228 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c11b0-f5b2-4f76-b096-2b525e849b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:02.477550 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c11b0-f5b2-4f76-b096-2b525e849b28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:02.489058 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c11b0-f5b2-4f76-b096-2b525e849b28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:02.490853 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c11b0-f5b2-4f76-b096-2b525e849b28 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:02.506582 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-e08c11b0-f5b2-4f76-b096-2b525e849b28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 14:00:02.506582 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:02.506582 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:02.506582 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:02.506582 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:02.506582 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:02.506582 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:02.506582 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:02.506582 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:02.506582 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:02.506582 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:02.506582 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:02.506582 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 14:00:02.506582 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 14:00:02.506582 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 14:00:02.507581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 14:00:02.507581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:02.507581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:02.507581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:02.507581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:02.507581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:02.507581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:02.507581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:02.507581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:02.507581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:02.507581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:02.507581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:02.507581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:02.507581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:02.507581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:02.507581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:02.507581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:02.508485 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 14:00:02.508485 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 14:00:02.508485 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 14:00:02.508485 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 14:00:02.508485 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 14:00:02.508485 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 14:00:02.508485 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 14:00:02.508485 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:02.512903 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 449/895] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 14:00:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:02.513906 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c11b0-f5b2-4f76-b096-2b525e849b28 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:02.537816 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0136b8a-0099-48d4-9815-164d56c3ef4d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:02.581932 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374ed8c-3860-4244-9e19-77a1c256b6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:02.582447 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374ed8c-3860-4244-9e19-77a1c256b6ca None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:02.582722 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374ed8c-3860-4244-9e19-77a1c256b6ca None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:02.582986 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374ed8c-3860-4244-9e19-77a1c256b6ca None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:02.583567 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374ed8c-3860-4244-9e19-77a1c256b6ca None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:02.585585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374ed8c-3860-4244-9e19-77a1c256b6ca None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:02.598646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-e374ed8c-3860-4244-9e19-77a1c256b6ca None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 14:00:02.598646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:02.598646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 14:00:02.598646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 14:00:02.598646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 14:00:02.598646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 14:00:02.598646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 14:00:02.598646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:02.598646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 14:00:02.598646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:02.598646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 14:00:02.598646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:02.598646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:02.598646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:02.598646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:02.598646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:02.598646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:02.599723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:02.599723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:02.599723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:02.599723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:02.599723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:02.599723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:02.599723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 14:00:02.599723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 14:00:02.599723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 14:00:02.599723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 14:00:02.599723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:02.599723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:02.599723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:02.599723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:02.599723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:02.599723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:02.600573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:02.600573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:02.600573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:02.600573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:02.600573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:02.600573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:02.600573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:02.600573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:02.600573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:02.600573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:02.600573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 14:00:02.600573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:02.600573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 14:00:02.600573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:02.600573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 447/896] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 13 14:00:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 14:00:02.607027 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374ed8c-3860-4244-9e19-77a1c256b6ca None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:02.641904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c11b0-f5b2-4f76-b096-2b525e849b28 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:02.691661 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a684948-96ee-4550-8e1e-3441b558f2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:02.692259 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a684948-96ee-4550-8e1e-3441b558f2f4 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:02.692534 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a684948-96ee-4550-8e1e-3441b558f2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:02.692803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a684948-96ee-4550-8e1e-3441b558f2f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:02.693817 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a684948-96ee-4550-8e1e-3441b558f2f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:02.694122 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a684948-96ee-4550-8e1e-3441b558f2f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:02.695855 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a684948-96ee-4550-8e1e-3441b558f2f4 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:02.701912 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:02.719671 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 450/897] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 14:00:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:02.720564 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a684948-96ee-4550-8e1e-3441b558f2f4 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:02.734146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374ed8c-3860-4244-9e19-77a1c256b6ca None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:02.750949 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:02.770979 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617aa6b-76d1-419d-a7f6-5978d5ff9f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:02.771876 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617aa6b-76d1-419d-a7f6-5978d5ff9f98 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:02.772387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617aa6b-76d1-419d-a7f6-5978d5ff9f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:02.772857 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617aa6b-76d1-419d-a7f6-5978d5ff9f98 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:02.773708 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617aa6b-76d1-419d-a7f6-5978d5ff9f98 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:02.774228 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617aa6b-76d1-419d-a7f6-5978d5ff9f98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:02.775840 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617aa6b-76d1-419d-a7f6-5978d5ff9f98 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:02.781213 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 448/898] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 13 14:00:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:02.787667 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617aa6b-76d1-419d-a7f6-5978d5ff9f98 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:02.838810 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a684948-96ee-4550-8e1e-3441b558f2f4 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:02.879522 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8975e-49da-4196-93ab-b46694d4a256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:02.880139 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8975e-49da-4196-93ab-b46694d4a256 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:02.880413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8975e-49da-4196-93ab-b46694d4a256 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:02.880681 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8975e-49da-4196-93ab-b46694d4a256 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:02.881532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8975e-49da-4196-93ab-b46694d4a256 None admin] RBAC: Adding query filter params (role.id=a0ce4da381a2401daee681a57a4731b3, scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086, user.id=0c41b4ecb17a43fdb05e586cce43b5a5) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:02.881836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8975e-49da-4196-93ab-b46694d4a256 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:02.883322 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8975e-49da-4196-93ab-b46694d4a256 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:02.897213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 451/899] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 14:00:02 2022] GET /identity/v3/role_assignments?user.id=0c41b4ecb17a43fdb05e586cce43b5a5&scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086&role.id=a0ce4da381a2401daee681a57a4731b3 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:02.902022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617aa6b-76d1-419d-a7f6-5978d5ff9f98 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:02.943633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a787eb-777b-42cb-9cd3-8cc12176e4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:02.944641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a787eb-777b-42cb-9cd3-8cc12176e4e4 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:02.945192 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a787eb-777b-42cb-9cd3-8cc12176e4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:02.945696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a787eb-777b-42cb-9cd3-8cc12176e4e4 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:02.946543 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a787eb-777b-42cb-9cd3-8cc12176e4e4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:02.947061 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a787eb-777b-42cb-9cd3-8cc12176e4e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:02.948691 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a787eb-777b-42cb-9cd3-8cc12176e4e4 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:02.955265 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 449/900] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 13 14:00:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:02.961719 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8975e-49da-4196-93ab-b46694d4a256 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:03.004289 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac933d-9eaf-4745-9416-3e5864a51c19 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:03.004608 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac933d-9eaf-4745-9416-3e5864a51c19 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:03.004821 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac933d-9eaf-4745-9416-3e5864a51c19 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:03.006594 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 450/901] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 14:00:03.014773 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0975e-c1ba-40a8-b0f2-1839a9445a24 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:03.015212 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0975e-c1ba-40a8-b0f2-1839a9445a24 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:03.015588 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0975e-c1ba-40a8-b0f2-1839a9445a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:03.022353 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:03.037887 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-64f0975e-c1ba-40a8-b0f2-1839a9445a24 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:03.039098 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-64f0975e-c1ba-40a8-b0f2-1839a9445a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:03.069882 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:03.082256 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8975e-49da-4196-93ab-b46694d4a256 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:03.130580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d85999-e3cb-459d-b910-f4a220fdaa27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:03.131812 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d85999-e3cb-459d-b910-f4a220fdaa27 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:03.132594 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d85999-e3cb-459d-b910-f4a220fdaa27 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:03.133428 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d85999-e3cb-459d-b910-f4a220fdaa27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:03.134719 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d85999-e3cb-459d-b910-f4a220fdaa27 None admin] RBAC: Adding query filter params (interface=public, service_id=1718d3354fd1449585b8ce1c81d874ad, region_id=RegionOne) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:03.135238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d85999-e3cb-459d-b910-f4a220fdaa27 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:03.136837 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d85999-e3cb-459d-b910-f4a220fdaa27 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:03.137179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 451/902] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:03 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 14:00:03.144794 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 452/903] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Sep 13 14:00:02 2022] GET /identity/v3/endpoints?service_id=1718d3354fd1449585b8ce1c81d874ad&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:03.150151 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0975e-c1ba-40a8-b0f2-1839a9445a24 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:03.255410 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0975e-c1ba-40a8-b0f2-1839a9445a24 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:03.286409 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:03.291822 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d12a98-39be-4b7d-8a4c-b8ccd6b1fde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:03.292635 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d12a98-39be-4b7d-8a4c-b8ccd6b1fde1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:03.293086 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d12a98-39be-4b7d-8a4c-b8ccd6b1fde1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:03.293574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d12a98-39be-4b7d-8a4c-b8ccd6b1fde1 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:03.294237 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d12a98-39be-4b7d-8a4c-b8ccd6b1fde1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:03.295630 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d12a98-39be-4b7d-8a4c-b8ccd6b1fde1 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:03.302362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 452/904] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Sep 13 14:00:03 2022] GET /identity/v3/services => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:00:03.403904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d85999-e3cb-459d-b910-f4a220fdaa27 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:03.516253 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5db597-0750-42dc-ab29-00acce6b44ba None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:03.516590 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5db597-0750-42dc-ab29-00acce6b44ba None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:03.516809 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5db597-0750-42dc-ab29-00acce6b44ba None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:03.518187 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 453/905] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:00:03.528588 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e444652-f2eb-42b1-8887-04d7892b650d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:03.528588 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e444652-f2eb-42b1-8887-04d7892b650d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:03.528588 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e444652-f2eb-42b1-8887-04d7892b650d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:03.528930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d85999-e3cb-459d-b910-f4a220fdaa27 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:03.546224 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5e444652-f2eb-42b1-8887-04d7892b650d None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:03.547707 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5e444652-f2eb-42b1-8887-04d7892b650d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:03.569242 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499da82-bf76-4500-b514-5242437c2b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:03.569846 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499da82-bf76-4500-b514-5242437c2b45 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:03.570123 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499da82-bf76-4500-b514-5242437c2b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:03.570393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499da82-bf76-4500-b514-5242437c2b45 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:03.571569 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e499da82-bf76-4500-b514-5242437c2b45 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:03.573259 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e499da82-bf76-4500-b514-5242437c2b45 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:03.592849 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 453/906] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Sep 13 14:00:03 2022] POST /identity/v3/services => generated 241 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:00:03.645293 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 454/907] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:00:03.920864 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499da82-bf76-4500-b514-5242437c2b45 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:03.938409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:04.025698 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499da82-bf76-4500-b514-5242437c2b45 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:04.060594 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52414e11-5b28-4a42-b287-d54c05ce4b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:04.061257 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52414e11-5b28-4a42-b287-d54c05ce4b09 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:04.061531 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52414e11-5b28-4a42-b287-d54c05ce4b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:04.061798 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52414e11-5b28-4a42-b287-d54c05ce4b09 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:04.062385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52414e11-5b28-4a42-b287-d54c05ce4b09 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:04.063814 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52414e11-5b28-4a42-b287-d54c05ce4b09 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:04.073586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-52414e11-5b28-4a42-b287-d54c05ce4b09 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 14:00:04.073586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:04.073586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 14:00:04.073586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 14:00:04.073586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 14:00:04.073586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 14:00:04.073586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 14:00:04.073586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:04.073586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 14:00:04.073586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:04.073586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 14:00:04.073586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:04.073586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:04.073586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:04.073586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:04.073586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:04.074532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:04.074532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:04.074532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:04.074532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:04.074532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:04.074532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:04.074532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:04.074532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 14:00:04.074532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 14:00:04.074532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 14:00:04.074532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 14:00:04.074532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:04.074532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:04.074532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:04.074532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:04.074532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:04.074532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:04.075409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:04.075409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:04.075409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:04.075409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:04.075409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:04.075409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:04.075409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:04.075409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:04.075409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:04.075409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:04.075409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 14:00:04.075409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:04.075409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 14:00:04.075409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:04.075409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 454/908] 10.222.0.26 () {56 vars in 1132 bytes} [Tue Sep 13 14:00:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:04.080977 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e444652-f2eb-42b1-8887-04d7892b650d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:04.187504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e444652-f2eb-42b1-8887-04d7892b650d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:04.211883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:04.224434 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f28609-8a8a-43f0-9581-61c9772aa14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:04.225069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f28609-8a8a-43f0-9581-61c9772aa14f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:04.225384 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f28609-8a8a-43f0-9581-61c9772aa14f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:04.225660 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f28609-8a8a-43f0-9581-61c9772aa14f None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:04.226292 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f28609-8a8a-43f0-9581-61c9772aa14f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:04.226596 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f28609-8a8a-43f0-9581-61c9772aa14f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:04.227976 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f28609-8a8a-43f0-9581-61c9772aa14f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:04.233149 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 455/909] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Sep 13 14:00:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:04.238785 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52414e11-5b28-4a42-b287-d54c05ce4b09 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:04.325667 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:04.348497 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52414e11-5b28-4a42-b287-d54c05ce4b09 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:04.383290 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9cb0b-52c0-4303-9f91-1fa8ef17ba9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:04.383890 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9cb0b-52c0-4303-9f91-1fa8ef17ba9b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:04.384166 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9cb0b-52c0-4303-9f91-1fa8ef17ba9b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:04.384433 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9cb0b-52c0-4303-9f91-1fa8ef17ba9b None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:04.385056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9cb0b-52c0-4303-9f91-1fa8ef17ba9b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:04.385385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9cb0b-52c0-4303-9f91-1fa8ef17ba9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:04.386813 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9cb0b-52c0-4303-9f91-1fa8ef17ba9b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:04.391932 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 455/910] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Sep 13 14:00:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:04.397715 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f28609-8a8a-43f0-9581-61c9772aa14f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:04.511602 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f28609-8a8a-43f0-9581-61c9772aa14f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:04.548207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8b440-56c0-44ee-8507-170bf8ff6b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:04.548812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8b440-56c0-44ee-8507-170bf8ff6b71 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:04.549117 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8b440-56c0-44ee-8507-170bf8ff6b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:04.549390 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8b440-56c0-44ee-8507-170bf8ff6b71 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:04.550118 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8b440-56c0-44ee-8507-170bf8ff6b71 None admin] RBAC: Adding query filter params (interface=public, service_id=3ad5d672a5264ff7a1f9e84fad59c1eb, region_id=RegionOne) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:04.550425 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8b440-56c0-44ee-8507-170bf8ff6b71 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:04.551854 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8b440-56c0-44ee-8507-170bf8ff6b71 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:04.557525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 456/911] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Sep 13 14:00:04 2022] GET /identity/v3/endpoints?service_id=3ad5d672a5264ff7a1f9e84fad59c1eb&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:04.566409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9cb0b-52c0-4303-9f91-1fa8ef17ba9b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:04.671931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9cb0b-52c0-4303-9f91-1fa8ef17ba9b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:04.707943 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5e5f8-b542-4518-aec7-f12fb27a6b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:04.708576 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5e5f8-b542-4518-aec7-f12fb27a6b0c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:04.708860 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5e5f8-b542-4518-aec7-f12fb27a6b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:04.709147 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5e5f8-b542-4518-aec7-f12fb27a6b0c None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:04.709755 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5e5f8-b542-4518-aec7-f12fb27a6b0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:04.711108 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5e5f8-b542-4518-aec7-f12fb27a6b0c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:04.717535 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 456/912] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Sep 13 14:00:04 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:00:05.164749 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4fd7d-8ad6-4b03-a584-d32c17de1387 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:05.165317 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4fd7d-8ad6-4b03-a584-d32c17de1387 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:05.165619 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4fd7d-8ad6-4b03-a584-d32c17de1387 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:05.167020 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 457/913] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:00:05.172450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e76b7-79a3-4b49-b94a-ffd148126b9e None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:05.172725 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e76b7-79a3-4b49-b94a-ffd148126b9e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:05.172994 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e76b7-79a3-4b49-b94a-ffd148126b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:05.186131 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:05.195010 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-d89e76b7-79a3-4b49-b94a-ffd148126b9e None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:05.196208 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d89e76b7-79a3-4b49-b94a-ffd148126b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:05.266558 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 457/914] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 14:00:05.535309 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4fd7d-8ad6-4b03-a584-d32c17de1387 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:05.590375 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:05.639820 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9b987-c609-43d6-b7b2-31b40210d48d None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:05.640779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9b987-c609-43d6-b7b2-31b40210d48d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:05.641316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9b987-c609-43d6-b7b2-31b40210d48d None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:05.643118 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 458/915] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:00:05.650137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383971db-a499-47c6-85d2-8c62ae8339d1 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:05.650959 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383971db-a499-47c6-85d2-8c62ae8339d1 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:05.651645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383971db-a499-47c6-85d2-8c62ae8339d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:05.656909 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4fd7d-8ad6-4b03-a584-d32c17de1387 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:05.672207 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-383971db-a499-47c6-85d2-8c62ae8339d1 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:05.674034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-383971db-a499-47c6-85d2-8c62ae8339d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:05.705321 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d7506-3f41-42a1-bbb1-63e49b3994bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:05.706022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d7506-3f41-42a1-bbb1-63e49b3994bc None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:05.706302 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d7506-3f41-42a1-bbb1-63e49b3994bc None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:05.706574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d7506-3f41-42a1-bbb1-63e49b3994bc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:05.720341 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d7506-3f41-42a1-bbb1-63e49b3994bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 14:00:05.726758 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-489d7506-3f41-42a1-bbb1-63e49b3994bc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 14:00:05.726758 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:05.726758 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:05.726758 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:05.726758 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:05.726758 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:05.726758 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:05.726758 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:05.726758 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:05.726758 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:05.726758 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:05.726758 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:05.726758 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 14:00:05.726758 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 14:00:05.726758 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 14:00:05.726758 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 14:00:05.727678 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 14:00:05.727678 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 14:00:05.727678 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 14:00:05.727678 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 14:00:05.727678 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:05.727678 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:05.727678 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:05.727678 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:05.727678 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:05.727678 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:05.727678 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:05.727678 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:05.727678 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:05.727678 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:05.727678 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:05.727678 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:05.728559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:05.728559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:05.728559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:05.728559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:05.728559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 14:00:05.728559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 14:00:05.728559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 14:00:05.728559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 14:00:05.728559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 14:00:05.728559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 14:00:05.728559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 14:00:05.728559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:05.728559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 458/916] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Sep 13 14:00:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:05.733563 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d7506-3f41-42a1-bbb1-63e49b3994bc None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:05.769532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 459/917] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 14:00:05.792680 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddfa29-24d7-4659-84e5-46e78ac53609 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:05.792955 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddfa29-24d7-4659-84e5-46e78ac53609 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:05.793172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddfa29-24d7-4659-84e5-46e78ac53609 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:05.798284 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 460/918] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 14:00:05.799779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa61eb8-3074-414f-8ad6-f55bceb5a6f9 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:05.800095 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa61eb8-3074-414f-8ad6-f55bceb5a6f9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:05.800365 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa61eb8-3074-414f-8ad6-f55bceb5a6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:05.819282 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-efa61eb8-3074-414f-8ad6-f55bceb5a6f9 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:05.820448 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-efa61eb8-3074-414f-8ad6-f55bceb5a6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:05.847154 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d7506-3f41-42a1-bbb1-63e49b3994bc None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:05.858816 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:05.886567 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75fd55-2fdb-429b-9805-3a902e47f843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:05.887598 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75fd55-2fdb-429b-9805-3a902e47f843 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:05.888082 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75fd55-2fdb-429b-9805-3a902e47f843 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:05.888583 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75fd55-2fdb-429b-9805-3a902e47f843 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:05.889532 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75fd55-2fdb-429b-9805-3a902e47f843 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:05.890035 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75fd55-2fdb-429b-9805-3a902e47f843 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:05.891758 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75fd55-2fdb-429b-9805-3a902e47f843 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:05.897435 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:05.903689 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 459/919] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Sep 13 14:00:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:05.913222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 461/920] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:00:05.913372 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75fd55-2fdb-429b-9805-3a902e47f843 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:06.023496 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75fd55-2fdb-429b-9805-3a902e47f843 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:06.051715 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa61eb8-3074-414f-8ad6-f55bceb5a6f9 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:06.064608 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9953ee5-ab7f-4093-bb0a-aa88825819c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:06.066115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9953ee5-ab7f-4093-bb0a-aa88825819c3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:06.066589 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9953ee5-ab7f-4093-bb0a-aa88825819c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:06.067039 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9953ee5-ab7f-4093-bb0a-aa88825819c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:06.079692 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9953ee5-ab7f-4093-bb0a-aa88825819c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:06.081675 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9953ee5-ab7f-4093-bb0a-aa88825819c3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:06.097421 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-c9953ee5-ab7f-4093-bb0a-aa88825819c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:00:06.097421 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:06.097421 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:06.097421 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:06.097421 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:06.097421 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:06.097421 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:06.097421 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:06.097421 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:06.097421 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:06.097421 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:06.097421 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:06.097421 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 14:00:06.097421 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 14:00:06.097421 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 14:00:06.097421 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 14:00:06.098347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:06.098347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:06.098347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:06.098347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:06.098347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:06.098347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:06.098347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:06.098347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:06.098347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:06.098347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:06.098347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:06.098347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:06.098347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:06.098347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:06.098347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:06.098347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:06.098347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 14:00:06.099223 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 14:00:06.099223 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:00:06.099223 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:06.101187 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 460/921] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:06.106146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9953ee5-ab7f-4093-bb0a-aa88825819c3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:06.142821 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:06.167756 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa61eb8-3074-414f-8ad6-f55bceb5a6f9 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:06.208059 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad53f3d-142d-47db-9999-7c99e046ae67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:06.209022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad53f3d-142d-47db-9999-7c99e046ae67 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:06.209421 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad53f3d-142d-47db-9999-7c99e046ae67 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:06.209694 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad53f3d-142d-47db-9999-7c99e046ae67 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:06.210268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad53f3d-142d-47db-9999-7c99e046ae67 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:06.211619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad53f3d-142d-47db-9999-7c99e046ae67 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:06.220297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-8ad53f3d-142d-47db-9999-7c99e046ae67 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 14:00:06.220297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:06.220297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 14:00:06.220297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 14:00:06.220297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 14:00:06.220297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 14:00:06.220297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 14:00:06.220297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:06.220297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 14:00:06.220297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:06.220297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 14:00:06.220297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:06.220297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:06.220297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:06.220297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:06.220297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:06.220297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:06.221286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:06.221286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:06.221286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:06.221286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:06.221286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:06.221286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:06.221286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 14:00:06.221286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 14:00:06.221286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 14:00:06.221286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 14:00:06.221286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:06.221286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:06.221286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:06.221286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:06.221286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:06.221286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:06.227558 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:06.227558 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:06.227558 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:06.227558 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:06.227558 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:06.227558 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:06.227558 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:06.227558 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:06.227558 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:06.227558 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:06.227558 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 14:00:06.227558 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:06.227558 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 14:00:06.227558 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:06.227558 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 462/922] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 13 14:00:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 14:00:06.228428 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad53f3d-142d-47db-9999-7c99e046ae67 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:06.232810 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9953ee5-ab7f-4093-bb0a-aa88825819c3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:06.267092 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a1781-bb77-4dd9-9f14-c52eff756bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:06.268075 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a1781-bb77-4dd9-9f14-c52eff756bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:06.268981 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a1781-bb77-4dd9-9f14-c52eff756bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:06.269302 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a1781-bb77-4dd9-9f14-c52eff756bf5 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:06.269941 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a1781-bb77-4dd9-9f14-c52eff756bf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:06.270589 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a1781-bb77-4dd9-9f14-c52eff756bf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:06.272274 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a1781-bb77-4dd9-9f14-c52eff756bf5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:06.288144 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:06.289366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 461/923] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 14:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:06.290553 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a1781-bb77-4dd9-9f14-c52eff756bf5 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:06.336290 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad53f3d-142d-47db-9999-7c99e046ae67 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:06.375767 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291417e-c485-483f-a75d-a18c74868577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:06.376535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:06.378129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291417e-c485-483f-a75d-a18c74868577 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:06.378524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291417e-c485-483f-a75d-a18c74868577 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:06.378949 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291417e-c485-483f-a75d-a18c74868577 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:06.379629 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291417e-c485-483f-a75d-a18c74868577 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:06.381563 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291417e-c485-483f-a75d-a18c74868577 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:06.391607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-7291417e-c485-483f-a75d-a18c74868577 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 14:00:06.391607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:06.391607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 14:00:06.391607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 14:00:06.391607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 14:00:06.391607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 14:00:06.391607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 14:00:06.391607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:06.391607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 14:00:06.391607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:06.391607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 14:00:06.391607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:06.391607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:06.391607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:06.391607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:06.391607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:06.391607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:06.392573 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:06.392573 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:06.392573 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:06.392573 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:06.392573 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:06.392573 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:06.392573 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 14:00:06.392573 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 14:00:06.392573 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 14:00:06.392573 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 14:00:06.392573 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:06.392573 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:06.392573 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:06.392573 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:06.392573 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:06.392573 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:06.398223 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:06.398223 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:06.398223 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:06.398223 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:06.398223 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:06.398223 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:06.398223 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:06.398223 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:06.398223 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:06.398223 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:06.398223 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 14:00:06.398223 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:06.398223 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 14:00:06.398223 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:06.399000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a1781-bb77-4dd9-9f14-c52eff756bf5 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:06.399077 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 463/924] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Sep 13 14:00:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:06.399077 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291417e-c485-483f-a75d-a18c74868577 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:06.428813 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fd39e-04c4-437d-a67e-96f4be5fc735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:06.429447 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fd39e-04c4-437d-a67e-96f4be5fc735 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:06.429728 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fd39e-04c4-437d-a67e-96f4be5fc735 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:06.430001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fd39e-04c4-437d-a67e-96f4be5fc735 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:06.430630 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9fd39e-04c4-437d-a67e-96f4be5fc735 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:06.430940 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9fd39e-04c4-437d-a67e-96f4be5fc735 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:06.432317 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9fd39e-04c4-437d-a67e-96f4be5fc735 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:06.442214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 462/925] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 13 14:00:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:06.442214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fd39e-04c4-437d-a67e-96f4be5fc735 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:06.511763 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291417e-c485-483f-a75d-a18c74868577 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:06.538067 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:06.551528 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934db42-91bc-4fdc-a234-8ecad0e05de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:06.552158 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934db42-91bc-4fdc-a234-8ecad0e05de8 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:06.552432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934db42-91bc-4fdc-a234-8ecad0e05de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:06.552699 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934db42-91bc-4fdc-a234-8ecad0e05de8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:06.553253 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fd39e-04c4-437d-a67e-96f4be5fc735 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:06.560852 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934db42-91bc-4fdc-a234-8ecad0e05de8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:06.562449 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934db42-91bc-4fdc-a234-8ecad0e05de8 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:06.576079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-6934db42-91bc-4fdc-a234-8ecad0e05de8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 14:00:06.576079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:06.576079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:06.576079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:06.576079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:06.576079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:06.576079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:06.576079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:06.576079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:06.576079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:06.576079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:06.576079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:06.576079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 14:00:06.576079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 14:00:06.576079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 14:00:06.576079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 14:00:06.577017 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:06.577017 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:06.577017 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 14:00:06.577017 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 14:00:06.577017 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 14:00:06.577017 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 14:00:06.577017 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:06.577017 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:06.577017 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:06.577017 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:06.577017 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:06.577017 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:06.577017 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:06.577017 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:06.577017 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:06.577017 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:06.577017 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:06.577017 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:06.577983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:06.577983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:06.577983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 14:00:06.577983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 14:00:06.577983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 14:00:06.577983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 14:00:06.577983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 14:00:06.577983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 14:00:06.577983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 14:00:06.577983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:06.577983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 464/926] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Sep 13 14:00:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:06.579091 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934db42-91bc-4fdc-a234-8ecad0e05de8 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:06.592163 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca08e1-b53b-4793-928b-7952329ad7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:06.592841 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca08e1-b53b-4793-928b-7952329ad7ee None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:06.593213 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca08e1-b53b-4793-928b-7952329ad7ee None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:06.593552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca08e1-b53b-4793-928b-7952329ad7ee None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:06.594244 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca08e1-b53b-4793-928b-7952329ad7ee None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:06.594653 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca08e1-b53b-4793-928b-7952329ad7ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:06.595972 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca08e1-b53b-4793-928b-7952329ad7ee None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:06.605814 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 463/927] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Sep 13 14:00:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:06.605814 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca08e1-b53b-4793-928b-7952329ad7ee None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:06.625572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:06.685685 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934db42-91bc-4fdc-a234-8ecad0e05de8 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:06.720771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca08e1-b53b-4793-928b-7952329ad7ee None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:06.720956 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8320d-98e8-4ed2-bc1c-9630b03bc21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:06.722029 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8320d-98e8-4ed2-bc1c-9630b03bc21e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:06.722365 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8320d-98e8-4ed2-bc1c-9630b03bc21e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:06.722641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8320d-98e8-4ed2-bc1c-9630b03bc21e None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:06.723279 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8320d-98e8-4ed2-bc1c-9630b03bc21e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:06.723578 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8320d-98e8-4ed2-bc1c-9630b03bc21e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:06.724946 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8320d-98e8-4ed2-bc1c-9630b03bc21e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:06.734187 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 465/928] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Sep 13 14:00:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:06.734187 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8320d-98e8-4ed2-bc1c-9630b03bc21e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:06.763322 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e34fb-9a6b-450c-917d-89873595078f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:06.764170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e34fb-9a6b-450c-917d-89873595078f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:06.764597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e34fb-9a6b-450c-917d-89873595078f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:06.765011 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e34fb-9a6b-450c-917d-89873595078f None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:06.765926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e34fb-9a6b-450c-917d-89873595078f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:06.766374 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e34fb-9a6b-450c-917d-89873595078f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:06.767933 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e34fb-9a6b-450c-917d-89873595078f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:06.780423 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:06.786836 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 464/929] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Sep 13 14:00:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:06.787999 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e34fb-9a6b-450c-917d-89873595078f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:06.849537 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8320d-98e8-4ed2-bc1c-9630b03bc21e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:06.865893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:06.885453 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0dc381-1fc7-427c-bdaf-817b91b972f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:06.886059 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dc381-1fc7-427c-bdaf-817b91b972f1 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:06.886338 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dc381-1fc7-427c-bdaf-817b91b972f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:06.886610 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dc381-1fc7-427c-bdaf-817b91b972f1 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:06.887241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0dc381-1fc7-427c-bdaf-817b91b972f1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:06.887543 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0dc381-1fc7-427c-bdaf-817b91b972f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:06.888909 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0dc381-1fc7-427c-bdaf-817b91b972f1 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:06.894718 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 466/930] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Sep 13 14:00:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:06.895523 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0dc381-1fc7-427c-bdaf-817b91b972f1 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:06.904536 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e34fb-9a6b-450c-917d-89873595078f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:06.941337 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a08928-f3b6-4e52-a696-16795402f769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:06.941934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a08928-f3b6-4e52-a696-16795402f769 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:06.942212 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a08928-f3b6-4e52-a696-16795402f769 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:06.942685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a08928-f3b6-4e52-a696-16795402f769 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:06.943130 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a08928-f3b6-4e52-a696-16795402f769 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:06.944472 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a08928-f3b6-4e52-a696-16795402f769 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:06.965343 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 465/931] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:00:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:00:06.966145 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a08928-f3b6-4e52-a696-16795402f769 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:07.008269 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0dc381-1fc7-427c-bdaf-817b91b972f1 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:07.024576 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:07.056134 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24caf0df-9939-42b4-b962-a80e1326679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:07.056891 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24caf0df-9939-42b4-b962-a80e1326679d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:07.057265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24caf0df-9939-42b4-b962-a80e1326679d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:07.057614 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24caf0df-9939-42b4-b962-a80e1326679d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:07.069700 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24caf0df-9939-42b4-b962-a80e1326679d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:07.071732 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24caf0df-9939-42b4-b962-a80e1326679d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:07.080505 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a08928-f3b6-4e52-a696-16795402f769 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:07.088168 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-24caf0df-9939-42b4-b962-a80e1326679d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:00:07.088168 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:07.088168 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:07.088168 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:07.088168 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:07.088168 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:07.088168 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:07.088168 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:07.088168 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:07.088168 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:07.088168 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:07.088168 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:07.088168 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 14:00:07.088168 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 14:00:07.088168 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 14:00:07.088168 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 14:00:07.089202 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:07.089202 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:07.089202 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:07.089202 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:07.089202 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:07.089202 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:07.089202 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:07.089202 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:07.089202 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:07.089202 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:07.089202 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:07.089202 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:07.089202 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:07.089202 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:07.089202 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:07.089202 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:07.089202 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 14:00:07.090179 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 14:00:07.090179 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:00:07.090179 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:07.090179 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 467/932] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:00:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:07.091462 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054871b-db13-4159-8d8b-e99291a2df14 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:07.091462 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054871b-db13-4159-8d8b-e99291a2df14 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:07.091462 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054871b-db13-4159-8d8b-e99291a2df14 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:07.092735 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 468/933] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:00:07.097852 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054871b-db13-4159-8d8b-e99291a2df14 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:07.115932 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:07.127700 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf08e99-2cbf-4051-bd6d-cc443fff89dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:07.128421 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf08e99-2cbf-4051-bd6d-cc443fff89dc None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:07.128766 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf08e99-2cbf-4051-bd6d-cc443fff89dc None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:07.129109 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf08e99-2cbf-4051-bd6d-cc443fff89dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:07.129903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf08e99-2cbf-4051-bd6d-cc443fff89dc None admin] RBAC: Adding query filter params (interface=public, service_id=3c2dc18d41684c10b64bd30913d722a0, region_id=RegionOne) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:07.130292 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf08e99-2cbf-4051-bd6d-cc443fff89dc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:07.131677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf08e99-2cbf-4051-bd6d-cc443fff89dc None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:07.141143 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 466/934] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Sep 13 14:00:06 2022] GET /identity/v3/endpoints?service_id=3c2dc18d41684c10b64bd30913d722a0&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:07.141143 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c0a73-c57e-4030-9260-a6ff99717a95 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:07.141143 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c0a73-c57e-4030-9260-a6ff99717a95 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:07.141143 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c0a73-c57e-4030-9260-a6ff99717a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:07.159604 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-7b0c0a73-c57e-4030-9260-a6ff99717a95 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:07.160800 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7b0c0a73-c57e-4030-9260-a6ff99717a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:07.220982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054871b-db13-4159-8d8b-e99291a2df14 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:07.230046 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 467/935] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:00:07.231113 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c0a73-c57e-4030-9260-a6ff99717a95 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:07.256834 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbf278-921a-43d7-bff3-84c21489f290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:07.257569 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbf278-921a-43d7-bff3-84c21489f290 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:07.258055 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbf278-921a-43d7-bff3-84c21489f290 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:07.258397 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbf278-921a-43d7-bff3-84c21489f290 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:07.259115 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbf278-921a-43d7-bff3-84c21489f290 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:07.259486 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbf278-921a-43d7-bff3-84c21489f290 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:07.261124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbf278-921a-43d7-bff3-84c21489f290 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:07.277818 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 469/936] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 14:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:07.283244 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbf278-921a-43d7-bff3-84c21489f290 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:07.306422 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:07.353223 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c0a73-c57e-4030-9260-a6ff99717a95 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:07.376122 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:07.391116 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de2597-0994-49a7-8e19-1bd40e746e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:07.392083 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de2597-0994-49a7-8e19-1bd40e746e3c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:07.392566 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de2597-0994-49a7-8e19-1bd40e746e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:07.393079 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de2597-0994-49a7-8e19-1bd40e746e3c None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:07.393945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de2597-0994-49a7-8e19-1bd40e746e3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:07.395538 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de2597-0994-49a7-8e19-1bd40e746e3c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:07.408613 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 468/937] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Sep 13 14:00:07 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:00:07.411980 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbf278-921a-43d7-bff3-84c21489f290 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:07.452558 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15b006-56a1-4c22-aa46-37710dcf4f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:07.453228 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15b006-56a1-4c22-aa46-37710dcf4f53 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:07.453507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15b006-56a1-4c22-aa46-37710dcf4f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:07.453773 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15b006-56a1-4c22-aa46-37710dcf4f53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:07.461827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15b006-56a1-4c22-aa46-37710dcf4f53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:07.463307 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15b006-56a1-4c22-aa46-37710dcf4f53 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:07.476845 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-0b15b006-56a1-4c22-aa46-37710dcf4f53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 14:00:07.476845 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:07.476845 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:07.476845 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:07.476845 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:07.476845 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:07.476845 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:07.476845 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:07.476845 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:07.476845 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:07.476845 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:07.476845 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:07.476845 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 14:00:07.476845 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 14:00:07.476845 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 14:00:07.477836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 14:00:07.477836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:07.477836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:07.477836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:07.477836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:07.477836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:07.477836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:07.477836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:07.477836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:07.477836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:07.477836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:07.477836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:07.477836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:07.477836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:07.477836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:07.477836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:07.477836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:07.479174 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 14:00:07.479174 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 14:00:07.479174 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 14:00:07.479174 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 14:00:07.479174 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 14:00:07.479174 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 14:00:07.479174 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 14:00:07.479174 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:07.479174 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 470/938] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 14:00:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:07.484209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de2597-0994-49a7-8e19-1bd40e746e3c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:07.517344 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15b006-56a1-4c22-aa46-37710dcf4f53 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:07.607626 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de2597-0994-49a7-8e19-1bd40e746e3c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:07.635817 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:07.655183 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0804b4-dcb5-4545-b081-8a43093fc028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:07.655931 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0804b4-dcb5-4545-b081-8a43093fc028 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:07.656223 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0804b4-dcb5-4545-b081-8a43093fc028 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:07.656493 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0804b4-dcb5-4545-b081-8a43093fc028 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:07.657230 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0804b4-dcb5-4545-b081-8a43093fc028 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:07.658097 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0804b4-dcb5-4545-b081-8a43093fc028 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:07.660395 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0804b4-dcb5-4545-b081-8a43093fc028 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:07.666805 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15b006-56a1-4c22-aa46-37710dcf4f53 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:07.675089 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 469/939] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 14:00:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:07.680963 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0804b4-dcb5-4545-b081-8a43093fc028 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:07.709323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b360d39-2b25-4f08-9113-ddf5f9902c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:07.710730 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b360d39-2b25-4f08-9113-ddf5f9902c11 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:07.711405 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b360d39-2b25-4f08-9113-ddf5f9902c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:07.711912 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b360d39-2b25-4f08-9113-ddf5f9902c11 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:07.712800 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b360d39-2b25-4f08-9113-ddf5f9902c11 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:07.715185 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b360d39-2b25-4f08-9113-ddf5f9902c11 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:07.726983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-5b360d39-2b25-4f08-9113-ddf5f9902c11 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 14:00:07.726983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:07.726983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 14:00:07.726983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 14:00:07.726983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 14:00:07.726983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 14:00:07.726983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 14:00:07.726983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:07.726983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 14:00:07.726983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:07.726983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 14:00:07.726983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:07.726983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:07.726983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:07.726983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:07.726983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:07.727972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:07.727972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:07.727972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:07.727972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:07.727972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:07.727972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:07.727972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:07.727972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 14:00:07.727972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 14:00:07.727972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 14:00:07.727972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 14:00:07.727972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:07.727972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:07.727972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:07.727972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:07.727972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:07.727972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:07.728869 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:07.728869 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:07.728869 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:07.728869 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:07.728869 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:07.728869 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:07.728869 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:07.728869 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:07.728869 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:07.728869 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:07.728869 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 14:00:07.728869 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:07.728869 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 14:00:07.728869 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:07.736694 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 471/940] 10.222.0.26 () {56 vars in 1132 bytes} [Tue Sep 13 14:00:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 14:00:07.738868 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b360d39-2b25-4f08-9113-ddf5f9902c11 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:07.742202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:07.811999 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0804b4-dcb5-4545-b081-8a43093fc028 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:07.849950 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287a9d2-a847-487e-86b6-8a778846af87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:07.850577 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287a9d2-a847-487e-86b6-8a778846af87 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:07.850951 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287a9d2-a847-487e-86b6-8a778846af87 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:07.851324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287a9d2-a847-487e-86b6-8a778846af87 None admin] PATH_INFO: `/v3/projects/17ba27c26bf34daa91cf8f7cc25bf086/users/0c41b4ecb17a43fdb05e586cce43b5a5/roles/a0ce4da381a2401daee681a57a4731b3` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:07.855070 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287a9d2-a847-487e-86b6-8a778846af87 None admin] RBAC: Authorizing `identity:create_grant(project_id=17ba27c26bf34daa91cf8f7cc25bf086, user_id=0c41b4ecb17a43fdb05e586cce43b5a5, role_id=a0ce4da381a2401daee681a57a4731b3)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:07.857287 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287a9d2-a847-487e-86b6-8a778846af87 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:07.867794 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b360d39-2b25-4f08-9113-ddf5f9902c11 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:07.878492 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 470/941] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 13 14:00:07 2022] PUT /identity/v3/projects/17ba27c26bf34daa91cf8f7cc25bf086/users/0c41b4ecb17a43fdb05e586cce43b5a5/roles/a0ce4da381a2401daee681a57a4731b3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:00:07.914858 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9a58a-305d-4dd1-bad6-0fde2254ebc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:07.915739 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9a58a-305d-4dd1-bad6-0fde2254ebc5 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:07.916161 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9a58a-305d-4dd1-bad6-0fde2254ebc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:07.916573 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9a58a-305d-4dd1-bad6-0fde2254ebc5 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:07.917403 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9a58a-305d-4dd1-bad6-0fde2254ebc5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:07.917851 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9a58a-305d-4dd1-bad6-0fde2254ebc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:07.919478 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9a58a-305d-4dd1-bad6-0fde2254ebc5 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:07.926293 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 472/942] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Sep 13 14:00:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:07.937176 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287a9d2-a847-487e-86b6-8a778846af87 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:08.052561 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287a9d2-a847-487e-86b6-8a778846af87 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:08.055881 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:08.092424 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3478b-e60f-4c9a-a211-1f3f55e63f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:08.093021 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3478b-e60f-4c9a-a211-1f3f55e63f2a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:08.093343 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3478b-e60f-4c9a-a211-1f3f55e63f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:08.093613 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3478b-e60f-4c9a-a211-1f3f55e63f2a None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:08.094340 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3478b-e60f-4c9a-a211-1f3f55e63f2a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:08.094654 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3478b-e60f-4c9a-a211-1f3f55e63f2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:08.096021 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3478b-e60f-4c9a-a211-1f3f55e63f2a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:08.102091 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 471/943] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Sep 13 14:00:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:08.107731 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9a58a-305d-4dd1-bad6-0fde2254ebc5 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:08.120296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:08.219329 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9a58a-305d-4dd1-bad6-0fde2254ebc5 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:08.260070 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb98b8d-7cd9-48fe-bbac-184cb13ebf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:08.260673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb98b8d-7cd9-48fe-bbac-184cb13ebf36 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:08.260944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb98b8d-7cd9-48fe-bbac-184cb13ebf36 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:08.261271 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb98b8d-7cd9-48fe-bbac-184cb13ebf36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:08.261922 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb98b8d-7cd9-48fe-bbac-184cb13ebf36 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:08.263277 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb98b8d-7cd9-48fe-bbac-184cb13ebf36 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:08.286543 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 473/944] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:00:08 2022] POST /identity/v3/endpoints => generated 347 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:00:09.177466 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32490834-23e1-4ceb-8481-94e168fd059c None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:09.177982 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32490834-23e1-4ceb-8481-94e168fd059c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:09.177982 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32490834-23e1-4ceb-8481-94e168fd059c None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:09.179606 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 472/945] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:00:09.185087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5669a5-9e6e-429a-82b2-871300938293 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:09.185520 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5669a5-9e6e-429a-82b2-871300938293 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:09.185697 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5669a5-9e6e-429a-82b2-871300938293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:09.205154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-3f5669a5-9e6e-429a-82b2-871300938293 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:09.206939 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-3f5669a5-9e6e-429a-82b2-871300938293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:09.269522 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:09.284780 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 474/946] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 14:00:09.551138 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32490834-23e1-4ceb-8481-94e168fd059c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:09.670307 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32490834-23e1-4ceb-8481-94e168fd059c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:09.709919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906565a3-bca3-4a46-b991-833c2d31f0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:09.710275 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04432fe-0000-4d72-bf40-1881000cadff None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:09.710523 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906565a3-bca3-4a46-b991-833c2d31f0b5 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:09.710623 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04432fe-0000-4d72-bf40-1881000cadff None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:09.710811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906565a3-bca3-4a46-b991-833c2d31f0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:09.710905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04432fe-0000-4d72-bf40-1881000cadff None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:09.711067 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906565a3-bca3-4a46-b991-833c2d31f0b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:09.711723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906565a3-bca3-4a46-b991-833c2d31f0b5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:09.712353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 475/947] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:00:09.713186 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906565a3-bca3-4a46-b991-833c2d31f0b5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:09.715822 dv-cinder-857434-1-smb devstack@keystone.service[81626]: WARNING keystone.server.flask.common [None req-906565a3-bca3-4a46-b991-833c2d31f0b5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 13 14:00:09.717489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8020b-db4e-420b-babc-7947eb91561b None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:09.717772 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8020b-db4e-420b-babc-7947eb91561b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:09.718047 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8020b-db4e-420b-babc-7947eb91561b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:09.737189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.sql.core [None req-906565a3-bca3-4a46-b991-833c2d31f0b5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 14:00:09.737189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 13 14:00:09.737189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [parameters: {'id': '2040b98495fb4214bbbf954642feb9ac', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 13 14:00:09.737189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81626) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 14:00:09.737717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-fef8020b-db4e-420b-babc-7947eb91561b None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:09.738906 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-fef8020b-db4e-420b-babc-7947eb91561b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:09.759784 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-906565a3-bca3-4a46-b991-833c2d31f0b5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2040b98495fb4214bbbf954642feb9ac.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2040b98495fb4214bbbf954642feb9ac. Sep 13 14:00:09.759784 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:09.759784 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 14:00:09.759784 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 14:00:09.759784 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 14:00:09.759784 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 14:00:09.759784 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 14:00:09.759784 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 14:00:09.759784 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 14:00:09.759784 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application conn.query(q) Sep 13 14:00:09.759784 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 14:00:09.759784 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 14:00:09.759784 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 14:00:09.760624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application result.read() Sep 13 14:00:09.760624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 14:00:09.760624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 14:00:09.760624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 14:00:09.760624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 14:00:09.760624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 14:00:09.760624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 14:00:09.760624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 14:00:09.760624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 14:00:09.760624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 14:00:09.760624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:09.760624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 14:00:09.760624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:09.760624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:09.760624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 14:00:09.760624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 14:00:09.760624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 13 14:00:09.760624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 13 14:00:09.761576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 14:00:09.761576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application next(self.gen) Sep 13 14:00:09.761576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 14:00:09.761576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application yield resource Sep 13 14:00:09.761576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 14:00:09.761576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application next(self.gen) Sep 13 14:00:09.761576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 14:00:09.761576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 14:00:09.761576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 14:00:09.761576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 14:00:09.761576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 14:00:09.761576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise self.value Sep 13 14:00:09.761576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 14:00:09.761576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 14:00:09.761576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 14:00:09.761576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application session.commit() Sep 13 14:00:09.761576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 14:00:09.762443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 14:00:09.762443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 14:00:09.762443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 14:00:09.762443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 14:00:09.762443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self.session.flush() Sep 13 14:00:09.762443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 14:00:09.762443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 14:00:09.762443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 14:00:09.762443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 14:00:09.762443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 14:00:09.762443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application compat.raise_( Sep 13 14:00:09.762443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 14:00:09.762443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception Sep 13 14:00:09.762443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 14:00:09.762443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 14:00:09.762443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 14:00:09.762443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 14:00:09.763489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 14:00:09.763489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 14:00:09.763489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 14:00:09.763489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 14:00:09.763489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 13 14:00:09.763489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 13 14:00:09.763489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 14:00:09.763489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 14:00:09.763489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 14:00:09.763489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 14:00:09.763489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 14:00:09.763489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 14:00:09.763489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 14:00:09.763489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 14:00:09.763489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 14:00:09.764298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 14:00:09.764298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 14:00:09.764298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception Sep 13 14:00:09.764298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 14:00:09.764298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 14:00:09.764298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 14:00:09.764298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 14:00:09.764298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 14:00:09.764298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 14:00:09.764298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 14:00:09.764298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application conn.query(q) Sep 13 14:00:09.764298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 14:00:09.764298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 14:00:09.764298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 14:00:09.764298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application result.read() Sep 13 14:00:09.764298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 14:00:09.764298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 14:00:09.765377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 14:00:09.765377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 14:00:09.765377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 14:00:09.765377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 14:00:09.765377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 14:00:09.765377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 14:00:09.765377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 14:00:09.765377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 13 14:00:09.765377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [parameters: {'id': '2040b98495fb4214bbbf954642feb9ac', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 13 14:00:09.765377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 14:00:09.765377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:09.765377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 14:00:09.765377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:09.765377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:09.765377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 13 14:00:09.766350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 13 14:00:09.766350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 14:00:09.766350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 14:00:09.766350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 13 14:00:09.766350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:09.766350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 14:00:09.766350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:09.766350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:09.766350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:09.766350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:09.766350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:09.766350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:09.766350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:09.766350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:09.766350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:09.766350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:09.766350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:09.774195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:09.774195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 13 14:00:09.774195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 13 14:00:09.774195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:09.774195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:09.774195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 13 14:00:09.774195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 13 14:00:09.774195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2040b98495fb4214bbbf954642feb9ac. Sep 13 14:00:09.774195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:09.774195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 473/948] 10.222.0.26 () {60 vars in 1140 bytes} [Tue Sep 13 14:00:09 2022] POST /identity/v3/projects => generated 262 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:09.774195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906565a3-bca3-4a46-b991-833c2d31f0b5 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:09.808721 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:09.829420 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 476/949] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:00:09.896296 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906565a3-bca3-4a46-b991-833c2d31f0b5 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:09.932818 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d6e22-8ecf-4f69-8f25-91ae2c7f2488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:09.933482 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d6e22-8ecf-4f69-8f25-91ae2c7f2488 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:09.933761 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d6e22-8ecf-4f69-8f25-91ae2c7f2488 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:09.934031 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d6e22-8ecf-4f69-8f25-91ae2c7f2488 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:09.941111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d6e22-8ecf-4f69-8f25-91ae2c7f2488 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:09.942850 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d6e22-8ecf-4f69-8f25-91ae2c7f2488 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:09.954540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-823d6e22-8ecf-4f69-8f25-91ae2c7f2488 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 14:00:09.954540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:09.954540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:09.954540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:09.954540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:09.954540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:09.954540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:09.954540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:09.954540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:09.954540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:09.954540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:09.954540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:09.954540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 14:00:09.954540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 14:00:09.954540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 14:00:09.957174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 14:00:09.957174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:09.957174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:09.957174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:09.957174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:09.957174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:09.957174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:09.957174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:09.957174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:09.957174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:09.957174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:09.957174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:09.957174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:09.957174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:09.957174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:09.957174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:09.957174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:09.959324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 14:00:09.959324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 14:00:09.959324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 14:00:09.959324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 14:00:09.959324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 14:00:09.959324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 14:00:09.959324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 14:00:09.959324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:09.959324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 474/950] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 14:00:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:09.966334 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef8020b-db4e-420b-babc-7947eb91561b None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:10.081267 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef8020b-db4e-420b-babc-7947eb91561b None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:10.102903 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:10.118802 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956101e6-6d64-42b3-ab66-1aef784a8303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:10.119696 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956101e6-6d64-42b3-ab66-1aef784a8303 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:10.120156 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956101e6-6d64-42b3-ab66-1aef784a8303 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:10.120603 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956101e6-6d64-42b3-ab66-1aef784a8303 None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:10.121584 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956101e6-6d64-42b3-ab66-1aef784a8303 None admin] RBAC: Adding query filter params (name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:10.122738 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d6e22-8ecf-4f69-8f25-91ae2c7f2488 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:10.123838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956101e6-6d64-42b3-ab66-1aef784a8303 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:10.125398 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956101e6-6d64-42b3-ab66-1aef784a8303 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:10.144375 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 477/951] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Sep 13 14:00:09 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:10.145665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9e244-1b26-4e90-ab51-f9cb87a1712d None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:10.145953 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9e244-1b26-4e90-ab51-f9cb87a1712d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:10.146227 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9e244-1b26-4e90-ab51-f9cb87a1712d None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:10.147599 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 478/952] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:00:10.153196 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f9bd5-6c52-43f0-8ea2-2e7f954a8b4e None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:10.153502 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f9bd5-6c52-43f0-8ea2-2e7f954a8b4e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:10.153734 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f9bd5-6c52-43f0-8ea2-2e7f954a8b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:10.177405 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-738f9bd5-6c52-43f0-8ea2-2e7f954a8b4e None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:10.178652 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-738f9bd5-6c52-43f0-8ea2-2e7f954a8b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:10.246176 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:10.277127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d6e22-8ecf-4f69-8f25-91ae2c7f2488 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:10.277342 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 479/953] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 14:00:10.322416 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c751b-0d63-46f8-b3ae-6168142f56e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:10.323056 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c751b-0d63-46f8-b3ae-6168142f56e9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:10.323331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c751b-0d63-46f8-b3ae-6168142f56e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:10.323599 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c751b-0d63-46f8-b3ae-6168142f56e9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:10.324179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c751b-0d63-46f8-b3ae-6168142f56e9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:10.325581 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c751b-0d63-46f8-b3ae-6168142f56e9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:10.334956 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-b24c751b-0d63-46f8-b3ae-6168142f56e9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 14:00:10.334956 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:10.334956 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 14:00:10.334956 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 14:00:10.334956 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 14:00:10.334956 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 14:00:10.334956 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 14:00:10.334956 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:10.334956 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 14:00:10.334956 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:10.334956 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 14:00:10.334956 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:10.334956 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:10.334956 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:10.334956 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:10.334956 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:10.334956 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:10.336148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:10.336148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:10.336148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:10.336148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:10.336148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:10.336148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:10.336148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 14:00:10.336148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 14:00:10.336148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 14:00:10.336148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 14:00:10.336148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:10.336148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:10.336148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:10.336148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:10.336148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:10.336148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:10.337030 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:10.337030 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:10.337030 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:10.337030 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:10.337030 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:10.337030 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:10.337030 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:10.337030 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:10.337030 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:10.337030 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:10.337030 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 14:00:10.337030 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:10.337030 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 14:00:10.337030 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:10.337030 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 475/954] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Sep 13 14:00:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:10.343210 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f9bd5-6c52-43f0-8ea2-2e7f954a8b4e None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:10.456365 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f9bd5-6c52-43f0-8ea2-2e7f954a8b4e None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:10.469376 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:10.494950 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad9d78-5c78-44e0-b60a-c1dab75740d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:10.495558 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad9d78-5c78-44e0-b60a-c1dab75740d1 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:10.495884 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad9d78-5c78-44e0-b60a-c1dab75740d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:10.496160 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad9d78-5c78-44e0-b60a-c1dab75740d1 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:10.496794 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad9d78-5c78-44e0-b60a-c1dab75740d1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:10.497114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad9d78-5c78-44e0-b60a-c1dab75740d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:10.498492 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad9d78-5c78-44e0-b60a-c1dab75740d1 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:10.504217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 480/955] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Sep 13 14:00:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:10.509618 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c751b-0d63-46f8-b3ae-6168142f56e9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:10.543640 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad9d78-5c78-44e0-b60a-c1dab75740d1 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:10.623103 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c751b-0d63-46f8-b3ae-6168142f56e9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:10.658484 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad9d78-5c78-44e0-b60a-c1dab75740d1 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:10.660905 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83455bc8-e6ed-4f26-8b8d-95105aa277a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:10.661549 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83455bc8-e6ed-4f26-8b8d-95105aa277a0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:10.661824 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83455bc8-e6ed-4f26-8b8d-95105aa277a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:10.662093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83455bc8-e6ed-4f26-8b8d-95105aa277a0 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:10.662725 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83455bc8-e6ed-4f26-8b8d-95105aa277a0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:10.663025 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83455bc8-e6ed-4f26-8b8d-95105aa277a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:10.664403 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83455bc8-e6ed-4f26-8b8d-95105aa277a0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:10.672419 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 476/956] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Sep 13 14:00:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:10.677269 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ed6ab-8e4f-4272-99c4-916cadf87378 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:10.677269 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ed6ab-8e4f-4272-99c4-916cadf87378 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:10.677269 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ed6ab-8e4f-4272-99c4-916cadf87378 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:10.677269 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 477/957] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:00:10.677810 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ed6ab-8e4f-4272-99c4-916cadf87378 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:10.693850 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:10.706276 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742fb293-72af-473a-8799-14d4005d1bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:10.706931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fb293-72af-473a-8799-14d4005d1bbb None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:10.707265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fb293-72af-473a-8799-14d4005d1bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:10.707543 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fb293-72af-473a-8799-14d4005d1bbb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:10.720066 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742fb293-72af-473a-8799-14d4005d1bbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 14:00:10.726703 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-742fb293-72af-473a-8799-14d4005d1bbb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 14:00:10.726703 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:10.726703 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:10.726703 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:10.726703 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:10.726703 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:10.726703 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:10.726703 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:10.726703 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:10.726703 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:10.726703 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:10.726703 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:10.726703 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 14:00:10.726703 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 14:00:10.726703 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 14:00:10.726703 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 14:00:10.727837 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 14:00:10.727837 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 14:00:10.727837 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 14:00:10.727837 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 14:00:10.727837 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:10.727837 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:10.727837 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:10.727837 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:10.727837 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:10.727837 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:10.727837 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:10.727837 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:10.727837 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:10.727837 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:10.727837 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:10.727837 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:10.728693 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:10.728693 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:10.728693 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:10.728693 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:10.728693 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 14:00:10.728693 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 14:00:10.728693 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 14:00:10.728693 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 14:00:10.728693 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 14:00:10.728693 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 14:00:10.728693 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 14:00:10.728693 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:10.728693 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 481/958] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Sep 13 14:00:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 14:00:10.729443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27b6af-4f8c-4bb4-b686-7974c81be0ed None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:10.729693 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27b6af-4f8c-4bb4-b686-7974c81be0ed None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:10.729963 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27b6af-4f8c-4bb4-b686-7974c81be0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:10.748749 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-cf27b6af-4f8c-4bb4-b686-7974c81be0ed None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:10.749959 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-cf27b6af-4f8c-4bb4-b686-7974c81be0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:10.779008 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:10.793117 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ed6ab-8e4f-4272-99c4-916cadf87378 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:10.821644 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 482/959] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:00:10.833293 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27b6af-4f8c-4bb4-b686-7974c81be0ed None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:10.842237 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e2b78-5b22-4859-b820-8d848f42914a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:10.842852 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e2b78-5b22-4859-b820-8d848f42914a None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:10.843245 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e2b78-5b22-4859-b820-8d848f42914a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:10.843525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e2b78-5b22-4859-b820-8d848f42914a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:10.844204 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e2b78-5b22-4859-b820-8d848f42914a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:10.845650 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e2b78-5b22-4859-b820-8d848f42914a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:10.872581 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 478/960] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:00:10 2022] POST /identity/v3/endpoints => generated 349 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:00:10.949065 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27b6af-4f8c-4bb4-b686-7974c81be0ed None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:10.995088 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9819a60-129b-46ed-9d39-95208ef9aaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:10.995704 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9819a60-129b-46ed-9d39-95208ef9aaf8 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:10.995982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9819a60-129b-46ed-9d39-95208ef9aaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:10.996313 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9819a60-129b-46ed-9d39-95208ef9aaf8 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:10.996999 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9819a60-129b-46ed-9d39-95208ef9aaf8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:10.997340 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9819a60-129b-46ed-9d39-95208ef9aaf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:10.998807 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9819a60-129b-46ed-9d39-95208ef9aaf8 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:11.010029 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 483/961] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Sep 13 14:00:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:11.015913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e2b78-5b22-4859-b820-8d848f42914a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:11.088307 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:11.117748 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9819a60-129b-46ed-9d39-95208ef9aaf8 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:11.126209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e2b78-5b22-4859-b820-8d848f42914a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:11.147271 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:11.172411 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3c712-9722-4101-abdb-17402d96fcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:11.173048 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3c712-9722-4101-abdb-17402d96fcf3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:11.173370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3c712-9722-4101-abdb-17402d96fcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:11.173639 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3c712-9722-4101-abdb-17402d96fcf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:11.185613 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3c712-9722-4101-abdb-17402d96fcf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:11.187079 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3c712-9722-4101-abdb-17402d96fcf3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:11.205853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-33c3c712-9722-4101-abdb-17402d96fcf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:00:11.205853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:11.205853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:11.205853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:11.205853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:11.205853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:11.205853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:11.205853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:11.205853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:11.205853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:11.205853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:11.205853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:11.205853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 14:00:11.205853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 14:00:11.205853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 14:00:11.205853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 14:00:11.206848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:11.206848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:11.206848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:11.206848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:11.206848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:11.206848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:11.206848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:11.206848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:11.206848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:11.206848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:11.206848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:11.206848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:11.206848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:11.206848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:11.206848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:11.206848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:11.206848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 14:00:11.208164 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 14:00:11.208164 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:00:11.208164 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:11.208164 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 479/962] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:11.213275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3c712-9722-4101-abdb-17402d96fcf3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:11.238946 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9819a60-129b-46ed-9d39-95208ef9aaf8 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:11.277201 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e0ab0-08b3-4918-9559-0edf667b88ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:11.278192 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e0ab0-08b3-4918-9559-0edf667b88ef None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:11.279109 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e0ab0-08b3-4918-9559-0edf667b88ef None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:11.279593 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e0ab0-08b3-4918-9559-0edf667b88ef None admin] PATH_INFO: `/v3/services/compute` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:11.280372 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e0ab0-08b3-4918-9559-0edf667b88ef None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:11.282018 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e0ab0-08b3-4918-9559-0edf667b88ef None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:11.292224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-234e0ab0-08b3-4918-9559-0edf667b88ef None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 14:00:11.292224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:11.292224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 14:00:11.292224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 14:00:11.292224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 14:00:11.292224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 14:00:11.292224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 14:00:11.292224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:11.292224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 14:00:11.292224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:11.292224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 14:00:11.292224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:11.292224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:11.292224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:11.292224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:11.292224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:11.292224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:11.293281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:11.293281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:11.293281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:11.293281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:11.293281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:11.293281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:11.293281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 14:00:11.293281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 14:00:11.293281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 14:00:11.293281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 14:00:11.293281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:11.293281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:11.293281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:11.293281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:11.293281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:11.293281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:11.294117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:11.294117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:11.294117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:11.294117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:11.294117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:11.294117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:11.294117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:11.294117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:11.294117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:11.294117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:11.294117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 14:00:11.294117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:11.294117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 14:00:11.294117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:11.302104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 484/963] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 14:00:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 14:00:11.303589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e0ab0-08b3-4918-9559-0edf667b88ef None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:11.341480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3c712-9722-4101-abdb-17402d96fcf3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:11.363854 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:11.382891 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cea6c3-5b29-4304-abe9-dd28c0a5ee22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:11.383412 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cea6c3-5b29-4304-abe9-dd28c0a5ee22 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:11.383691 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cea6c3-5b29-4304-abe9-dd28c0a5ee22 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:11.383964 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cea6c3-5b29-4304-abe9-dd28c0a5ee22 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:11.384871 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cea6c3-5b29-4304-abe9-dd28c0a5ee22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:11.385216 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cea6c3-5b29-4304-abe9-dd28c0a5ee22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:11.386857 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cea6c3-5b29-4304-abe9-dd28c0a5ee22 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:11.404207 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:11.404856 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 480/964] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 14:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:11.410645 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cea6c3-5b29-4304-abe9-dd28c0a5ee22 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:11.429113 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e0ab0-08b3-4918-9559-0edf667b88ef None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:11.475458 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7f80f-7429-4ff1-8be5-02652cc0585e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:11.476067 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7f80f-7429-4ff1-8be5-02652cc0585e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:11.476344 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7f80f-7429-4ff1-8be5-02652cc0585e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:11.476620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7f80f-7429-4ff1-8be5-02652cc0585e None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:11.477285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7f80f-7429-4ff1-8be5-02652cc0585e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:11.477754 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7f80f-7429-4ff1-8be5-02652cc0585e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:11.479796 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7f80f-7429-4ff1-8be5-02652cc0585e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:11.485697 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 485/965] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Sep 13 14:00:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:11.492617 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7f80f-7429-4ff1-8be5-02652cc0585e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:11.531753 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cea6c3-5b29-4304-abe9-dd28c0a5ee22 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:11.576580 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835223a-22d6-40ed-9bb6-05338c9ed503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:11.577245 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835223a-22d6-40ed-9bb6-05338c9ed503 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:11.577525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835223a-22d6-40ed-9bb6-05338c9ed503 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:11.577796 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835223a-22d6-40ed-9bb6-05338c9ed503 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:11.586711 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835223a-22d6-40ed-9bb6-05338c9ed503 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:11.588317 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835223a-22d6-40ed-9bb6-05338c9ed503 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:11.603506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-8835223a-22d6-40ed-9bb6-05338c9ed503 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 14:00:11.603506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:11.603506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:11.603506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:11.603506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:11.603506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:11.603506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:11.603506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:11.603506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:11.603506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:11.603506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:11.603506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:11.603506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 14:00:11.603506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 14:00:11.603506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 14:00:11.603506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 14:00:11.604452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:11.604452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:11.604452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 14:00:11.604452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 14:00:11.604452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 14:00:11.604452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 14:00:11.604452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:11.604452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:11.604452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:11.604452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:11.604452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:11.604452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:11.604452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:11.604452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:11.604452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:11.604452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:11.604452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:11.604452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:11.606057 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:11.606057 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:11.606057 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 14:00:11.606057 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 14:00:11.606057 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 14:00:11.606057 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 14:00:11.606057 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 14:00:11.606057 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 14:00:11.606057 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 14:00:11.606057 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:11.606057 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 481/966] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Sep 13 14:00:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 14:00:11.610125 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835223a-22d6-40ed-9bb6-05338c9ed503 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:11.612485 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7f80f-7429-4ff1-8be5-02652cc0585e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:11.662550 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e67562-9eb7-41e9-9dcb-35936846d611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:11.663073 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e67562-9eb7-41e9-9dcb-35936846d611 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:11.663347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e67562-9eb7-41e9-9dcb-35936846d611 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:11.663614 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e67562-9eb7-41e9-9dcb-35936846d611 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:11.664251 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e67562-9eb7-41e9-9dcb-35936846d611 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:11.664552 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e67562-9eb7-41e9-9dcb-35936846d611 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:11.666412 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e67562-9eb7-41e9-9dcb-35936846d611 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:11.667511 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:11.677848 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 486/967] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Sep 13 14:00:11 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:11.743673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835223a-22d6-40ed-9bb6-05338c9ed503 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:11.781385 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44a7c1-39d0-44c5-ac48-9fe80723ff50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:11.782002 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44a7c1-39d0-44c5-ac48-9fe80723ff50 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:11.782277 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44a7c1-39d0-44c5-ac48-9fe80723ff50 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:11.782801 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44a7c1-39d0-44c5-ac48-9fe80723ff50 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:11.783538 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44a7c1-39d0-44c5-ac48-9fe80723ff50 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:11.784392 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44a7c1-39d0-44c5-ac48-9fe80723ff50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:11.785887 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44a7c1-39d0-44c5-ac48-9fe80723ff50 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:11.806483 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 482/968] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Sep 13 14:00:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:11.814286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e67562-9eb7-41e9-9dcb-35936846d611 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:11.836757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:11.932714 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e67562-9eb7-41e9-9dcb-35936846d611 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:11.967911 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ce2e3-5348-4dda-9501-43df2e42a93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:11.968513 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ce2e3-5348-4dda-9501-43df2e42a93c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:11.968833 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ce2e3-5348-4dda-9501-43df2e42a93c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:11.969120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ce2e3-5348-4dda-9501-43df2e42a93c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:12.038865 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ce2e3-5348-4dda-9501-43df2e42a93c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:12.040398 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ce2e3-5348-4dda-9501-43df2e42a93c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:12.056042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:12.146365 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 487/969] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 14:00:11 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 14:00:12.152057 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44a7c1-39d0-44c5-ac48-9fe80723ff50 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:12.254538 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:12.258740 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44a7c1-39d0-44c5-ac48-9fe80723ff50 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:12.297216 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336bee7-2f11-4271-9e9a-8f67d662873b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:12.298260 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336bee7-2f11-4271-9e9a-8f67d662873b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:12.298746 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336bee7-2f11-4271-9e9a-8f67d662873b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:12.299245 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336bee7-2f11-4271-9e9a-8f67d662873b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:12.312309 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336bee7-2f11-4271-9e9a-8f67d662873b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:12.314300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336bee7-2f11-4271-9e9a-8f67d662873b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:12.332099 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-5336bee7-2f11-4271-9e9a-8f67d662873b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:00:12.332099 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:12.332099 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:12.332099 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:12.332099 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:12.332099 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:12.332099 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:12.332099 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:12.332099 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:12.332099 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:12.332099 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:12.332099 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:12.332099 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 14:00:12.332099 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 14:00:12.332099 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 14:00:12.332099 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 14:00:12.333110 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:12.333110 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:12.333110 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:12.333110 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:12.333110 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:12.333110 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:12.333110 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:12.333110 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:12.333110 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:12.333110 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:12.333110 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:12.333110 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:12.333110 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:12.333110 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:12.333110 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:12.333110 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:12.333110 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 14:00:12.334012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 14:00:12.334012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:00:12.334012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:12.336192 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 483/970] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:12.342354 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ce2e3-5348-4dda-9501-43df2e42a93c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:12.420062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4731089-d2f8-4d96-a266-f3bca84746f7 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:12.420591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4731089-d2f8-4d96-a266-f3bca84746f7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:12.420591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4731089-d2f8-4d96-a266-f3bca84746f7 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:12.422199 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 484/971] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:00:12.427019 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acafad5-f82d-476d-ab09-8a9eea854527 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:12.427301 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acafad5-f82d-476d-ab09-8a9eea854527 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:12.427571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acafad5-f82d-476d-ab09-8a9eea854527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:12.446997 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-4acafad5-f82d-476d-ab09-8a9eea854527 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:12.447828 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ce2e3-5348-4dda-9501-43df2e42a93c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:12.448545 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4acafad5-f82d-476d-ab09-8a9eea854527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:12.462699 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:12.484665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef52047-7a99-4864-a1ce-77e0cf239dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:12.485290 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef52047-7a99-4864-a1ce-77e0cf239dcd None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:12.485561 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef52047-7a99-4864-a1ce-77e0cf239dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:12.485821 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef52047-7a99-4864-a1ce-77e0cf239dcd None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:12.486455 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef52047-7a99-4864-a1ce-77e0cf239dcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:12.486752 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef52047-7a99-4864-a1ce-77e0cf239dcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:12.488157 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef52047-7a99-4864-a1ce-77e0cf239dcd None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:12.500114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 488/972] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 14:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:12.506083 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef52047-7a99-4864-a1ce-77e0cf239dcd None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:12.533015 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 485/973] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:00:12.615643 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef52047-7a99-4864-a1ce-77e0cf239dcd None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:12.656834 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49060278-d17e-4bcc-beb7-1bbf1ddacf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:12.657806 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49060278-d17e-4bcc-beb7-1bbf1ddacf51 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:12.658086 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49060278-d17e-4bcc-beb7-1bbf1ddacf51 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:12.658357 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49060278-d17e-4bcc-beb7-1bbf1ddacf51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:12.665972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49060278-d17e-4bcc-beb7-1bbf1ddacf51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:12.667462 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49060278-d17e-4bcc-beb7-1bbf1ddacf51 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:12.679264 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-49060278-d17e-4bcc-beb7-1bbf1ddacf51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 14:00:12.679264 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:12.679264 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:12.679264 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:12.679264 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:12.679264 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:12.679264 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:12.679264 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:12.679264 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:12.679264 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:12.679264 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:12.679264 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:12.679264 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 14:00:12.679264 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 14:00:12.679264 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 14:00:12.680178 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 14:00:12.680178 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:12.680178 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:12.680178 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:12.680178 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:12.680178 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:12.680178 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:12.680178 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:12.680178 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:12.680178 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:12.680178 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:12.680178 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:12.680178 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:12.680178 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:12.680178 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:12.680178 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:12.680178 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:12.681723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 14:00:12.681723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 14:00:12.681723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 14:00:12.681723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 14:00:12.681723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 14:00:12.681723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 14:00:12.681723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 14:00:12.681723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:12.681723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 489/974] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 14:00:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:12.686548 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acafad5-f82d-476d-ab09-8a9eea854527 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:12.774286 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:12.795964 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acafad5-f82d-476d-ab09-8a9eea854527 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:12.808148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49060278-d17e-4bcc-beb7-1bbf1ddacf51 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:12.834763 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441a5ea-be86-4266-ae8d-b4a2e86ead6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:12.835715 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441a5ea-be86-4266-ae8d-b4a2e86ead6a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:12.836133 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441a5ea-be86-4266-ae8d-b4a2e86ead6a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:12.836581 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441a5ea-be86-4266-ae8d-b4a2e86ead6a None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:12.837438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441a5ea-be86-4266-ae8d-b4a2e86ead6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:12.837931 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441a5ea-be86-4266-ae8d-b4a2e86ead6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:12.839621 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441a5ea-be86-4266-ae8d-b4a2e86ead6a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:12.847923 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:12.852519 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 486/975] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 14:00:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:12.858533 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441a5ea-be86-4266-ae8d-b4a2e86ead6a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:12.929765 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49060278-d17e-4bcc-beb7-1bbf1ddacf51 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:12.974689 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fe9ed-a7ce-4ae5-9e81-7f43b53cd996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:12.975643 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fe9ed-a7ce-4ae5-9e81-7f43b53cd996 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:12.976113 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fe9ed-a7ce-4ae5-9e81-7f43b53cd996 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:12.976607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fe9ed-a7ce-4ae5-9e81-7f43b53cd996 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:12.977457 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4fe9ed-a7ce-4ae5-9e81-7f43b53cd996 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:12.979071 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4fe9ed-a7ce-4ae5-9e81-7f43b53cd996 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:12.981836 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441a5ea-be86-4266-ae8d-b4a2e86ead6a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:12.982055 dv-cinder-857434-1-smb devstack@keystone.service[81625]: WARNING keystone.server.flask.common [None req-8d4fe9ed-a7ce-4ae5-9e81-7f43b53cd996 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 13 14:00:12.995999 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.sql.core [None req-8d4fe9ed-a7ce-4ae5-9e81-7f43b53cd996 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 14:00:12.995999 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 13 14:00:12.995999 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [parameters: {'user_id': 'f00fa329ad5d4f78a9183980066de687', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 13 14:00:12.995999 dv-cinder-857434-1-smb devstack@keystone.service[81625]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81625) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 14:00:13.004604 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-8d4fe9ed-a7ce-4ae5-9e81-7f43b53cd996 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 13 14:00:13.004604 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:13.004604 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 14:00:13.004604 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 14:00:13.004604 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 14:00:13.004604 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 14:00:13.004604 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 14:00:13.004604 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 14:00:13.004604 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 14:00:13.004604 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application conn.query(q) Sep 13 14:00:13.004604 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 14:00:13.004604 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 14:00:13.004604 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 14:00:13.004604 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application result.read() Sep 13 14:00:13.004604 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 14:00:13.005512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 14:00:13.005512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 14:00:13.005512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 14:00:13.005512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 14:00:13.005512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 14:00:13.005512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 14:00:13.005512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 14:00:13.005512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 14:00:13.005512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:13.005512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 14:00:13.005512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:13.005512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:13.005512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 14:00:13.005512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 14:00:13.005512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 13 14:00:13.005512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 13 14:00:13.005512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 14:00:13.005512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application next(self.gen) Sep 13 14:00:13.006581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 14:00:13.006581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application yield resource Sep 13 14:00:13.006581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 14:00:13.006581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application next(self.gen) Sep 13 14:00:13.006581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 14:00:13.006581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 14:00:13.006581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 14:00:13.006581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 14:00:13.006581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 14:00:13.006581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise self.value Sep 13 14:00:13.006581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 14:00:13.006581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 14:00:13.006581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 14:00:13.006581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application session.commit() Sep 13 14:00:13.006581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 14:00:13.006581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 14:00:13.006581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 14:00:13.008056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 14:00:13.008056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 14:00:13.008056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self.session.flush() Sep 13 14:00:13.008056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 14:00:13.008056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 14:00:13.008056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 14:00:13.008056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 14:00:13.008056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 14:00:13.008056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application compat.raise_( Sep 13 14:00:13.008056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 14:00:13.008056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception Sep 13 14:00:13.008056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 14:00:13.008056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 14:00:13.008056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 14:00:13.008056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 14:00:13.008056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 14:00:13.008056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 14:00:13.008944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 14:00:13.008944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 14:00:13.008944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 13 14:00:13.008944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 13 14:00:13.008944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 14:00:13.008944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 14:00:13.008944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 14:00:13.008944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 14:00:13.008944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 14:00:13.008944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 14:00:13.008944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 14:00:13.008944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 14:00:13.008944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 14:00:13.008944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 14:00:13.008944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 14:00:13.008944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception Sep 13 14:00:13.010487 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 14:00:13.010487 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 14:00:13.010487 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 14:00:13.010487 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 14:00:13.010487 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 14:00:13.010487 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 14:00:13.010487 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 14:00:13.010487 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application conn.query(q) Sep 13 14:00:13.010487 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 14:00:13.010487 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 14:00:13.010487 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 14:00:13.010487 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application result.read() Sep 13 14:00:13.010487 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 14:00:13.010487 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 14:00:13.010487 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 14:00:13.010487 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 14:00:13.011972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 14:00:13.011972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 14:00:13.011972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 14:00:13.011972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 14:00:13.011972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 14:00:13.011972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 13 14:00:13.011972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f00fa329ad5d4f78a9183980066de687', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 13 14:00:13.011972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 14:00:13.011972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:13.011972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 14:00:13.011972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:13.011972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:13.011972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:13.011972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:13.011972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:13.012942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:13.012942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:13.012942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:13.012942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:13.012942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:13.012942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:13.012942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:13.012942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 13 14:00:13.012942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 13 14:00:13.012942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:13.012942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:13.012942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 14:00:13.012942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 14:00:13.012942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 14:00:13.012942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 14:00:13.012942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 13 14:00:13.012942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 13 14:00:13.014081 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 13 14:00:13.014081 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 13 14:00:13.014081 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 14:00:13.014081 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 14:00:13.014081 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 13 14:00:13.014081 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:13.014081 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 490/976] 10.222.0.26 () {60 vars in 1131 bytes} [Tue Sep 13 14:00:12 2022] POST /identity/v3/users => generated 160 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:13.020314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fe9ed-a7ce-4ae5-9e81-7f43b53cd996 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:13.034763 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef17c2-5cb2-45b9-9487-3799c0977dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:13.035724 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef17c2-5cb2-45b9-9487-3799c0977dcb None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:13.036322 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef17c2-5cb2-45b9-9487-3799c0977dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:13.036851 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef17c2-5cb2-45b9-9487-3799c0977dcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:13.037807 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef17c2-5cb2-45b9-9487-3799c0977dcb None admin] RBAC: Adding query filter params (role.id=a0ce4da381a2401daee681a57a4731b3, scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086, user.id=0c41b4ecb17a43fdb05e586cce43b5a5) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:13.038344 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef17c2-5cb2-45b9-9487-3799c0977dcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:13.040217 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef17c2-5cb2-45b9-9487-3799c0977dcb None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:13.047506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 487/977] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 14:00:12 2022] GET /identity/v3/role_assignments?user.id=0c41b4ecb17a43fdb05e586cce43b5a5&scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086&role.id=a0ce4da381a2401daee681a57a4731b3 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:13.139835 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fe9ed-a7ce-4ae5-9e81-7f43b53cd996 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:13.159227 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:13.180930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37523aca-afef-4847-b71c-bce44e82db9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:13.181693 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37523aca-afef-4847-b71c-bce44e82db9d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:13.181970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37523aca-afef-4847-b71c-bce44e82db9d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:13.182254 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37523aca-afef-4847-b71c-bce44e82db9d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:13.190907 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84c271-c5db-4034-a7fe-887392c1545e None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:13.191261 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84c271-c5db-4034-a7fe-887392c1545e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:13.191467 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84c271-c5db-4034-a7fe-887392c1545e None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:13.191647 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37523aca-afef-4847-b71c-bce44e82db9d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:13.193352 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37523aca-afef-4847-b71c-bce44e82db9d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:13.197629 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 488/978] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 14:00:13.199002 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea54e00-72fc-4310-8405-0d405063ba9d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:13.199288 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea54e00-72fc-4310-8405-0d405063ba9d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:13.199563 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea54e00-72fc-4310-8405-0d405063ba9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:13.206788 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-37523aca-afef-4847-b71c-bce44e82db9d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 14:00:13.206788 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:13.206788 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:13.206788 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:13.206788 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:13.206788 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:13.206788 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:13.206788 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:13.206788 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:13.206788 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:13.206788 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:13.206788 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:13.206788 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 14:00:13.206788 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 14:00:13.206788 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 14:00:13.206788 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 14:00:13.207855 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:13.207855 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:13.207855 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 14:00:13.207855 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 14:00:13.207855 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 14:00:13.207855 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 14:00:13.207855 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:13.207855 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:13.207855 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:13.207855 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:13.207855 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:13.207855 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:13.207855 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:13.207855 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:13.207855 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:13.207855 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:13.207855 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:13.207855 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:13.208802 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:13.208802 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:13.208802 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 14:00:13.208802 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 14:00:13.208802 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 14:00:13.208802 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 14:00:13.208802 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 14:00:13.208802 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 14:00:13.208802 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 14:00:13.208802 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:13.209378 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:13.211330 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 491/979] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 14:00:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:13.218341 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37523aca-afef-4847-b71c-bce44e82db9d None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:13.222351 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-cea54e00-72fc-4310-8405-0d405063ba9d None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:13.223694 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cea54e00-72fc-4310-8405-0d405063ba9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:13.324295 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 489/980] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:00:13.358830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37523aca-afef-4847-b71c-bce44e82db9d None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:13.398351 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c8330-2b6d-473e-ae66-255c5a9430db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:13.398957 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c8330-2b6d-473e-ae66-255c5a9430db None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:13.399231 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c8330-2b6d-473e-ae66-255c5a9430db None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:13.399499 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c8330-2b6d-473e-ae66-255c5a9430db None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:13.400196 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c8330-2b6d-473e-ae66-255c5a9430db None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:13.400493 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c8330-2b6d-473e-ae66-255c5a9430db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:13.401930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c8330-2b6d-473e-ae66-255c5a9430db None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:13.443387 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 492/981] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Sep 13 14:00:13 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:13.626667 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea54e00-72fc-4310-8405-0d405063ba9d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:13.779722 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea54e00-72fc-4310-8405-0d405063ba9d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:13.816357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af92955-d414-4c60-af5f-5000b46fc425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:13.816986 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af92955-d414-4c60-af5f-5000b46fc425 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:13.817285 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af92955-d414-4c60-af5f-5000b46fc425 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:13.817551 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af92955-d414-4c60-af5f-5000b46fc425 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:13.818133 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af92955-d414-4c60-af5f-5000b46fc425 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:13.819499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af92955-d414-4c60-af5f-5000b46fc425 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:13.821499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:13.829893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-8af92955-d414-4c60-af5f-5000b46fc425 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 14:00:13.829893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:13.829893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 14:00:13.829893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 14:00:13.829893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 14:00:13.829893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 14:00:13.829893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 14:00:13.829893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:13.829893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 14:00:13.829893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:13.829893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 14:00:13.829893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:13.829893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:13.829893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:13.829893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:13.829893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:13.829893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:13.830925 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:13.830925 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:13.830925 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:13.830925 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:13.830925 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:13.830925 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:13.830925 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 14:00:13.830925 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 14:00:13.830925 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 14:00:13.830925 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 14:00:13.830925 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:13.830925 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:13.830925 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:13.830925 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:13.830925 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:13.830925 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:13.832026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:13.832026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:13.832026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:13.832026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:13.832026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:13.832026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:13.832026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:13.832026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:13.832026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:13.832026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:13.832026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 14:00:13.832026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:13.832026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 14:00:13.832026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:13.833480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 490/982] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Sep 13 14:00:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:13.838168 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c8330-2b6d-473e-ae66-255c5a9430db None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:13.854827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:13.943847 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c8330-2b6d-473e-ae66-255c5a9430db None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:13.979037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dff34b-e90e-400d-a184-a04b798fadf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:13.979642 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dff34b-e90e-400d-a184-a04b798fadf1 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:13.979915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dff34b-e90e-400d-a184-a04b798fadf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:13.980181 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dff34b-e90e-400d-a184-a04b798fadf1 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:13.980811 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dff34b-e90e-400d-a184-a04b798fadf1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:13.981127 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dff34b-e90e-400d-a184-a04b798fadf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:13.982486 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dff34b-e90e-400d-a184-a04b798fadf1 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:13.987495 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 493/983] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Sep 13 14:00:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:13.993926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af92955-d414-4c60-af5f-5000b46fc425 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:14.108062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af92955-d414-4c60-af5f-5000b46fc425 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:14.143707 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357083a7-0db7-4097-a67c-bfa7d1f2789b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:14.144308 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357083a7-0db7-4097-a67c-bfa7d1f2789b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:14.144587 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357083a7-0db7-4097-a67c-bfa7d1f2789b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:14.144856 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357083a7-0db7-4097-a67c-bfa7d1f2789b None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:14.145510 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357083a7-0db7-4097-a67c-bfa7d1f2789b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:14.145812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357083a7-0db7-4097-a67c-bfa7d1f2789b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:14.147238 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357083a7-0db7-4097-a67c-bfa7d1f2789b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:14.152331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 491/984] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Sep 13 14:00:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:14.154460 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9580a-71e1-4a8c-bbac-8fbee2e5de52 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:14.154841 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9580a-71e1-4a8c-bbac-8fbee2e5de52 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:14.155213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9580a-71e1-4a8c-bbac-8fbee2e5de52 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:14.161240 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 494/985] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:00:14.161369 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357083a7-0db7-4097-a67c-bfa7d1f2789b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:14.162707 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a98b9-7c61-4e23-80f7-06406b3932e2 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:14.163050 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a98b9-7c61-4e23-80f7-06406b3932e2 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:14.163388 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a98b9-7c61-4e23-80f7-06406b3932e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:14.182366 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-391a98b9-7c61-4e23-80f7-06406b3932e2 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:14.183949 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-391a98b9-7c61-4e23-80f7-06406b3932e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:14.229716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:14.254541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 495/986] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:00:14.276622 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357083a7-0db7-4097-a67c-bfa7d1f2789b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:14.313217 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae615d-67f4-4eef-9e47-375855fe0030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:14.314002 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae615d-67f4-4eef-9e47-375855fe0030 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:14.314479 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae615d-67f4-4eef-9e47-375855fe0030 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:14.314991 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae615d-67f4-4eef-9e47-375855fe0030 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:14.316425 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae615d-67f4-4eef-9e47-375855fe0030 None admin] RBAC: Adding query filter params (interface=admin, service_id=3c2dc18d41684c10b64bd30913d722a0, region_id=RegionOne) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:14.316740 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae615d-67f4-4eef-9e47-375855fe0030 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:14.318156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae615d-67f4-4eef-9e47-375855fe0030 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:14.328049 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 492/987] 10.222.0.26 () {56 vars in 1249 bytes} [Tue Sep 13 14:00:14 2022] GET /identity/v3/endpoints?service_id=3c2dc18d41684c10b64bd30913d722a0&interface=admin®ion_id=RegionOne => generated 193 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:14.329299 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a98b9-7c61-4e23-80f7-06406b3932e2 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:14.339867 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:14.438543 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a98b9-7c61-4e23-80f7-06406b3932e2 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:14.474105 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bdfaa2-d769-4823-8156-16cbf521e0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:14.474702 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdfaa2-d769-4823-8156-16cbf521e0a7 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:14.474978 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdfaa2-d769-4823-8156-16cbf521e0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:14.475246 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdfaa2-d769-4823-8156-16cbf521e0a7 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:14.475848 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bdfaa2-d769-4823-8156-16cbf521e0a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:14.477233 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bdfaa2-d769-4823-8156-16cbf521e0a7 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:14.483457 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 496/988] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Sep 13 14:00:14 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:00:14.527655 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae615d-67f4-4eef-9e47-375855fe0030 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:14.641435 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae615d-67f4-4eef-9e47-375855fe0030 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:14.672346 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:14.682048 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730c00a-7c24-40b8-8694-e28ee769756a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:14.682657 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730c00a-7c24-40b8-8694-e28ee769756a None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:14.682939 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730c00a-7c24-40b8-8694-e28ee769756a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:14.683210 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730c00a-7c24-40b8-8694-e28ee769756a None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:14.683898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730c00a-7c24-40b8-8694-e28ee769756a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:14.685305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730c00a-7c24-40b8-8694-e28ee769756a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:14.700524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 493/989] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Sep 13 14:00:14 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:00:15.348739 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfd99a-e452-4d38-b80c-bcd7e1d59cb4 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:15.349149 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfd99a-e452-4d38-b80c-bcd7e1d59cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:15.349335 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfd99a-e452-4d38-b80c-bcd7e1d59cb4 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:15.350721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 497/990] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:00:15.355818 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801a4ae-1f94-4de6-8c50-43b80c847299 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:15.356104 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801a4ae-1f94-4de6-8c50-43b80c847299 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:15.356372 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801a4ae-1f94-4de6-8c50-43b80c847299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:15.375709 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-2801a4ae-1f94-4de6-8c50-43b80c847299 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:15.376929 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2801a4ae-1f94-4de6-8c50-43b80c847299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:15.452814 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 494/991] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:15 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:00:15.718862 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfd99a-e452-4d38-b80c-bcd7e1d59cb4 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:15.791748 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:15.822589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfd99a-e452-4d38-b80c-bcd7e1d59cb4 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:15.854909 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce835074-9443-46e1-9fe3-2d3210efa6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:15.855519 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce835074-9443-46e1-9fe3-2d3210efa6ac None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:15.855793 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce835074-9443-46e1-9fe3-2d3210efa6ac None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:15.856071 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce835074-9443-46e1-9fe3-2d3210efa6ac None admin] PATH_INFO: `/v3/services/image` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:15.856631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce835074-9443-46e1-9fe3-2d3210efa6ac None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:15.858002 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce835074-9443-46e1-9fe3-2d3210efa6ac None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:15.867089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-ce835074-9443-46e1-9fe3-2d3210efa6ac None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 14:00:15.867089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:15.867089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 14:00:15.867089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 14:00:15.867089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 14:00:15.867089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 14:00:15.867089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 14:00:15.867089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:15.867089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 14:00:15.867089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:15.867089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 14:00:15.867089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:15.867089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:15.867089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:15.867089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:15.867089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:15.867089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:15.868089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:15.868089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:15.868089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:15.868089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:15.868089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:15.868089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:15.868089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 14:00:15.868089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 14:00:15.868089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 14:00:15.868089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 14:00:15.868089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:15.868089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:15.868089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:15.868089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:15.868089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:15.868089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:15.868962 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:15.868962 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:15.868962 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:15.868962 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:15.868962 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:15.868962 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:15.868962 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:15.868962 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:15.868962 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:15.868962 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:15.868962 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 14:00:15.868962 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:15.868962 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 14:00:15.868962 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:15.873089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 498/992] 10.222.0.26 () {56 vars in 1105 bytes} [Tue Sep 13 14:00:15 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:15.874111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801a4ae-1f94-4de6-8c50-43b80c847299 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:15.973325 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801a4ae-1f94-4de6-8c50-43b80c847299 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:15.986377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:16.008944 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecc57d-2f29-4303-ae5d-7477dbebe9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:16.009572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecc57d-2f29-4303-ae5d-7477dbebe9bb None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:16.009849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecc57d-2f29-4303-ae5d-7477dbebe9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:16.010115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecc57d-2f29-4303-ae5d-7477dbebe9bb None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:16.010739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecc57d-2f29-4303-ae5d-7477dbebe9bb None admin] RBAC: Adding query filter params (name=image) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:16.011036 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecc57d-2f29-4303-ae5d-7477dbebe9bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:16.012400 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecc57d-2f29-4303-ae5d-7477dbebe9bb None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:16.017325 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 495/993] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:00:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:16.023450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce835074-9443-46e1-9fe3-2d3210efa6ac None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:16.125287 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce835074-9443-46e1-9fe3-2d3210efa6ac None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:16.158538 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb869b62-ef87-48de-824b-defa8b3be911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:16.159643 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb869b62-ef87-48de-824b-defa8b3be911 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:16.159915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb869b62-ef87-48de-824b-defa8b3be911 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:16.160179 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb869b62-ef87-48de-824b-defa8b3be911 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:16.160795 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb869b62-ef87-48de-824b-defa8b3be911 None admin] RBAC: Adding query filter params (type=image) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:16.161103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb869b62-ef87-48de-824b-defa8b3be911 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:16.162477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb869b62-ef87-48de-824b-defa8b3be911 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:16.164519 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:16.168720 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 499/994] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:00:16 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:16.673738 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84459e4b-b977-459d-900a-8e3f6a7a646c None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:16.674064 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84459e4b-b977-459d-900a-8e3f6a7a646c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:16.674826 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84459e4b-b977-459d-900a-8e3f6a7a646c None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:16.676343 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 496/995] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:00:16.681409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e64a2-d41e-49ce-8642-61011061cb10 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:16.681697 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e64a2-d41e-49ce-8642-61011061cb10 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:16.681970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e64a2-d41e-49ce-8642-61011061cb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:16.701040 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-983e64a2-d41e-49ce-8642-61011061cb10 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:16.702257 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-983e64a2-d41e-49ce-8642-61011061cb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:16.767747 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 500/996] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:16 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:00:16.898399 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330e7b6-ae0b-4e0c-8e90-a2c47fc2c731 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:16.898880 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330e7b6-ae0b-4e0c-8e90-a2c47fc2c731 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:16.898880 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330e7b6-ae0b-4e0c-8e90-a2c47fc2c731 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:16.900346 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 497/997] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:00:16.905331 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6e62b-f56e-4392-91eb-ebc4c79ef766 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:16.905615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6e62b-f56e-4392-91eb-ebc4c79ef766 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:16.905885 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6e62b-f56e-4392-91eb-ebc4c79ef766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:16.924592 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-74d6e62b-f56e-4392-91eb-ebc4c79ef766 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:16.925785 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-74d6e62b-f56e-4392-91eb-ebc4c79ef766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:16.991572 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 501/998] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:16 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:00:17.036138 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330e7b6-ae0b-4e0c-8e90-a2c47fc2c731 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:17.142642 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330e7b6-ae0b-4e0c-8e90-a2c47fc2c731 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:17.176749 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25351c5-98fd-4ca5-85e0-416c602f9d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:17.177338 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25351c5-98fd-4ca5-85e0-416c602f9d3f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:17.177665 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25351c5-98fd-4ca5-85e0-416c602f9d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:17.177935 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25351c5-98fd-4ca5-85e0-416c602f9d3f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:17.178514 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25351c5-98fd-4ca5-85e0-416c602f9d3f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:17.179939 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25351c5-98fd-4ca5-85e0-416c602f9d3f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:17.189028 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-b25351c5-98fd-4ca5-85e0-416c602f9d3f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 14:00:17.189028 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:17.189028 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 14:00:17.189028 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 14:00:17.189028 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 14:00:17.189028 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 14:00:17.189028 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 14:00:17.189028 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:17.189028 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 14:00:17.189028 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:17.189028 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 14:00:17.189028 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:17.189028 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:17.189028 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:17.189028 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:17.189028 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:17.189028 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:17.190721 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:17.190721 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:17.190721 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:17.190721 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:17.190721 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:17.190721 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:17.190721 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 14:00:17.190721 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 14:00:17.190721 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 14:00:17.190721 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 14:00:17.190721 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:17.190721 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:17.190721 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:17.190721 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:17.190721 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:17.190721 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:17.191603 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:17.191603 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:17.191603 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:17.191603 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:17.191603 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:17.191603 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:17.191603 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:17.191603 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:17.191603 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:17.191603 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:17.191603 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 14:00:17.191603 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:17.191603 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 14:00:17.191603 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:17.193481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 498/999] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Sep 13 14:00:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:17.196689 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6e62b-f56e-4392-91eb-ebc4c79ef766 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:17.255902 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:17.259959 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25351c5-98fd-4ca5-85e0-416c602f9d3f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:17.302943 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6e62b-f56e-4392-91eb-ebc4c79ef766 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:17.308480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:17.340602 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d369d71-cfce-4ad9-8f34-b4f9a290c7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:17.341232 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d369d71-cfce-4ad9-8f34-b4f9a290c7ab None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:17.341512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d369d71-cfce-4ad9-8f34-b4f9a290c7ab None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:17.341780 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d369d71-cfce-4ad9-8f34-b4f9a290c7ab None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:17.342412 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d369d71-cfce-4ad9-8f34-b4f9a290c7ab None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:17.342713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d369d71-cfce-4ad9-8f34-b4f9a290c7ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:17.344073 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d369d71-cfce-4ad9-8f34-b4f9a290c7ab None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:17.353262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 502/1000] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Sep 13 14:00:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:17.354950 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d369d71-cfce-4ad9-8f34-b4f9a290c7ab None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:17.375504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25351c5-98fd-4ca5-85e0-416c602f9d3f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:17.411356 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642c35e-ee8e-4aee-8a73-3b5ac385a732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:17.411984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642c35e-ee8e-4aee-8a73-3b5ac385a732 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:17.412258 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642c35e-ee8e-4aee-8a73-3b5ac385a732 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:17.412686 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642c35e-ee8e-4aee-8a73-3b5ac385a732 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:17.413089 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642c35e-ee8e-4aee-8a73-3b5ac385a732 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:17.414480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642c35e-ee8e-4aee-8a73-3b5ac385a732 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:17.424071 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-8642c35e-ee8e-4aee-8a73-3b5ac385a732 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 14:00:17.424071 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:17.424071 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 14:00:17.424071 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 14:00:17.424071 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 14:00:17.424071 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 14:00:17.424071 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 14:00:17.424071 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:17.424071 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 14:00:17.424071 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:17.424071 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 14:00:17.424071 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:17.424071 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:17.424071 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:17.424071 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:17.424071 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:17.424071 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:17.425624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:17.425624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:17.425624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:17.425624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:17.425624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:17.425624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:17.425624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 14:00:17.425624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 14:00:17.425624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 14:00:17.425624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 14:00:17.425624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:17.425624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:17.425624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:17.425624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:17.425624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:17.425624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:17.426445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:17.426445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:17.426445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:17.426445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:17.426445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:17.426445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:17.426445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:17.426445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:17.426445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:17.426445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:17.426445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 14:00:17.426445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:17.426445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 14:00:17.426445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:17.426445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 499/1001] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 14:00:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 14:00:17.431430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642c35e-ee8e-4aee-8a73-3b5ac385a732 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:17.468733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d369d71-cfce-4ad9-8f34-b4f9a290c7ab None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:17.493490 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:17.505326 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b16f01-5f3e-44ec-bea3-cab2efdabf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:17.505920 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b16f01-5f3e-44ec-bea3-cab2efdabf98 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:17.506192 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b16f01-5f3e-44ec-bea3-cab2efdabf98 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:17.506455 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b16f01-5f3e-44ec-bea3-cab2efdabf98 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:17.507073 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b16f01-5f3e-44ec-bea3-cab2efdabf98 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:17.507367 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b16f01-5f3e-44ec-bea3-cab2efdabf98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:17.508719 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b16f01-5f3e-44ec-bea3-cab2efdabf98 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:17.513380 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 503/1002] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Sep 13 14:00:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:17.519448 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b16f01-5f3e-44ec-bea3-cab2efdabf98 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:17.540269 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642c35e-ee8e-4aee-8a73-3b5ac385a732 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:17.542610 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:17.577703 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecef40-bcfd-47a7-b4da-c595e1cabc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:17.578461 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecef40-bcfd-47a7-b4da-c595e1cabc0d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:17.578738 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecef40-bcfd-47a7-b4da-c595e1cabc0d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:17.579032 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecef40-bcfd-47a7-b4da-c595e1cabc0d None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:17.579723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ecef40-bcfd-47a7-b4da-c595e1cabc0d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:17.580027 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ecef40-bcfd-47a7-b4da-c595e1cabc0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:17.582075 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ecef40-bcfd-47a7-b4da-c595e1cabc0d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:17.591606 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 500/1003] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Sep 13 14:00:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:17.592654 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecef40-bcfd-47a7-b4da-c595e1cabc0d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:17.626391 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b16f01-5f3e-44ec-bea3-cab2efdabf98 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:17.664383 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e459f-c401-405d-984f-912986b9acd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:17.664973 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e459f-c401-405d-984f-912986b9acd4 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:17.665282 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e459f-c401-405d-984f-912986b9acd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:17.665550 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e459f-c401-405d-984f-912986b9acd4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:17.666204 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e459f-c401-405d-984f-912986b9acd4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:17.667555 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e459f-c401-405d-984f-912986b9acd4 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:17.684072 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 504/1004] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:00:17 2022] POST /identity/v3/endpoints => generated 325 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:00:17.723012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecef40-bcfd-47a7-b4da-c595e1cabc0d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:17.772237 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e6f12-4071-4fe8-8924-8eb1a17ca8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:17.772861 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e6f12-4071-4fe8-8924-8eb1a17ca8f4 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:17.773168 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e6f12-4071-4fe8-8924-8eb1a17ca8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:17.773445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e6f12-4071-4fe8-8924-8eb1a17ca8f4 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:17.774082 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e6f12-4071-4fe8-8924-8eb1a17ca8f4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:17.774385 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e6f12-4071-4fe8-8924-8eb1a17ca8f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:17.775824 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e6f12-4071-4fe8-8924-8eb1a17ca8f4 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:17.786359 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 501/1005] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Sep 13 14:00:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:17.787989 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e459f-c401-405d-984f-912986b9acd4 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:17.842872 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:17.902040 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e459f-c401-405d-984f-912986b9acd4 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:17.936611 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097af6c-d1f7-46fd-91f3-a625289f6dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:17.937162 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097af6c-d1f7-46fd-91f3-a625289f6dda None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:17.937439 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097af6c-d1f7-46fd-91f3-a625289f6dda None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:17.937700 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097af6c-d1f7-46fd-91f3-a625289f6dda None admin] PATH_INFO: `/v3/endpoints` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:17.938398 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097af6c-d1f7-46fd-91f3-a625289f6dda None admin] RBAC: Adding query filter params (interface=public, service_id=737fee6b43284fd696e7abd688de5349, region_id=RegionOne) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:17.938697 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097af6c-d1f7-46fd-91f3-a625289f6dda None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:17.940539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097af6c-d1f7-46fd-91f3-a625289f6dda None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:17.945803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 505/1006] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Sep 13 14:00:17 2022] GET /identity/v3/endpoints?service_id=737fee6b43284fd696e7abd688de5349&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:17.951434 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e6f12-4071-4fe8-8924-8eb1a17ca8f4 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:17.988069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:18.064186 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e6f12-4071-4fe8-8924-8eb1a17ca8f4 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:18.098989 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859119e-a196-486d-92e8-73f36de19099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:18.099592 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859119e-a196-486d-92e8-73f36de19099 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:18.099867 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859119e-a196-486d-92e8-73f36de19099 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:18.100134 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859119e-a196-486d-92e8-73f36de19099 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:18.100732 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859119e-a196-486d-92e8-73f36de19099 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:18.102118 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859119e-a196-486d-92e8-73f36de19099 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:18.117202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 502/1007] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Sep 13 14:00:17 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:00:18.366526 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c242d4-5937-4f33-9fc5-9b69b36955c1 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:18.366948 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c242d4-5937-4f33-9fc5-9b69b36955c1 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:18.367127 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c242d4-5937-4f33-9fc5-9b69b36955c1 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:18.368576 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 506/1008] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:00:18.373621 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2ec81-3412-4224-9364-38794062b114 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:18.373910 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2ec81-3412-4224-9364-38794062b114 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:18.374189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2ec81-3412-4224-9364-38794062b114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:18.393139 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-04b2ec81-3412-4224-9364-38794062b114 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:18.394333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-04b2ec81-3412-4224-9364-38794062b114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:18.462808 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 503/1009] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:18 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:00:18.736281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c242d4-5937-4f33-9fc5-9b69b36955c1 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:18.838469 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c242d4-5937-4f33-9fc5-9b69b36955c1 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:18.851540 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:18.874267 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef3c00-8009-463f-b4a0-2aef0f9bb4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:18.874790 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef3c00-8009-463f-b4a0-2aef0f9bb4d4 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:18.875064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef3c00-8009-463f-b4a0-2aef0f9bb4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:18.875334 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef3c00-8009-463f-b4a0-2aef0f9bb4d4 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:18.875989 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef3c00-8009-463f-b4a0-2aef0f9bb4d4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:18.878025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef3c00-8009-463f-b4a0-2aef0f9bb4d4 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:18.897325 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 507/1010] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Sep 13 14:00:18 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:00:19.896755 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabde78-35ad-48f3-954f-05c7173a70fb None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:19.897279 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabde78-35ad-48f3-954f-05c7173a70fb None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:19.897279 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabde78-35ad-48f3-954f-05c7173a70fb None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:19.898624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 504/1011] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:00:19.903786 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d74bfb-45ae-408d-99b6-42dfc88a9de3 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:19.904169 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d74bfb-45ae-408d-99b6-42dfc88a9de3 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:19.904361 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d74bfb-45ae-408d-99b6-42dfc88a9de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:19.923055 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-86d74bfb-45ae-408d-99b6-42dfc88a9de3 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:19.924270 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-86d74bfb-45ae-408d-99b6-42dfc88a9de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:19.997793 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 508/1012] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:19 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:00:20.265016 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabde78-35ad-48f3-954f-05c7173a70fb None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:20.290740 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:20.321915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7eb264-6e68-4981-a863-7e2393dc289f None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:20.322238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7eb264-6e68-4981-a863-7e2393dc289f None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:20.322466 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7eb264-6e68-4981-a863-7e2393dc289f None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:20.323947 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 509/1013] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 14:00:20.328631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1bd89-badb-484a-9b94-57b54cdc4163 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:20.328913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1bd89-badb-484a-9b94-57b54cdc4163 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:20.329214 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1bd89-badb-484a-9b94-57b54cdc4163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:20.346870 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-5cc1bd89-badb-484a-9b94-57b54cdc4163 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:20.348049 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5cc1bd89-badb-484a-9b94-57b54cdc4163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:20.374533 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabde78-35ad-48f3-954f-05c7173a70fb None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:20.409577 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d65f13-fe55-4ba5-97fd-24199cf7a71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:20.410454 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d65f13-fe55-4ba5-97fd-24199cf7a71f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:20.411143 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d65f13-fe55-4ba5-97fd-24199cf7a71f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:20.411426 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d65f13-fe55-4ba5-97fd-24199cf7a71f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:20.412693 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d65f13-fe55-4ba5-97fd-24199cf7a71f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:20.414281 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d65f13-fe55-4ba5-97fd-24199cf7a71f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:20.415854 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 505/1014] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:00:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:20.420580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 510/1015] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:20 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 14:00:20.422420 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d65f13-fe55-4ba5-97fd-24199cf7a71f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:20.514525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:20.525126 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d65f13-fe55-4ba5-97fd-24199cf7a71f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:20.559454 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e5a01-0128-4800-8444-118a06b27eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:20.560053 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e5a01-0128-4800-8444-118a06b27eb3 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:20.560330 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e5a01-0128-4800-8444-118a06b27eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:20.560606 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e5a01-0128-4800-8444-118a06b27eb3 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:20.561276 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e5a01-0128-4800-8444-118a06b27eb3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:20.562693 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e5a01-0128-4800-8444-118a06b27eb3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:20.594496 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 506/1016] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Sep 13 14:00:20 2022] POST /identity/v3/projects => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:00:20.688092 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1bd89-badb-484a-9b94-57b54cdc4163 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:20.717511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:20.796158 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1bd89-badb-484a-9b94-57b54cdc4163 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:20.831514 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e196e-591d-4506-8bc1-b21da17f11df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:20.832133 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e196e-591d-4506-8bc1-b21da17f11df None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:20.832405 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e196e-591d-4506-8bc1-b21da17f11df None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:20.832666 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e196e-591d-4506-8bc1-b21da17f11df None admin] PATH_INFO: `/v3/services/compute` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:20.833271 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e196e-591d-4506-8bc1-b21da17f11df None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:20.834620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e196e-591d-4506-8bc1-b21da17f11df None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:20.843247 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-9a8e196e-591d-4506-8bc1-b21da17f11df None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 14:00:20.843247 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:20.843247 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 14:00:20.843247 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 14:00:20.843247 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 14:00:20.843247 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 14:00:20.843247 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 14:00:20.843247 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:20.843247 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 14:00:20.843247 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:20.843247 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 14:00:20.843247 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:20.843247 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:20.843247 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:20.843247 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:20.843247 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:20.843247 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:20.844385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:20.844385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:20.844385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:20.844385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:20.844385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:20.844385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:20.844385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 14:00:20.844385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 14:00:20.844385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 14:00:20.844385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 14:00:20.844385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:20.844385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:20.844385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:20.844385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:20.844385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:20.844385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:20.845459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:20.845459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:20.845459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:20.845459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:20.845459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:20.845459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:20.845459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:20.845459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:20.845459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:20.845459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:20.845459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 14:00:20.845459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:20.845459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 14:00:20.845459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:20.845459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 511/1017] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 14:00:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:20.852251 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e5a01-0128-4800-8444-118a06b27eb3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:20.954245 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e5a01-0128-4800-8444-118a06b27eb3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:20.992777 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e22978-32cc-4ef4-856f-62797d7eaf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:20.993420 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e22978-32cc-4ef4-856f-62797d7eaf53 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:20.993697 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e22978-32cc-4ef4-856f-62797d7eaf53 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:20.993968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e22978-32cc-4ef4-856f-62797d7eaf53 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:20.994602 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e22978-32cc-4ef4-856f-62797d7eaf53 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:20.994904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e22978-32cc-4ef4-856f-62797d7eaf53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:20.996273 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e22978-32cc-4ef4-856f-62797d7eaf53 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:21.006669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 507/1018] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Sep 13 14:00:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:21.007565 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e196e-591d-4506-8bc1-b21da17f11df None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:21.078534 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb9d06-ba0d-4efc-b37b-4e55accced7c None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:21.078723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb9d06-ba0d-4efc-b37b-4e55accced7c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:21.079008 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb9d06-ba0d-4efc-b37b-4e55accced7c None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:21.080429 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 508/1019] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 14:00:21.085941 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faca876-545d-4766-b048-fd4d218bab8d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:21.086228 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faca876-545d-4766-b048-fd4d218bab8d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:21.086502 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faca876-545d-4766-b048-fd4d218bab8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:21.100037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:21.103774 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:21.106031 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-9faca876-545d-4766-b048-fd4d218bab8d None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:21.107476 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9faca876-545d-4766-b048-fd4d218bab8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:21.114867 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e196e-591d-4506-8bc1-b21da17f11df None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:21.151032 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5b557-9088-4964-a691-916088dea60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:21.151615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5b557-9088-4964-a691-916088dea60e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:21.151891 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5b557-9088-4964-a691-916088dea60e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:21.152158 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5b557-9088-4964-a691-916088dea60e None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:21.152785 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5b557-9088-4964-a691-916088dea60e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:21.153084 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5b557-9088-4964-a691-916088dea60e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:21.154473 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5b557-9088-4964-a691-916088dea60e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:21.160536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 512/1020] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Sep 13 14:00:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:21.166465 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5b557-9088-4964-a691-916088dea60e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:21.181131 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 509/1021] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:21 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 14:00:21.273759 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5b557-9088-4964-a691-916088dea60e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:21.308581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d13f4-6c10-4f54-8ac6-24a920e91f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:21.309235 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d13f4-6c10-4f54-8ac6-24a920e91f1c None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:21.309511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d13f4-6c10-4f54-8ac6-24a920e91f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:21.309777 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d13f4-6c10-4f54-8ac6-24a920e91f1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:21.310428 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d13f4-6c10-4f54-8ac6-24a920e91f1c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:21.311811 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d13f4-6c10-4f54-8ac6-24a920e91f1c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:21.337210 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 513/1022] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:00:21 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:00:21.444837 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faca876-545d-4766-b048-fd4d218bab8d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:21.557394 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faca876-545d-4766-b048-fd4d218bab8d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:21.594788 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:21.601182 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fdb5c-4c77-4210-be44-575e58388035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:21.602073 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fdb5c-4c77-4210-be44-575e58388035 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:21.602357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fdb5c-4c77-4210-be44-575e58388035 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:21.602630 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fdb5c-4c77-4210-be44-575e58388035 None admin] PATH_INFO: `/v3/services/image` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:21.604681 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2fdb5c-4c77-4210-be44-575e58388035 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:21.604681 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2fdb5c-4c77-4210-be44-575e58388035 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:21.615202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-0f2fdb5c-4c77-4210-be44-575e58388035 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 14:00:21.615202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:21.615202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 14:00:21.615202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 14:00:21.615202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 14:00:21.615202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 14:00:21.615202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 14:00:21.615202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:21.615202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 14:00:21.615202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:21.615202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 14:00:21.615202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:21.615202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:21.615202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:21.615202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:21.615202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:21.615202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:21.616203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:21.616203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:21.616203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:21.616203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:21.616203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:21.616203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:21.616203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 14:00:21.616203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 14:00:21.616203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 14:00:21.616203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 14:00:21.616203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:21.616203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:21.616203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:21.616203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:21.616203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:21.616203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:21.617037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:21.617037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:21.617037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:21.617037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:21.617037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:21.617037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:21.617037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:21.617037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:21.617037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:21.617037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:21.617037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 14:00:21.617037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:21.617037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 14:00:21.617037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:21.617037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 510/1023] 10.222.0.26 () {56 vars in 1105 bytes} [Tue Sep 13 14:00:21 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:21.623051 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d13f4-6c10-4f54-8ac6-24a920e91f1c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:21.641249 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:21.733209 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d13f4-6c10-4f54-8ac6-24a920e91f1c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:21.766420 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75c9f5-7b96-49a8-94a0-d90206837bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:21.767015 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75c9f5-7b96-49a8-94a0-d90206837bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:21.767294 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75c9f5-7b96-49a8-94a0-d90206837bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:21.767562 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75c9f5-7b96-49a8-94a0-d90206837bd2 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:21.768744 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75c9f5-7b96-49a8-94a0-d90206837bd2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:21.769036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75c9f5-7b96-49a8-94a0-d90206837bd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:21.770432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75c9f5-7b96-49a8-94a0-d90206837bd2 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:21.775900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 514/1024] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:00:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:21.781432 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fdb5c-4c77-4210-be44-575e58388035 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:21.885335 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fdb5c-4c77-4210-be44-575e58388035 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:21.919915 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ec160-f02c-413c-86c4-900fbe0fa859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:21.920517 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ec160-f02c-413c-86c4-900fbe0fa859 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:21.920794 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ec160-f02c-413c-86c4-900fbe0fa859 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:21.921062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ec160-f02c-413c-86c4-900fbe0fa859 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:21.921713 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ec160-f02c-413c-86c4-900fbe0fa859 None admin] RBAC: Adding query filter params (type=image) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:21.922011 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ec160-f02c-413c-86c4-900fbe0fa859 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:21.923376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ec160-f02c-413c-86c4-900fbe0fa859 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:21.935386 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 511/1025] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:00:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:21.936654 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75c9f5-7b96-49a8-94a0-d90206837bd2 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:22.015629 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:22.039419 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75c9f5-7b96-49a8-94a0-d90206837bd2 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:22.072898 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc0f78-8fd5-4057-86a3-c9df4ae4a0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:22.073512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc0f78-8fd5-4057-86a3-c9df4ae4a0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:22.073784 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc0f78-8fd5-4057-86a3-c9df4ae4a0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:22.074050 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc0f78-8fd5-4057-86a3-c9df4ae4a0a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:22.074734 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc0f78-8fd5-4057-86a3-c9df4ae4a0a4 None admin] RBAC: Adding query filter params (interface=public, service_id=a72d98814d034474a6bdde57427b7a95, region_id=RegionOne) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:22.075034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc0f78-8fd5-4057-86a3-c9df4ae4a0a4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:22.076378 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc0f78-8fd5-4057-86a3-c9df4ae4a0a4 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:22.082163 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 515/1026] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Sep 13 14:00:21 2022] GET /identity/v3/endpoints?service_id=a72d98814d034474a6bdde57427b7a95&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:22.087597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ec160-f02c-413c-86c4-900fbe0fa859 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:22.146980 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:22.191152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ec160-f02c-413c-86c4-900fbe0fa859 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:22.225326 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cbaee-e5e5-478f-ab3c-2e0b29b6ce89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:22.225924 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cbaee-e5e5-478f-ab3c-2e0b29b6ce89 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:22.226199 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cbaee-e5e5-478f-ab3c-2e0b29b6ce89 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:22.226463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cbaee-e5e5-478f-ab3c-2e0b29b6ce89 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:22.227055 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cbaee-e5e5-478f-ab3c-2e0b29b6ce89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:22.228408 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cbaee-e5e5-478f-ab3c-2e0b29b6ce89 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:22.241181 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 512/1027] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Sep 13 14:00:22 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:00:22.834008 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b24398-1833-454d-8ca6-0696a6a83a02 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:22.834389 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b24398-1833-454d-8ca6-0696a6a83a02 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:22.834584 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b24398-1833-454d-8ca6-0696a6a83a02 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:22.836053 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 516/1028] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:00:22.841066 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be96f8-b480-44b3-871d-87b1b6f1b1a4 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:22.841461 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be96f8-b480-44b3-871d-87b1b6f1b1a4 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:22.841806 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be96f8-b480-44b3-871d-87b1b6f1b1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:22.860443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e4be96f8-b480-44b3-871d-87b1b6f1b1a4 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:22.861704 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e4be96f8-b480-44b3-871d-87b1b6f1b1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:22.928722 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 513/1029] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:00:23.194350 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b24398-1833-454d-8ca6-0696a6a83a02 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:23.299801 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b24398-1833-454d-8ca6-0696a6a83a02 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:23.333329 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3b920-1640-4746-a2e7-a6c0065f8dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:23.333970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3b920-1640-4746-a2e7-a6c0065f8dec None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:23.334221 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3b920-1640-4746-a2e7-a6c0065f8dec None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:23.334490 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3b920-1640-4746-a2e7-a6c0065f8dec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:23.335603 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3b920-1640-4746-a2e7-a6c0065f8dec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:23.337031 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3b920-1640-4746-a2e7-a6c0065f8dec None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:23.338803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 517/1030] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:00:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:23.344223 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be96f8-b480-44b3-871d-87b1b6f1b1a4 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:23.404242 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:23.451328 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be96f8-b480-44b3-871d-87b1b6f1b1a4 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:23.490461 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98edbb-f8b1-4d25-b42a-149dd93ad06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:23.491101 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98edbb-f8b1-4d25-b42a-149dd93ad06d None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:23.491382 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98edbb-f8b1-4d25-b42a-149dd93ad06d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:23.491651 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98edbb-f8b1-4d25-b42a-149dd93ad06d None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:23.492375 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98edbb-f8b1-4d25-b42a-149dd93ad06d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:23.493892 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98edbb-f8b1-4d25-b42a-149dd93ad06d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:23.520846 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 514/1031] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 13 14:00:23 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:00:23.598083 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35352bd5-66dd-4f38-a640-237e44a078e4 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:23.598358 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35352bd5-66dd-4f38-a640-237e44a078e4 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:23.598799 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35352bd5-66dd-4f38-a640-237e44a078e4 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:23.600166 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 518/1032] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 14:00:23.606072 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a68dab-1aff-43aa-b64d-11fb48f565d2 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:23.606361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a68dab-1aff-43aa-b64d-11fb48f565d2 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:23.606815 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a68dab-1aff-43aa-b64d-11fb48f565d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:23.626844 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e7a68dab-1aff-43aa-b64d-11fb48f565d2 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:23.628597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e7a68dab-1aff-43aa-b64d-11fb48f565d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:23.709363 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 515/1033] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:00:23.981414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35352bd5-66dd-4f38-a640-237e44a078e4 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:23.992915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:24.097214 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35352bd5-66dd-4f38-a640-237e44a078e4 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:24.131021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe72c2-88d7-486f-9632-708ac2122351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:24.131640 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe72c2-88d7-486f-9632-708ac2122351 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:24.131914 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe72c2-88d7-486f-9632-708ac2122351 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:24.132179 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe72c2-88d7-486f-9632-708ac2122351 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:24.142784 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe72c2-88d7-486f-9632-708ac2122351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 14:00:24.147549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-28fe72c2-88d7-486f-9632-708ac2122351 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 14:00:24.147549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:24.147549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:24.147549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:24.147549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:24.147549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:24.147549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:24.147549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:24.147549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:24.147549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:24.147549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:24.147549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:24.147549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 14:00:24.147549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 14:00:24.147549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 14:00:24.147549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 14:00:24.148452 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 14:00:24.148452 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 14:00:24.148452 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 14:00:24.148452 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 14:00:24.148452 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:24.148452 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:24.148452 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:24.148452 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:24.148452 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:24.148452 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:24.148452 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:24.148452 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:24.148452 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:24.148452 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:24.148452 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:24.148452 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:24.149561 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:24.149561 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:24.149561 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:24.149561 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:24.149561 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 14:00:24.149561 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 14:00:24.149561 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 14:00:24.149561 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 14:00:24.149561 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 14:00:24.149561 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 14:00:24.149561 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 14:00:24.149561 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:24.149561 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 519/1034] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Sep 13 14:00:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:24.154571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a68dab-1aff-43aa-b64d-11fb48f565d2 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:24.196983 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:24.259491 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a68dab-1aff-43aa-b64d-11fb48f565d2 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:24.297189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5064d5-55b3-4a9a-b213-3dffa8bb4242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:24.297824 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5064d5-55b3-4a9a-b213-3dffa8bb4242 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:24.298098 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5064d5-55b3-4a9a-b213-3dffa8bb4242 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:24.298368 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5064d5-55b3-4a9a-b213-3dffa8bb4242 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:24.299596 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5064d5-55b3-4a9a-b213-3dffa8bb4242 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:24.299971 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5064d5-55b3-4a9a-b213-3dffa8bb4242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:24.301426 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5064d5-55b3-4a9a-b213-3dffa8bb4242 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:24.316749 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 516/1035] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Sep 13 14:00:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:24.318418 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe72c2-88d7-486f-9632-708ac2122351 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:24.387193 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:24.422809 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe72c2-88d7-486f-9632-708ac2122351 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:24.443489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5879c8-e396-4eb0-815a-6af5bdc5d6ef None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:24.443983 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5879c8-e396-4eb0-815a-6af5bdc5d6ef None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:24.444074 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5879c8-e396-4eb0-815a-6af5bdc5d6ef None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:24.445526 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 517/1036] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:00:24.450186 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92d9b3-20ee-4c39-8790-1dccdf9910c4 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:24.450472 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92d9b3-20ee-4c39-8790-1dccdf9910c4 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:24.450745 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92d9b3-20ee-4c39-8790-1dccdf9910c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:24.459287 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531c024-3b97-4e9f-8639-ccba0132d34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:24.459912 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531c024-3b97-4e9f-8639-ccba0132d34b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:24.460186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531c024-3b97-4e9f-8639-ccba0132d34b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:24.460452 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531c024-3b97-4e9f-8639-ccba0132d34b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:24.468583 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-9e92d9b3-20ee-4c39-8790-1dccdf9910c4 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:24.469828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9e92d9b3-20ee-4c39-8790-1dccdf9910c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:24.473044 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b531c024-3b97-4e9f-8639-ccba0132d34b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:24.474744 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b531c024-3b97-4e9f-8639-ccba0132d34b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:24.490890 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-b531c024-3b97-4e9f-8639-ccba0132d34b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:00:24.490890 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:24.490890 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:24.490890 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:24.490890 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:24.490890 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:24.490890 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:24.490890 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:24.490890 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:24.490890 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:24.490890 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:24.490890 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:24.490890 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 14:00:24.490890 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 14:00:24.490890 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 14:00:24.490890 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 14:00:24.491904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:24.491904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:24.491904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:24.491904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:24.491904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:24.491904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:24.491904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:24.491904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:24.491904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:24.491904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:24.491904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:24.491904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:24.491904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:24.491904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:24.491904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:24.491904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:24.491904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 14:00:24.497838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 14:00:24.497838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:00:24.497838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:24.497838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 520/1037] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:00:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:24.497838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531c024-3b97-4e9f-8639-ccba0132d34b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:24.544467 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 518/1038] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 14:00:24.601232 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531c024-3b97-4e9f-8639-ccba0132d34b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:24.625148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:24.639087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49f6cc-3010-47d7-b479-a9d321a225dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:24.639694 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49f6cc-3010-47d7-b479-a9d321a225dc None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:24.639973 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49f6cc-3010-47d7-b479-a9d321a225dc None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:24.640244 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49f6cc-3010-47d7-b479-a9d321a225dc None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:24.640889 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49f6cc-3010-47d7-b479-a9d321a225dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:24.641229 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49f6cc-3010-47d7-b479-a9d321a225dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:24.642597 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49f6cc-3010-47d7-b479-a9d321a225dc None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:24.655236 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 521/1039] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 14:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:24.660943 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92d9b3-20ee-4c39-8790-1dccdf9910c4 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:24.692916 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:24.764214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92d9b3-20ee-4c39-8790-1dccdf9910c4 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:24.798158 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d361d-4f11-4b9a-9dd2-b7666d48d5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:24.798715 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d361d-4f11-4b9a-9dd2-b7666d48d5a6 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:24.799528 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d361d-4f11-4b9a-9dd2-b7666d48d5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:24.799801 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d361d-4f11-4b9a-9dd2-b7666d48d5a6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:24.809849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407d361d-4f11-4b9a-9dd2-b7666d48d5a6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:24.811571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407d361d-4f11-4b9a-9dd2-b7666d48d5a6 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:24.812571 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49f6cc-3010-47d7-b479-a9d321a225dc None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:24.826248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-407d361d-4f11-4b9a-9dd2-b7666d48d5a6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 14:00:24.826248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:24.826248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:24.826248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:24.826248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:24.826248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:24.826248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:24.826248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:24.826248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:24.826248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:24.826248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:24.826248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:24.826248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 14:00:24.826248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 14:00:24.826248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 14:00:24.826248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 14:00:24.827205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:24.827205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:24.827205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 14:00:24.827205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 14:00:24.827205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 14:00:24.827205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 14:00:24.827205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:24.827205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:24.827205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:24.827205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:24.827205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:24.827205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:24.827205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:24.827205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:24.827205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:24.827205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:24.827205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:24.827205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:24.828143 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:24.828143 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:24.828143 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 14:00:24.828143 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 14:00:24.828143 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 14:00:24.828143 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 14:00:24.828143 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 14:00:24.828143 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 14:00:24.828143 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 14:00:24.828143 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:24.828143 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 519/1040] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Sep 13 14:00:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:24.833263 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d361d-4f11-4b9a-9dd2-b7666d48d5a6 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:24.917339 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49f6cc-3010-47d7-b479-a9d321a225dc None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:24.936114 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:24.946393 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d361d-4f11-4b9a-9dd2-b7666d48d5a6 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:24.953953 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd53735-127a-4756-a02b-1c6fd33d7ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:24.954571 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd53735-127a-4756-a02b-1c6fd33d7ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:24.954862 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd53735-127a-4756-a02b-1c6fd33d7ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:24.955112 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd53735-127a-4756-a02b-1c6fd33d7ce2 None admin] PATH_INFO: `/v3/services/image` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:24.955713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd53735-127a-4756-a02b-1c6fd33d7ce2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:24.957070 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd53735-127a-4756-a02b-1c6fd33d7ce2 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:24.965949 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-5bd53735-127a-4756-a02b-1c6fd33d7ce2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 14:00:24.965949 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:24.965949 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 14:00:24.965949 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 14:00:24.965949 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 14:00:24.965949 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 14:00:24.965949 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 14:00:24.965949 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:24.965949 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 14:00:24.965949 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:24.965949 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 14:00:24.965949 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:24.965949 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:24.965949 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:24.965949 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:24.965949 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:24.965949 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:24.966931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:24.966931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:24.966931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:24.966931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:24.966931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:24.966931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:24.966931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 14:00:24.966931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 14:00:24.966931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 14:00:24.966931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 14:00:24.966931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:24.966931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:24.966931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:24.966931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:24.966931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:24.966931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:24.968630 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:24.968630 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:24.968630 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:24.968630 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:24.968630 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:24.968630 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:24.968630 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:24.968630 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:24.968630 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:24.968630 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:24.968630 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 14:00:24.968630 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:00:24.968630 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 14:00:24.968630 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:24.968630 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 522/1041] 10.222.0.26 () {56 vars in 1105 bytes} [Tue Sep 13 14:00:24 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 14:00:24.972879 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd53735-127a-4756-a02b-1c6fd33d7ce2 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:24.985544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2630ff-2d5c-4912-ac06-274eff57ba6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:24.986150 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2630ff-2d5c-4912-ac06-274eff57ba6e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:24.986945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2630ff-2d5c-4912-ac06-274eff57ba6e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:24.987224 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2630ff-2d5c-4912-ac06-274eff57ba6e None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:24.987948 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2630ff-2d5c-4912-ac06-274eff57ba6e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:24.988249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2630ff-2d5c-4912-ac06-274eff57ba6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:24.989708 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2630ff-2d5c-4912-ac06-274eff57ba6e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:25.007828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 520/1042] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Sep 13 14:00:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:25.013379 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2630ff-2d5c-4912-ac06-274eff57ba6e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:25.020505 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:25.081633 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd53735-127a-4756-a02b-1c6fd33d7ce2 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:25.116456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894020b6-0512-4194-a954-56f8cce954f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:25.117051 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894020b6-0512-4194-a954-56f8cce954f9 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:25.117357 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894020b6-0512-4194-a954-56f8cce954f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:25.117480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2630ff-2d5c-4912-ac06-274eff57ba6e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:25.117646 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894020b6-0512-4194-a954-56f8cce954f9 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:25.118248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894020b6-0512-4194-a954-56f8cce954f9 None admin] RBAC: Adding query filter params (name=image) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:25.118549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894020b6-0512-4194-a954-56f8cce954f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:25.120836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894020b6-0512-4194-a954-56f8cce954f9 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:25.126448 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 523/1043] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:00:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:25.132316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894020b6-0512-4194-a954-56f8cce954f9 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:25.158143 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817cf11-c0f6-414e-95db-137cf068762f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:25.159998 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817cf11-c0f6-414e-95db-137cf068762f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:25.160520 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817cf11-c0f6-414e-95db-137cf068762f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:25.160795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817cf11-c0f6-414e-95db-137cf068762f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:25.182783 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:25.234772 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817cf11-c0f6-414e-95db-137cf068762f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:25.237075 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817cf11-c0f6-414e-95db-137cf068762f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:25.242149 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894020b6-0512-4194-a954-56f8cce954f9 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:25.250993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:25.276613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47156b-651a-41e9-be48-e15e7cbee977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:25.277242 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47156b-651a-41e9-be48-e15e7cbee977 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:25.277523 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47156b-651a-41e9-be48-e15e7cbee977 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:25.277792 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47156b-651a-41e9-be48-e15e7cbee977 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:25.278418 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47156b-651a-41e9-be48-e15e7cbee977 None admin] RBAC: Adding query filter params (type=image) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:25.278718 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47156b-651a-41e9-be48-e15e7cbee977 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:25.280077 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47156b-651a-41e9-be48-e15e7cbee977 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:25.286052 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 524/1044] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:00:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:25.291469 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47156b-651a-41e9-be48-e15e7cbee977 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:25.350017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 521/1045] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 14:00:25 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 14:00:25.355663 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817cf11-c0f6-414e-95db-137cf068762f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:25.394946 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47156b-651a-41e9-be48-e15e7cbee977 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:25.408780 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:25.431605 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb71750-dd62-4c95-97ee-7558b8ce80bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:25.432425 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb71750-dd62-4c95-97ee-7558b8ce80bb None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:25.432865 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb71750-dd62-4c95-97ee-7558b8ce80bb None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:25.433329 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb71750-dd62-4c95-97ee-7558b8ce80bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:25.434198 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb71750-dd62-4c95-97ee-7558b8ce80bb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:25.435704 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb71750-dd62-4c95-97ee-7558b8ce80bb None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:25.459840 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 525/1046] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:00:25 2022] POST /identity/v3/endpoints => generated 327 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:00:25.460921 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817cf11-c0f6-414e-95db-137cf068762f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:25.509369 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07891b8-6ecb-4ad2-a33c-4148e68a9e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:25.510019 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07891b8-6ecb-4ad2-a33c-4148e68a9e80 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:25.510300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07891b8-6ecb-4ad2-a33c-4148e68a9e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:25.510573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07891b8-6ecb-4ad2-a33c-4148e68a9e80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:25.523267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07891b8-6ecb-4ad2-a33c-4148e68a9e80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:25.524835 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07891b8-6ecb-4ad2-a33c-4148e68a9e80 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:25.542260 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-d07891b8-6ecb-4ad2-a33c-4148e68a9e80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:00:25.542260 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:25.542260 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:25.542260 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:25.542260 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:25.542260 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:25.542260 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:25.542260 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:25.542260 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:25.542260 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:25.542260 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:25.542260 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:25.542260 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 14:00:25.542260 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 14:00:25.542260 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 14:00:25.542260 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 14:00:25.543280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:25.543280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:25.543280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:25.543280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:25.543280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:25.543280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:25.543280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:25.543280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:25.543280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:25.543280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:25.543280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:25.543280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:25.543280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:25.543280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:25.543280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:25.543280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:25.543280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 14:00:25.544165 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 14:00:25.544165 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:00:25.544165 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:25.544165 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 522/1047] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:25.549778 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb71750-dd62-4c95-97ee-7558b8ce80bb None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:25.583810 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:25.671032 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb71750-dd62-4c95-97ee-7558b8ce80bb None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:25.709414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520111b0-28c6-43ce-b310-ba233ad5b02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:25.710024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520111b0-28c6-43ce-b310-ba233ad5b02e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:25.710298 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520111b0-28c6-43ce-b310-ba233ad5b02e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:25.710566 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520111b0-28c6-43ce-b310-ba233ad5b02e None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:25.711204 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520111b0-28c6-43ce-b310-ba233ad5b02e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:25.711502 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520111b0-28c6-43ce-b310-ba233ad5b02e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:25.712862 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520111b0-28c6-43ce-b310-ba233ad5b02e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:25.725183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 526/1048] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 14:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:25.730526 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07891b8-6ecb-4ad2-a33c-4148e68a9e80 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:25.785794 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5c28a-1037-4b37-ae7e-253074e81bff None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:25.786103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5c28a-1037-4b37-ae7e-253074e81bff None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:25.786346 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5c28a-1037-4b37-ae7e-253074e81bff None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:25.787702 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 527/1049] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 14:00:25.792657 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d23cf6-4f7d-4ea1-8617-1e30ff603679 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:25.792928 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d23cf6-4f7d-4ea1-8617-1e30ff603679 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:25.793224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d23cf6-4f7d-4ea1-8617-1e30ff603679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:25.811614 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e0d23cf6-4f7d-4ea1-8617-1e30ff603679 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:25.812802 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e0d23cf6-4f7d-4ea1-8617-1e30ff603679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:25.837123 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:25.842254 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07891b8-6ecb-4ad2-a33c-4148e68a9e80 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:25.880604 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97390c-ea59-4205-9d6f-6d15c57ea5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:25.881278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97390c-ea59-4205-9d6f-6d15c57ea5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:25.881564 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97390c-ea59-4205-9d6f-6d15c57ea5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:25.881833 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97390c-ea59-4205-9d6f-6d15c57ea5f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:25.882460 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 528/1050] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 14:00:25.888764 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97390c-ea59-4205-9d6f-6d15c57ea5f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:25.890245 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97390c-ea59-4205-9d6f-6d15c57ea5f6 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:25.901533 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-1e97390c-ea59-4205-9d6f-6d15c57ea5f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 14:00:25.901533 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:25.901533 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:25.901533 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:25.901533 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:25.901533 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:25.901533 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:25.901533 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:25.901533 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:25.901533 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:25.901533 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:25.901533 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:25.901533 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 14:00:25.901533 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 14:00:25.901533 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 14:00:25.902431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 14:00:25.902431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:25.902431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:25.902431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:25.902431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:25.902431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:25.902431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:25.902431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:25.902431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:25.902431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:25.902431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:25.902431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:25.902431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:25.902431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:25.902431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:25.902431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:25.902431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:25.903868 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 14:00:25.903868 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 14:00:25.903868 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 14:00:25.903868 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 14:00:25.903868 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 14:00:25.903868 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 14:00:25.903868 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 14:00:25.903868 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:25.903868 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 523/1051] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 14:00:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:25.909119 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d23cf6-4f7d-4ea1-8617-1e30ff603679 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:25.930412 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:26.012816 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d23cf6-4f7d-4ea1-8617-1e30ff603679 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:26.046896 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d8e2c-d8b2-439f-a7cf-2c64fe807b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:26.047490 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d8e2c-d8b2-439f-a7cf-2c64fe807b9d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:26.047763 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d8e2c-d8b2-439f-a7cf-2c64fe807b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:26.048028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d8e2c-d8b2-439f-a7cf-2c64fe807b9d None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:26.048713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d8e2c-d8b2-439f-a7cf-2c64fe807b9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:26.049600 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d8e2c-d8b2-439f-a7cf-2c64fe807b9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:26.051028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d8e2c-d8b2-439f-a7cf-2c64fe807b9d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:26.067082 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 529/1052] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 14:00:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:26.068346 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97390c-ea59-4205-9d6f-6d15c57ea5f6 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:26.161246 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d8e2c-d8b2-439f-a7cf-2c64fe807b9d None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:26.168111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97390c-ea59-4205-9d6f-6d15c57ea5f6 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:26.202639 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88284180-c07c-4a29-8089-dca0be2d75e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:26.203245 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88284180-c07c-4a29-8089-dca0be2d75e3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:26.203593 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88284180-c07c-4a29-8089-dca0be2d75e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:26.203793 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88284180-c07c-4a29-8089-dca0be2d75e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:26.204514 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88284180-c07c-4a29-8089-dca0be2d75e3 None admin] RBAC: Adding query filter params (role.id=a0ce4da381a2401daee681a57a4731b3, scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086, user.id=1b3533d0a24e4e7bbf5c7137d3511b13) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:26.204820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88284180-c07c-4a29-8089-dca0be2d75e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:26.206314 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88284180-c07c-4a29-8089-dca0be2d75e3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:26.217140 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 524/1053] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 14:00:26 2022] GET /identity/v3/role_assignments?user.id=1b3533d0a24e4e7bbf5c7137d3511b13&scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086&role.id=a0ce4da381a2401daee681a57a4731b3 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:26.254768 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:26.280166 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d8e2c-d8b2-439f-a7cf-2c64fe807b9d None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:26.319273 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f48e4-a8a0-453f-977c-da28d049749e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:26.320193 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f48e4-a8a0-453f-977c-da28d049749e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:26.320620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f48e4-a8a0-453f-977c-da28d049749e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:26.321057 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f48e4-a8a0-453f-977c-da28d049749e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:26.332718 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f48e4-a8a0-453f-977c-da28d049749e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 14:00:26.338660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-7c4f48e4-a8a0-453f-977c-da28d049749e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 14:00:26.338660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:26.338660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:26.338660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:26.338660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:26.338660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:26.338660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:26.338660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:26.338660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:26.338660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:26.338660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:26.338660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:26.338660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 14:00:26.338660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 14:00:26.338660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 14:00:26.338660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 14:00:26.339765 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 14:00:26.339765 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 14:00:26.339765 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 14:00:26.339765 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 14:00:26.339765 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:26.339765 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:26.339765 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:26.339765 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:26.339765 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:26.339765 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:26.339765 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:26.339765 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:26.339765 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:26.339765 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:26.339765 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:26.339765 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:26.340617 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:26.340617 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:26.340617 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:26.340617 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:26.340617 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 14:00:26.340617 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 14:00:26.340617 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 14:00:26.340617 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 14:00:26.340617 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 14:00:26.340617 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 14:00:26.340617 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 14:00:26.340617 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:26.341461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 530/1054] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 14:00:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 14:00:26.346735 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88284180-c07c-4a29-8089-dca0be2d75e3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:26.375997 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:26.458598 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88284180-c07c-4a29-8089-dca0be2d75e3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:26.492791 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a96af-5ad5-40fc-800a-3d132c869e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:26.493411 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a96af-5ad5-40fc-800a-3d132c869e9e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:26.493687 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a96af-5ad5-40fc-800a-3d132c869e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:26.493956 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a96af-5ad5-40fc-800a-3d132c869e9e None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:26.494614 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a96af-5ad5-40fc-800a-3d132c869e9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:26.494914 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a96af-5ad5-40fc-800a-3d132c869e9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:26.496276 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a96af-5ad5-40fc-800a-3d132c869e9e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:26.505782 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 525/1055] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 14:00:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:26.511460 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f48e4-a8a0-453f-977c-da28d049749e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:26.615186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f48e4-a8a0-453f-977c-da28d049749e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:26.650613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e90d5-e6f7-4795-bac5-aceb5f10ff71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:26.651642 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e90d5-e6f7-4795-bac5-aceb5f10ff71 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:26.652136 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e90d5-e6f7-4795-bac5-aceb5f10ff71 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:26.652612 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e90d5-e6f7-4795-bac5-aceb5f10ff71 None admin] PATH_INFO: `/v3/users/428441a4e75a49eba5a99d91b1e8be58` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:26.660934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:26.667961 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e90d5-e6f7-4795-bac5-aceb5f10ff71 None admin] RBAC: Authorizing `identity:get_user(user_id=428441a4e75a49eba5a99d91b1e8be58)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:26.669461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e90d5-e6f7-4795-bac5-aceb5f10ff71 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:26.676566 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 531/1056] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 14:00:26 2022] GET /identity/v3/users/428441a4e75a49eba5a99d91b1e8be58 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:26.677917 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a96af-5ad5-40fc-800a-3d132c869e9e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:26.765340 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:26.782310 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a96af-5ad5-40fc-800a-3d132c869e9e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:26.818001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b8daa-42b6-4358-ae13-9ca90537fd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:26.818597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b8daa-42b6-4358-ae13-9ca90537fd44 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:26.818868 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b8daa-42b6-4358-ae13-9ca90537fd44 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:26.819134 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b8daa-42b6-4358-ae13-9ca90537fd44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:26.887628 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b8daa-42b6-4358-ae13-9ca90537fd44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:26.889069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b8daa-42b6-4358-ae13-9ca90537fd44 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:26.972414 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:26.990356 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 526/1057] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 14:00:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 14:00:26.995957 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e90d5-e6f7-4795-bac5-aceb5f10ff71 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:27.095356 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e90d5-e6f7-4795-bac5-aceb5f10ff71 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:27.130340 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457277bf-7dd5-4f2d-b8ad-bd51e1a55b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:27.130985 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457277bf-7dd5-4f2d-b8ad-bd51e1a55b04 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:27.131276 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457277bf-7dd5-4f2d-b8ad-bd51e1a55b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:27.131521 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457277bf-7dd5-4f2d-b8ad-bd51e1a55b04 None admin] PATH_INFO: `/v3/projects/f10c7b183b5c4a5aaeebc30fbf73e9b2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:27.132728 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457277bf-7dd5-4f2d-b8ad-bd51e1a55b04 None admin] RBAC: Authorizing `identity:get_project(project_id=f10c7b183b5c4a5aaeebc30fbf73e9b2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:27.134206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457277bf-7dd5-4f2d-b8ad-bd51e1a55b04 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:27.136081 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 532/1058] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 14:00:26 2022] GET /identity/v3/projects/f10c7b183b5c4a5aaeebc30fbf73e9b2 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:27.141921 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b8daa-42b6-4358-ae13-9ca90537fd44 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:27.240005 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b8daa-42b6-4358-ae13-9ca90537fd44 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:27.273330 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5e129-f553-46d6-9730-d59fcd03ced0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:27.273923 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5e129-f553-46d6-9730-d59fcd03ced0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:27.274195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5e129-f553-46d6-9730-d59fcd03ced0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:27.274459 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5e129-f553-46d6-9730-d59fcd03ced0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:27.275165 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5e129-f553-46d6-9730-d59fcd03ced0 None admin] RBAC: Adding query filter params (role.id=6dcc8495d2b24b3eab63dd656eb4eb6d, scope.project.id=f10c7b183b5c4a5aaeebc30fbf73e9b2, user.id=428441a4e75a49eba5a99d91b1e8be58) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:27.275468 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5e129-f553-46d6-9730-d59fcd03ced0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:27.276882 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5e129-f553-46d6-9730-d59fcd03ced0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:27.282658 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 527/1059] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 14:00:27 2022] GET /identity/v3/role_assignments?user.id=428441a4e75a49eba5a99d91b1e8be58&scope.project.id=f10c7b183b5c4a5aaeebc30fbf73e9b2&role.id=6dcc8495d2b24b3eab63dd656eb4eb6d => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:27.672203 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc633f1-fa7c-4ce8-90b0-196214c627a3 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:27.672705 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc633f1-fa7c-4ce8-90b0-196214c627a3 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:27.672807 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc633f1-fa7c-4ce8-90b0-196214c627a3 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:27.674869 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 533/1060] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:00:27.679838 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9362991-c070-4136-b640-6efb88c7076a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:27.680215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9362991-c070-4136-b640-6efb88c7076a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:27.680390 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9362991-c070-4136-b640-6efb88c7076a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:27.698258 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b9362991-c070-4136-b640-6efb88c7076a None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:27.699434 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b9362991-c070-4136-b640-6efb88c7076a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:27.743593 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:27.768218 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 528/1061] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:00:28.037204 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc633f1-fa7c-4ce8-90b0-196214c627a3 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:28.100631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:28.142703 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc633f1-fa7c-4ce8-90b0-196214c627a3 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:28.177193 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74989b63-3a62-4e05-92de-5a54d26bc19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:28.177792 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74989b63-3a62-4e05-92de-5a54d26bc19b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:28.178073 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74989b63-3a62-4e05-92de-5a54d26bc19b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:28.178343 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74989b63-3a62-4e05-92de-5a54d26bc19b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:28.244024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74989b63-3a62-4e05-92de-5a54d26bc19b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:28.245490 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74989b63-3a62-4e05-92de-5a54d26bc19b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:28.305882 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:28.347637 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 534/1062] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 14:00:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 14:00:28.353487 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9362991-c070-4136-b640-6efb88c7076a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:28.454662 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9362991-c070-4136-b640-6efb88c7076a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:28.466273 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e49368-ebb3-49d0-bf13-e7cf55b98178 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:28.466557 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e49368-ebb3-49d0-bf13-e7cf55b98178 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:28.466824 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e49368-ebb3-49d0-bf13-e7cf55b98178 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:28.468320 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 535/1063] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 14:00:28.473993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292e835-319d-47a0-bc1a-d690afb88f3c None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:28.474273 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292e835-319d-47a0-bc1a-d690afb88f3c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:28.474546 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292e835-319d-47a0-bc1a-d690afb88f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:28.493144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b85019-fbf5-49b6-929d-eeb88f012148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:28.493774 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b85019-fbf5-49b6-929d-eeb88f012148 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:28.494051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b85019-fbf5-49b6-929d-eeb88f012148 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:28.494320 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b85019-fbf5-49b6-929d-eeb88f012148 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:28.494431 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e292e835-319d-47a0-bc1a-d690afb88f3c None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:28.495561 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e292e835-319d-47a0-bc1a-d690afb88f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:28.504489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b85019-fbf5-49b6-929d-eeb88f012148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:28.505968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b85019-fbf5-49b6-929d-eeb88f012148 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:28.521209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-54b85019-fbf5-49b6-929d-eeb88f012148 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:00:28.521209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:28.521209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:28.521209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:28.521209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:28.521209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:28.521209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:28.521209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:28.521209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:28.521209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:28.521209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:28.521209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:28.521209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 14:00:28.521209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 14:00:28.521209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 14:00:28.521209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 14:00:28.522159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:28.522159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:28.522159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:28.522159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:28.522159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:28.522159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:28.522159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:28.522159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:28.522159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:28.522159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:28.522159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:28.522159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:28.522159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:28.522159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:28.522159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:28.522159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:28.522159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 14:00:28.523085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 14:00:28.523085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:00:28.523085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:28.523085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 529/1064] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:28.528135 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b85019-fbf5-49b6-929d-eeb88f012148 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:28.562412 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:28.570331 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 536/1065] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 14:00:28.644208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b85019-fbf5-49b6-929d-eeb88f012148 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:28.679156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30291c89-6b36-4b37-830d-622ddc186edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:28.679956 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30291c89-6b36-4b37-830d-622ddc186edc None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:28.680860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30291c89-6b36-4b37-830d-622ddc186edc None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:28.681355 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30291c89-6b36-4b37-830d-622ddc186edc None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:28.682153 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30291c89-6b36-4b37-830d-622ddc186edc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:28.682605 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30291c89-6b36-4b37-830d-622ddc186edc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:28.684120 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30291c89-6b36-4b37-830d-622ddc186edc None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:28.697112 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 530/1066] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 14:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:28.841864 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292e835-319d-47a0-bc1a-d690afb88f3c None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:28.943680 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:28.950389 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292e835-319d-47a0-bc1a-d690afb88f3c None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:28.987624 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9674c-aa71-47e7-bc0a-a591be7282d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:28.988258 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9674c-aa71-47e7-bc0a-a591be7282d2 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:28.988534 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9674c-aa71-47e7-bc0a-a591be7282d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:28.988799 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9674c-aa71-47e7-bc0a-a591be7282d2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:28.999235 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9674c-aa71-47e7-bc0a-a591be7282d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 14:00:29.004148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-53e9674c-aa71-47e7-bc0a-a591be7282d2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 14:00:29.004148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:29.004148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:29.004148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:29.004148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:29.004148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:29.004148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:29.004148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:29.004148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:29.004148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:29.004148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:29.004148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:29.004148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 14:00:29.004148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 14:00:29.004148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 14:00:29.004148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 14:00:29.005304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 14:00:29.005304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 14:00:29.005304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 14:00:29.005304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 14:00:29.005304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:29.005304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:29.005304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:29.005304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:29.005304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:29.005304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:29.005304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:29.005304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:29.005304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:29.005304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:29.005304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:29.005304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:29.006414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:29.006414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:29.006414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:29.006414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:29.006414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 14:00:29.006414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 14:00:29.006414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 14:00:29.006414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 14:00:29.006414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 14:00:29.006414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 14:00:29.006414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 14:00:29.006414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:29.006414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 537/1067] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Sep 13 14:00:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:29.012522 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30291c89-6b36-4b37-830d-622ddc186edc None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:29.104466 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:29.115169 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30291c89-6b36-4b37-830d-622ddc186edc None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:29.149794 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fb3ab-abc9-4e55-b9bb-97f383f77bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:29.150394 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fb3ab-abc9-4e55-b9bb-97f383f77bcd None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:29.150669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fb3ab-abc9-4e55-b9bb-97f383f77bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:29.150937 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fb3ab-abc9-4e55-b9bb-97f383f77bcd None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:29.151593 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485fb3ab-abc9-4e55-b9bb-97f383f77bcd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:29.151892 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485fb3ab-abc9-4e55-b9bb-97f383f77bcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:29.153293 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485fb3ab-abc9-4e55-b9bb-97f383f77bcd None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:29.161893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 531/1068] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Sep 13 14:00:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:29.167568 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9674c-aa71-47e7-bc0a-a591be7282d2 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:29.263826 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9674c-aa71-47e7-bc0a-a591be7282d2 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:29.298395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c4003-85ff-444f-84be-8029303a2ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:29.299070 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c4003-85ff-444f-84be-8029303a2ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:29.299344 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c4003-85ff-444f-84be-8029303a2ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:29.299611 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c4003-85ff-444f-84be-8029303a2ba8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:29.311149 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c4003-85ff-444f-84be-8029303a2ba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:29.312629 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c4003-85ff-444f-84be-8029303a2ba8 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:29.328620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-4c5c4003-85ff-444f-84be-8029303a2ba8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:00:29.328620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:29.328620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:29.328620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:29.328620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:29.328620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:29.328620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:29.328620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:29.328620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:29.328620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:29.328620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:29.328620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:29.328620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 14:00:29.328620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 14:00:29.328620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 14:00:29.328620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 14:00:29.329716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:29.329716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:29.329716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:29.329716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:29.329716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:29.329716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:29.329716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:29.329716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:29.329716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:29.329716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:29.329716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:29.329716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:29.329716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:29.329716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:29.329716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:29.329716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:29.329716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 14:00:29.331107 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 14:00:29.331107 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:00:29.331107 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:29.331107 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 538/1069] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 14:00:29.336047 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fb3ab-abc9-4e55-b9bb-97f383f77bcd None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:29.413823 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8377a-0ed9-4bb4-a845-5ad8fded222e None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:29.414022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8377a-0ed9-4bb4-a845-5ad8fded222e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:29.414278 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8377a-0ed9-4bb4-a845-5ad8fded222e None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:29.415670 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 539/1070] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 14:00:29.420795 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07c24a-8c44-4db7-8515-de279b23e1a3 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:29.421070 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07c24a-8c44-4db7-8515-de279b23e1a3 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:29.421418 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07c24a-8c44-4db7-8515-de279b23e1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:29.434395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:29.440585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fb3ab-abc9-4e55-b9bb-97f383f77bcd None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:29.440825 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-ec07c24a-8c44-4db7-8515-de279b23e1a3 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:29.442048 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ec07c24a-8c44-4db7-8515-de279b23e1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:29.473777 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edebbae-85a9-4469-be23-6e6302e5ba51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:29.474382 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edebbae-85a9-4469-be23-6e6302e5ba51 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:29.474664 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edebbae-85a9-4469-be23-6e6302e5ba51 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:29.474931 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edebbae-85a9-4469-be23-6e6302e5ba51 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:29.475564 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edebbae-85a9-4469-be23-6e6302e5ba51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:29.475863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edebbae-85a9-4469-be23-6e6302e5ba51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:29.477246 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edebbae-85a9-4469-be23-6e6302e5ba51 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:29.489764 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 532/1071] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 14:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:29.495976 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edebbae-85a9-4469-be23-6e6302e5ba51 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:29.509460 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 540/1072] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 14:00:29.511701 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:29.596451 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edebbae-85a9-4469-be23-6e6302e5ba51 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:29.630160 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84d1e9-bbf6-4a03-ba2d-606ff3460139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:29.630785 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84d1e9-bbf6-4a03-ba2d-606ff3460139 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:29.631060 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84d1e9-bbf6-4a03-ba2d-606ff3460139 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:29.631327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84d1e9-bbf6-4a03-ba2d-606ff3460139 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:29.638171 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84d1e9-bbf6-4a03-ba2d-606ff3460139 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:29.639610 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84d1e9-bbf6-4a03-ba2d-606ff3460139 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:29.650957 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-2d84d1e9-bbf6-4a03-ba2d-606ff3460139 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 14:00:29.650957 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:29.650957 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:29.650957 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:29.650957 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:29.650957 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:29.650957 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:29.650957 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:29.650957 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:29.650957 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:29.650957 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:29.650957 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:29.650957 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 14:00:29.650957 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 14:00:29.650957 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 14:00:29.650957 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 14:00:29.656669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:29.656669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:29.656669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 14:00:29.656669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 14:00:29.656669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 14:00:29.656669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 14:00:29.656669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:29.656669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:29.656669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:29.656669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:29.656669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:29.656669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:29.656669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:29.656669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:29.656669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:29.656669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:29.656669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:29.656669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:29.658699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:29.658699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:29.658699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 14:00:29.658699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 14:00:29.658699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 14:00:29.658699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 14:00:29.658699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 14:00:29.658699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 14:00:29.658699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 14:00:29.658699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:29.658699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 533/1073] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Sep 13 14:00:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:29.659463 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07c24a-8c44-4db7-8515-de279b23e1a3 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:29.754211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07c24a-8c44-4db7-8515-de279b23e1a3 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:29.779749 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84d1e9-bbf6-4a03-ba2d-606ff3460139 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:29.788747 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886260b4-8ded-4306-bc42-8aa278856c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:29.789377 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886260b4-8ded-4306-bc42-8aa278856c9c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:29.789659 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886260b4-8ded-4306-bc42-8aa278856c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:29.789931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886260b4-8ded-4306-bc42-8aa278856c9c None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:29.790660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886260b4-8ded-4306-bc42-8aa278856c9c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:29.790963 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886260b4-8ded-4306-bc42-8aa278856c9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:29.792393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886260b4-8ded-4306-bc42-8aa278856c9c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:29.795746 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:29.812410 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 541/1074] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Sep 13 14:00:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:29.822310 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886260b4-8ded-4306-bc42-8aa278856c9c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:29.854682 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:29.885455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84d1e9-bbf6-4a03-ba2d-606ff3460139 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:29.918722 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd408be7-88d1-45e3-a435-c444f6b7049e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:29.919339 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd408be7-88d1-45e3-a435-c444f6b7049e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:29.919616 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd408be7-88d1-45e3-a435-c444f6b7049e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:29.919885 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd408be7-88d1-45e3-a435-c444f6b7049e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:29.923682 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886260b4-8ded-4306-bc42-8aa278856c9c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:29.930328 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd408be7-88d1-45e3-a435-c444f6b7049e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 14:00:29.935093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-dd408be7-88d1-45e3-a435-c444f6b7049e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 14:00:29.935093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:29.935093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:29.935093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:29.935093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:29.935093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:29.935093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:29.935093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:29.935093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:29.935093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:29.935093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:29.935093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:29.935093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 14:00:29.935093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 14:00:29.935093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 14:00:29.935093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 14:00:29.936092 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 14:00:29.936092 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 14:00:29.936092 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 14:00:29.936092 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 14:00:29.936092 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:29.936092 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:29.936092 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:29.936092 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:29.936092 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:29.936092 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:29.936092 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:29.936092 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:29.936092 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:29.936092 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:29.936092 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:29.936092 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:29.936945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:29.936945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:29.936945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:29.936945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:29.936945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 14:00:29.936945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 14:00:29.936945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 14:00:29.936945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 14:00:29.936945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 14:00:29.936945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 14:00:29.936945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 14:00:29.936945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:29.936945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 534/1075] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 14:00:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 14:00:29.942640 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd408be7-88d1-45e3-a435-c444f6b7049e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:29.961917 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24494dd-0b3e-4d2e-9770-eeb38c8e4bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:29.962539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24494dd-0b3e-4d2e-9770-eeb38c8e4bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:29.962814 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24494dd-0b3e-4d2e-9770-eeb38c8e4bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:29.963079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24494dd-0b3e-4d2e-9770-eeb38c8e4bb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:29.973851 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24494dd-0b3e-4d2e-9770-eeb38c8e4bb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:29.975277 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24494dd-0b3e-4d2e-9770-eeb38c8e4bb4 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:29.990474 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-c24494dd-0b3e-4d2e-9770-eeb38c8e4bb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:00:29.990474 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:29.990474 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:29.990474 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:29.990474 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:29.990474 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:29.990474 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:29.990474 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:29.990474 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:29.990474 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:29.990474 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:29.990474 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:29.990474 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 14:00:29.990474 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 14:00:29.990474 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 14:00:29.990474 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 14:00:29.991439 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:29.991439 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:29.991439 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:29.991439 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:29.991439 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:29.991439 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:29.991439 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:29.991439 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:29.991439 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:29.991439 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:29.991439 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:29.991439 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:29.991439 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:29.991439 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:29.991439 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:29.991439 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:29.991439 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 14:00:29.992327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 14:00:29.992327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:00:29.992327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:29.992327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 542/1076] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:29.997384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24494dd-0b3e-4d2e-9770-eeb38c8e4bb4 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:30.042381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:30.045780 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd408be7-88d1-45e3-a435-c444f6b7049e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:30.075370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:30.080919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e9763-a442-4724-9234-fc09a4b03856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:30.081550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e9763-a442-4724-9234-fc09a4b03856 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:30.081823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e9763-a442-4724-9234-fc09a4b03856 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:30.082087 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e9763-a442-4724-9234-fc09a4b03856 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:30.082740 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e9763-a442-4724-9234-fc09a4b03856 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:30.083034 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e9763-a442-4724-9234-fc09a4b03856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:30.084386 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e9763-a442-4724-9234-fc09a4b03856 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:30.093661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 535/1077] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 14:00:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:30.096952 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24494dd-0b3e-4d2e-9770-eeb38c8e4bb4 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:30.099350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e9763-a442-4724-9234-fc09a4b03856 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:30.131291 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9181d7a-4500-4eeb-b703-f1395593cfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:30.131880 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9181d7a-4500-4eeb-b703-f1395593cfbe None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:30.132154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9181d7a-4500-4eeb-b703-f1395593cfbe None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:30.132416 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9181d7a-4500-4eeb-b703-f1395593cfbe None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:30.133043 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9181d7a-4500-4eeb-b703-f1395593cfbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:30.133374 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9181d7a-4500-4eeb-b703-f1395593cfbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:30.134718 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9181d7a-4500-4eeb-b703-f1395593cfbe None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:30.146022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 543/1078] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 14:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:30.151656 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9181d7a-4500-4eeb-b703-f1395593cfbe None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:30.200188 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e9763-a442-4724-9234-fc09a4b03856 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:30.233067 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba179315-97a5-4837-a393-3307c5c7f1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:30.233723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba179315-97a5-4837-a393-3307c5c7f1ed None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:30.234002 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba179315-97a5-4837-a393-3307c5c7f1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:30.234276 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba179315-97a5-4837-a393-3307c5c7f1ed None admin] PATH_INFO: `/v3/users/428441a4e75a49eba5a99d91b1e8be58` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:30.235406 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba179315-97a5-4837-a393-3307c5c7f1ed None admin] RBAC: Authorizing `identity:get_user(user_id=428441a4e75a49eba5a99d91b1e8be58)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:30.237376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba179315-97a5-4837-a393-3307c5c7f1ed None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:30.239116 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 536/1079] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 14:00:30 2022] GET /identity/v3/users/428441a4e75a49eba5a99d91b1e8be58 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:30.244498 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba179315-97a5-4837-a393-3307c5c7f1ed None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:30.248766 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9181d7a-4500-4eeb-b703-f1395593cfbe None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:30.256571 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:30.283607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27ab84-02c3-468c-a103-5368e23d33ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:30.284216 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27ab84-02c3-468c-a103-5368e23d33ab None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:30.284488 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27ab84-02c3-468c-a103-5368e23d33ab None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:30.284756 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27ab84-02c3-468c-a103-5368e23d33ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:30.293265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27ab84-02c3-468c-a103-5368e23d33ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:30.294632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27ab84-02c3-468c-a103-5368e23d33ab None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:30.304519 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:30.306360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-8c27ab84-02c3-468c-a103-5368e23d33ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 14:00:30.306360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:30.306360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:30.306360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:30.306360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:30.306360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:30.306360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:30.306360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:30.306360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:30.306360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:30.306360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:30.306360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:30.306360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 14:00:30.306360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 14:00:30.306360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 14:00:30.307311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 14:00:30.307311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:30.307311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:30.307311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:30.307311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:30.307311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:30.307311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:30.307311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:30.307311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:30.307311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:30.307311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:30.307311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:30.307311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:30.307311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:30.307311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:30.307311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:30.307311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:30.308204 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 14:00:30.308204 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 14:00:30.308204 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 14:00:30.308204 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 14:00:30.308204 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 14:00:30.308204 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 14:00:30.308204 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 14:00:30.308204 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:30.308204 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 544/1080] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 14:00:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 14:00:30.313197 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27ab84-02c3-468c-a103-5368e23d33ab None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:30.344363 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba179315-97a5-4837-a393-3307c5c7f1ed None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:30.378063 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca929863-de1e-4a89-bc77-c5d0b02295a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:30.378681 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca929863-de1e-4a89-bc77-c5d0b02295a3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:30.378962 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca929863-de1e-4a89-bc77-c5d0b02295a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:30.379230 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca929863-de1e-4a89-bc77-c5d0b02295a3 None admin] PATH_INFO: `/v3/projects/f10c7b183b5c4a5aaeebc30fbf73e9b2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:30.380335 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca929863-de1e-4a89-bc77-c5d0b02295a3 None admin] RBAC: Authorizing `identity:get_project(project_id=f10c7b183b5c4a5aaeebc30fbf73e9b2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:30.381797 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca929863-de1e-4a89-bc77-c5d0b02295a3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:30.383438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 537/1081] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 14:00:30 2022] GET /identity/v3/projects/f10c7b183b5c4a5aaeebc30fbf73e9b2 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:30.389347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca929863-de1e-4a89-bc77-c5d0b02295a3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:30.411135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27ab84-02c3-468c-a103-5368e23d33ab None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:30.446011 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33623c1e-f29c-4072-85d5-adcaf31c4197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:30.446671 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33623c1e-f29c-4072-85d5-adcaf31c4197 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:30.446945 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33623c1e-f29c-4072-85d5-adcaf31c4197 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:30.447214 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33623c1e-f29c-4072-85d5-adcaf31c4197 None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:30.447926 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33623c1e-f29c-4072-85d5-adcaf31c4197 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:30.448228 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33623c1e-f29c-4072-85d5-adcaf31c4197 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:30.449689 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33623c1e-f29c-4072-85d5-adcaf31c4197 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:30.463031 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 545/1082] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 14:00:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:30.469089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33623c1e-f29c-4072-85d5-adcaf31c4197 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:30.489432 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca929863-de1e-4a89-bc77-c5d0b02295a3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:30.495858 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:30.521342 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:30.527396 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000afca8-4176-4c16-8a8c-10d26ca7764c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:30.528047 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000afca8-4176-4c16-8a8c-10d26ca7764c None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:30.528323 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000afca8-4176-4c16-8a8c-10d26ca7764c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:30.528600 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000afca8-4176-4c16-8a8c-10d26ca7764c None admin] PATH_INFO: `/v3/projects/f10c7b183b5c4a5aaeebc30fbf73e9b2/users/428441a4e75a49eba5a99d91b1e8be58/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:30.530670 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000afca8-4176-4c16-8a8c-10d26ca7764c None admin] RBAC: Authorizing `identity:create_grant(project_id=f10c7b183b5c4a5aaeebc30fbf73e9b2, user_id=428441a4e75a49eba5a99d91b1e8be58, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:30.532096 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000afca8-4176-4c16-8a8c-10d26ca7764c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:30.545616 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 538/1083] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 13 14:00:30 2022] PUT /identity/v3/projects/f10c7b183b5c4a5aaeebc30fbf73e9b2/users/428441a4e75a49eba5a99d91b1e8be58/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:00:30.569821 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33623c1e-f29c-4072-85d5-adcaf31c4197 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:30.606045 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097e2e0-3db2-4334-9510-de74be970da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:30.606722 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097e2e0-3db2-4334-9510-de74be970da8 None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:30.606992 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097e2e0-3db2-4334-9510-de74be970da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:30.607258 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097e2e0-3db2-4334-9510-de74be970da8 None admin] PATH_INFO: `/v3/projects/17ba27c26bf34daa91cf8f7cc25bf086/users/1b3533d0a24e4e7bbf5c7137d3511b13/roles/a0ce4da381a2401daee681a57a4731b3` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:30.609500 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5097e2e0-3db2-4334-9510-de74be970da8 None admin] RBAC: Authorizing `identity:create_grant(project_id=17ba27c26bf34daa91cf8f7cc25bf086, user_id=1b3533d0a24e4e7bbf5c7137d3511b13, role_id=a0ce4da381a2401daee681a57a4731b3)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:30.610939 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5097e2e0-3db2-4334-9510-de74be970da8 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:30.630251 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 546/1084] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 13 14:00:30 2022] PUT /identity/v3/projects/17ba27c26bf34daa91cf8f7cc25bf086/users/1b3533d0a24e4e7bbf5c7137d3511b13/roles/a0ce4da381a2401daee681a57a4731b3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:00:32.711535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb64c7-7647-4362-a9f0-0b6ebb59377d None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:32.712100 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb64c7-7647-4362-a9f0-0b6ebb59377d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:32.712100 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb64c7-7647-4362-a9f0-0b6ebb59377d None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:32.713486 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 539/1085] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:00:32.718741 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126539e-0352-43e3-9cfe-5af19cab5709 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:32.719206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126539e-0352-43e3-9cfe-5af19cab5709 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:32.719307 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126539e-0352-43e3-9cfe-5af19cab5709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:32.738251 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-5126539e-0352-43e3-9cfe-5af19cab5709 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:32.739429 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5126539e-0352-43e3-9cfe-5af19cab5709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:32.775172 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1b234-2ce7-4e61-a965-adbf7f12d5c3 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:32.775548 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1b234-2ce7-4e61-a965-adbf7f12d5c3 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:32.775885 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1b234-2ce7-4e61-a965-adbf7f12d5c3 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:32.777335 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 540/1086] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 14:00:32.782283 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a6f9a-4268-4df2-a5dc-e3217e22f961 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:32.782823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a6f9a-4268-4df2-a5dc-e3217e22f961 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:32.783626 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a6f9a-4268-4df2-a5dc-e3217e22f961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:32.801702 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f32a6f9a-4268-4df2-a5dc-e3217e22f961 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:32.802897 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f32a6f9a-4268-4df2-a5dc-e3217e22f961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:32.805288 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 547/1087] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:00:32.867653 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 541/1088] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 14:00:33.070103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126539e-0352-43e3-9cfe-5af19cab5709 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:33.087393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:33.133018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a6f9a-4268-4df2-a5dc-e3217e22f961 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:33.170105 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126539e-0352-43e3-9cfe-5af19cab5709 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:33.202622 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cbb55-f532-4495-9625-d89ee5f8da10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:33.203233 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cbb55-f532-4495-9625-d89ee5f8da10 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:33.203505 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cbb55-f532-4495-9625-d89ee5f8da10 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:33.203770 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cbb55-f532-4495-9625-d89ee5f8da10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:33.214554 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cbb55-f532-4495-9625-d89ee5f8da10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 14:00:33.219402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-ec9cbb55-f532-4495-9625-d89ee5f8da10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 14:00:33.219402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:33.219402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:33.219402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:33.219402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:33.219402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:33.219402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:33.219402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:33.219402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:33.219402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:33.219402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:33.219402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:33.219402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 14:00:33.219402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 14:00:33.219402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 14:00:33.219402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 14:00:33.220541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 14:00:33.220541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 14:00:33.220541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 14:00:33.220541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 14:00:33.220541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:33.220541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:33.220541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:33.220541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:33.220541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:33.220541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:33.220541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:33.220541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:33.220541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:33.220541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:33.220541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:33.220541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:33.221532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:33.221532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:33.221532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:33.221532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:33.221532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 14:00:33.221532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 14:00:33.221532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 14:00:33.221532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 14:00:33.221532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 14:00:33.221532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 14:00:33.221532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 14:00:33.221532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:33.221532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 548/1089] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 14:00:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:33.226625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cbb55-f532-4495-9625-d89ee5f8da10 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:33.231279 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a6f9a-4268-4df2-a5dc-e3217e22f961 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:33.251546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:33.266385 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e119f6c-00eb-4300-a1e1-17f4f00450c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:33.267002 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e119f6c-00eb-4300-a1e1-17f4f00450c0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:33.267284 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e119f6c-00eb-4300-a1e1-17f4f00450c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:33.268068 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e119f6c-00eb-4300-a1e1-17f4f00450c0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:33.277942 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e119f6c-00eb-4300-a1e1-17f4f00450c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 14:00:33.282926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-6e119f6c-00eb-4300-a1e1-17f4f00450c0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 14:00:33.282926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:33.282926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:33.282926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:33.282926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:33.282926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:33.282926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:33.282926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:33.282926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:33.282926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:33.282926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:33.282926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:33.282926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 14:00:33.282926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 14:00:33.282926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 14:00:33.282926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 14:00:33.284374 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 14:00:33.284374 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 14:00:33.284374 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 14:00:33.284374 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 14:00:33.284374 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:33.284374 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:33.284374 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:33.284374 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:33.284374 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:33.284374 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:33.284374 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:33.284374 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:33.284374 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:33.284374 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:33.284374 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:33.284374 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:33.285252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:33.285252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:33.285252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:33.285252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:33.285252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 14:00:33.285252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 14:00:33.285252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 14:00:33.285252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 14:00:33.285252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 14:00:33.285252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 14:00:33.285252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 14:00:33.285252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:33.285252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 542/1090] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Sep 13 14:00:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 14:00:33.291371 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e119f6c-00eb-4300-a1e1-17f4f00450c0 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:33.304968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:33.328487 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cbb55-f532-4495-9625-d89ee5f8da10 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:33.362806 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776048a2-c4b0-4f79-8c75-a5de29cd6eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:33.363398 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776048a2-c4b0-4f79-8c75-a5de29cd6eaa None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:33.363675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776048a2-c4b0-4f79-8c75-a5de29cd6eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:33.363950 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776048a2-c4b0-4f79-8c75-a5de29cd6eaa None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:33.364600 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776048a2-c4b0-4f79-8c75-a5de29cd6eaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:33.364894 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776048a2-c4b0-4f79-8c75-a5de29cd6eaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:33.366266 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776048a2-c4b0-4f79-8c75-a5de29cd6eaa None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:33.374650 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 549/1091] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 14:00:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:33.380454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776048a2-c4b0-4f79-8c75-a5de29cd6eaa None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:33.395017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e119f6c-00eb-4300-a1e1-17f4f00450c0 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:33.428334 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfc26e-b617-4f1c-886c-9e4c9a1c60c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:33.428925 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfc26e-b617-4f1c-886c-9e4c9a1c60c5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:33.429233 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfc26e-b617-4f1c-886c-9e4c9a1c60c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:33.429503 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfc26e-b617-4f1c-886c-9e4c9a1c60c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:33.430151 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfc26e-b617-4f1c-886c-9e4c9a1c60c5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:33.430451 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfc26e-b617-4f1c-886c-9e4c9a1c60c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:33.431813 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfc26e-b617-4f1c-886c-9e4c9a1c60c5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:33.440532 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 543/1092] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Sep 13 14:00:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:33.446189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfc26e-b617-4f1c-886c-9e4c9a1c60c5 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:33.485250 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776048a2-c4b0-4f79-8c75-a5de29cd6eaa None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:33.489703 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:33.518912 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da0d61-4241-4833-bd52-1e2e9660ec30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:33.519533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da0d61-4241-4833-bd52-1e2e9660ec30 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:33.519809 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da0d61-4241-4833-bd52-1e2e9660ec30 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:33.520084 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da0d61-4241-4833-bd52-1e2e9660ec30 None admin] PATH_INFO: `/v3/users/428441a4e75a49eba5a99d91b1e8be58` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:33.521261 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da0d61-4241-4833-bd52-1e2e9660ec30 None admin] RBAC: Authorizing `identity:get_user(user_id=428441a4e75a49eba5a99d91b1e8be58)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:33.522691 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da0d61-4241-4833-bd52-1e2e9660ec30 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:33.524286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 550/1093] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 14:00:33 2022] GET /identity/v3/users/428441a4e75a49eba5a99d91b1e8be58 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:33.529889 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da0d61-4241-4833-bd52-1e2e9660ec30 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:33.539320 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:33.548911 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfc26e-b617-4f1c-886c-9e4c9a1c60c5 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:33.584125 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685abcb6-055f-4e2d-af86-19c00a5b75ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:33.584745 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685abcb6-055f-4e2d-af86-19c00a5b75ce None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:33.585027 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685abcb6-055f-4e2d-af86-19c00a5b75ce None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:33.585328 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685abcb6-055f-4e2d-af86-19c00a5b75ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:33.595635 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685abcb6-055f-4e2d-af86-19c00a5b75ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:33.597070 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685abcb6-055f-4e2d-af86-19c00a5b75ce None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:33.610860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-685abcb6-055f-4e2d-af86-19c00a5b75ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:00:33.610860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:33.610860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:33.610860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:33.610860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:33.610860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:33.610860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:33.610860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:33.610860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:33.610860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:33.610860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:33.610860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:33.610860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 14:00:33.610860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 14:00:33.610860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 14:00:33.610860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 14:00:33.611862 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:33.611862 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:33.611862 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:33.611862 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:33.611862 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:33.611862 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:33.611862 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:33.611862 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:33.611862 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:33.611862 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:33.611862 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:33.611862 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:33.611862 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:33.611862 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:33.611862 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:33.611862 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:33.611862 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 14:00:33.612798 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 14:00:33.612798 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:00:33.612798 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:33.612798 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 544/1094] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 14:00:33.617827 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685abcb6-055f-4e2d-af86-19c00a5b75ce None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:33.637226 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da0d61-4241-4833-bd52-1e2e9660ec30 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:33.677595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da4e97-aa0b-4126-9a5a-c13ca2e3691e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:33.678117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da4e97-aa0b-4126-9a5a-c13ca2e3691e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:33.678389 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da4e97-aa0b-4126-9a5a-c13ca2e3691e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:33.678655 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da4e97-aa0b-4126-9a5a-c13ca2e3691e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:33.718284 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:33.725791 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685abcb6-055f-4e2d-af86-19c00a5b75ce None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:33.746897 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da4e97-aa0b-4126-9a5a-c13ca2e3691e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:33.748350 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da4e97-aa0b-4126-9a5a-c13ca2e3691e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:33.755822 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:33.759611 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76075343-a6b7-4124-bc68-b83f9bafb537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:33.760215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76075343-a6b7-4124-bc68-b83f9bafb537 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:33.760497 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76075343-a6b7-4124-bc68-b83f9bafb537 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:33.760771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76075343-a6b7-4124-bc68-b83f9bafb537 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:33.761442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76075343-a6b7-4124-bc68-b83f9bafb537 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:33.761746 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76075343-a6b7-4124-bc68-b83f9bafb537 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:33.763118 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76075343-a6b7-4124-bc68-b83f9bafb537 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:33.775843 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 545/1095] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 14:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:33.782885 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76075343-a6b7-4124-bc68-b83f9bafb537 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:33.849546 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 551/1096] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 14:00:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 14:00:33.855504 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da4e97-aa0b-4126-9a5a-c13ca2e3691e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:33.887080 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76075343-a6b7-4124-bc68-b83f9bafb537 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:33.921496 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d997aa4-547c-466d-b344-2e48c1350261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:33.922118 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d997aa4-547c-466d-b344-2e48c1350261 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:33.922397 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d997aa4-547c-466d-b344-2e48c1350261 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:33.922666 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d997aa4-547c-466d-b344-2e48c1350261 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:33.930036 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d997aa4-547c-466d-b344-2e48c1350261 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:33.931404 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d997aa4-547c-466d-b344-2e48c1350261 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:33.943194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-7d997aa4-547c-466d-b344-2e48c1350261 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 14:00:33.943194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:33.943194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:33.943194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:33.943194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:33.943194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:33.943194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:33.943194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:33.943194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:33.943194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:33.943194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:33.943194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:33.943194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 14:00:33.943194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 14:00:33.943194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 14:00:33.943194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 14:00:33.944252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:33.944252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:33.944252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 14:00:33.944252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 14:00:33.944252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 14:00:33.944252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 14:00:33.944252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:33.944252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:33.944252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:33.944252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:33.944252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:33.944252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:33.944252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:33.944252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:33.944252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:33.944252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:33.944252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:33.944252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:33.945250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:33.945250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:33.945250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 14:00:33.945250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 14:00:33.945250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 14:00:33.945250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 14:00:33.945250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 14:00:33.945250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 14:00:33.945250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 14:00:33.945250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:33.945250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 546/1097] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Sep 13 14:00:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 14:00:33.949984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d997aa4-547c-466d-b344-2e48c1350261 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:33.958050 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da4e97-aa0b-4126-9a5a-c13ca2e3691e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:33.964895 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:33.965537 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:33.993375 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de74947-1da8-41f3-91aa-b768c56f5a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:33.993992 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de74947-1da8-41f3-91aa-b768c56f5a3f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:33.994265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de74947-1da8-41f3-91aa-b768c56f5a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:33.994535 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de74947-1da8-41f3-91aa-b768c56f5a3f None admin] PATH_INFO: `/v3/projects/f10c7b183b5c4a5aaeebc30fbf73e9b2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:33.995628 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de74947-1da8-41f3-91aa-b768c56f5a3f None admin] RBAC: Authorizing `identity:get_project(project_id=f10c7b183b5c4a5aaeebc30fbf73e9b2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:33.997043 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de74947-1da8-41f3-91aa-b768c56f5a3f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:33.998688 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 552/1098] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 14:00:33 2022] GET /identity/v3/projects/f10c7b183b5c4a5aaeebc30fbf73e9b2 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:34.009010 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de74947-1da8-41f3-91aa-b768c56f5a3f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:34.050710 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d997aa4-547c-466d-b344-2e48c1350261 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:34.083556 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae9c11-78c9-4d16-82cc-7c246a988a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:34.084142 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae9c11-78c9-4d16-82cc-7c246a988a3c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:34.084419 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae9c11-78c9-4d16-82cc-7c246a988a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:34.084690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae9c11-78c9-4d16-82cc-7c246a988a3c None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:34.085448 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae9c11-78c9-4d16-82cc-7c246a988a3c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:34.085746 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae9c11-78c9-4d16-82cc-7c246a988a3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:34.087158 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae9c11-78c9-4d16-82cc-7c246a988a3c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:34.105864 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 547/1099] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Sep 13 14:00:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:34.108895 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de74947-1da8-41f3-91aa-b768c56f5a3f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:34.113021 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae9c11-78c9-4d16-82cc-7c246a988a3c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:34.144727 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099bc20-f0db-4343-a891-885438ecce8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:34.145358 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099bc20-f0db-4343-a891-885438ecce8f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:34.145633 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099bc20-f0db-4343-a891-885438ecce8f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:34.145897 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099bc20-f0db-4343-a891-885438ecce8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:34.146615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099bc20-f0db-4343-a891-885438ecce8f None admin] RBAC: Adding query filter params (role.id=6dcc8495d2b24b3eab63dd656eb4eb6d, scope.project.id=f10c7b183b5c4a5aaeebc30fbf73e9b2, user.id=428441a4e75a49eba5a99d91b1e8be58) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:34.146915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099bc20-f0db-4343-a891-885438ecce8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:34.148329 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099bc20-f0db-4343-a891-885438ecce8f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:34.153947 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 553/1100] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 14:00:34 2022] GET /identity/v3/role_assignments?user.id=428441a4e75a49eba5a99d91b1e8be58&scope.project.id=f10c7b183b5c4a5aaeebc30fbf73e9b2&role.id=6dcc8495d2b24b3eab63dd656eb4eb6d => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:34.185206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:34.217511 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae9c11-78c9-4d16-82cc-7c246a988a3c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:34.254401 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1bc44d-e6b5-493e-9859-5a1c08069e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:34.255017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bc44d-e6b5-493e-9859-5a1c08069e4e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:34.255317 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bc44d-e6b5-493e-9859-5a1c08069e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:34.255584 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bc44d-e6b5-493e-9859-5a1c08069e4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:34.325905 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1bc44d-e6b5-493e-9859-5a1c08069e4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:34.327348 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1bc44d-e6b5-493e-9859-5a1c08069e4e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:34.395600 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:34.427136 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 548/1101] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 14:00:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 14:00:34.433606 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099bc20-f0db-4343-a891-885438ecce8f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:34.473722 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:34.532587 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099bc20-f0db-4343-a891-885438ecce8f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:34.564903 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57412c-7645-444c-86bb-6bf292def3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:34.565538 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57412c-7645-444c-86bb-6bf292def3c1 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:34.565811 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57412c-7645-444c-86bb-6bf292def3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:34.566074 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57412c-7645-444c-86bb-6bf292def3c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:34.576138 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57412c-7645-444c-86bb-6bf292def3c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:34.577592 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57412c-7645-444c-86bb-6bf292def3c1 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:34.591580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-ba57412c-7645-444c-86bb-6bf292def3c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:00:34.591580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:34.591580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:34.591580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:34.591580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:34.591580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:34.591580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:34.591580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:34.591580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:34.591580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:34.591580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:34.591580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:34.591580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 14:00:34.591580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 14:00:34.591580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 14:00:34.591580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 14:00:34.592550 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:34.592550 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:34.592550 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:34.592550 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:34.592550 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:34.592550 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:34.592550 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:34.592550 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:34.592550 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:34.592550 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:34.592550 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:34.592550 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:34.592550 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:34.592550 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:34.592550 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:34.592550 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:34.592550 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 14:00:34.593491 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 14:00:34.593491 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:00:34.593491 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:34.593491 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 554/1102] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:34.598995 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1bc44d-e6b5-493e-9859-5a1c08069e4e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:34.699902 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1bc44d-e6b5-493e-9859-5a1c08069e4e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:34.734566 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6ed65-9abf-4d51-8113-f9ce0571efd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:34.735172 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6ed65-9abf-4d51-8113-f9ce0571efd7 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:34.735353 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6ed65-9abf-4d51-8113-f9ce0571efd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:34.735599 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6ed65-9abf-4d51-8113-f9ce0571efd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:34.736254 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6ed65-9abf-4d51-8113-f9ce0571efd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:34.736551 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6ed65-9abf-4d51-8113-f9ce0571efd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:34.737930 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6ed65-9abf-4d51-8113-f9ce0571efd7 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:34.749259 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 549/1103] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 14:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:34.754656 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57412c-7645-444c-86bb-6bf292def3c1 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:34.845172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:34.855888 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57412c-7645-444c-86bb-6bf292def3c1 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:34.888962 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80ab96-eb8e-4bf8-a6ac-37298be8f4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:34.889610 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80ab96-eb8e-4bf8-a6ac-37298be8f4f7 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:34.889905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80ab96-eb8e-4bf8-a6ac-37298be8f4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:34.890153 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80ab96-eb8e-4bf8-a6ac-37298be8f4f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:34.897642 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80ab96-eb8e-4bf8-a6ac-37298be8f4f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:34.899091 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80ab96-eb8e-4bf8-a6ac-37298be8f4f7 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:34.911069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-bd80ab96-eb8e-4bf8-a6ac-37298be8f4f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 14:00:34.911069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:34.911069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:34.911069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:34.911069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:34.911069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:34.911069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:34.911069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:34.911069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:34.911069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:34.911069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:34.911069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:34.911069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 14:00:34.911069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 14:00:34.911069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 14:00:34.912129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 14:00:34.912129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:34.912129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:34.912129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:34.912129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:34.912129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:34.912129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:34.912129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:34.912129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:34.912129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:34.912129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:34.912129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:34.912129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:34.912129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:34.912129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:34.912129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:34.912129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:34.917806 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 14:00:34.917806 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 14:00:34.917806 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 14:00:34.917806 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 14:00:34.917806 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 14:00:34.917806 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 14:00:34.917806 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 14:00:34.917806 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:00:34.917806 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 555/1104] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 14:00:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:34.918331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6ed65-9abf-4d51-8113-f9ce0571efd7 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:34.949266 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:35.016485 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6ed65-9abf-4d51-8113-f9ce0571efd7 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:35.049830 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dc0f7-b8e5-4edd-9b27-78c56da7f6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:35.050441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dc0f7-b8e5-4edd-9b27-78c56da7f6dc None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:35.050718 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dc0f7-b8e5-4edd-9b27-78c56da7f6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:35.050987 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dc0f7-b8e5-4edd-9b27-78c56da7f6dc None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:35.051690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82dc0f7-b8e5-4edd-9b27-78c56da7f6dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:35.051995 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82dc0f7-b8e5-4edd-9b27-78c56da7f6dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:35.053491 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82dc0f7-b8e5-4edd-9b27-78c56da7f6dc None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:35.067867 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 550/1105] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 14:00:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:35.073893 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80ab96-eb8e-4bf8-a6ac-37298be8f4f7 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:35.170082 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80ab96-eb8e-4bf8-a6ac-37298be8f4f7 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:35.202218 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1581cfa-8680-4de8-8a44-d8e8cfa461da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:35.202792 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1581cfa-8680-4de8-8a44-d8e8cfa461da None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:35.203062 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1581cfa-8680-4de8-8a44-d8e8cfa461da None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:35.203323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1581cfa-8680-4de8-8a44-d8e8cfa461da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:35.204028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1581cfa-8680-4de8-8a44-d8e8cfa461da None admin] RBAC: Adding query filter params (role.id=a0ce4da381a2401daee681a57a4731b3, scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086, user.id=1b3533d0a24e4e7bbf5c7137d3511b13) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:35.204327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1581cfa-8680-4de8-8a44-d8e8cfa461da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:35.205791 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1581cfa-8680-4de8-8a44-d8e8cfa461da None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:35.211365 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 556/1106] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 14:00:35 2022] GET /identity/v3/role_assignments?user.id=1b3533d0a24e4e7bbf5c7137d3511b13&scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086&role.id=a0ce4da381a2401daee681a57a4731b3 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:36.341622 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942f9f0-2bc4-45f4-9258-16be31ac5b8f None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:36.342148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942f9f0-2bc4-45f4-9258-16be31ac5b8f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:36.342148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942f9f0-2bc4-45f4-9258-16be31ac5b8f None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:36.343509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 551/1107] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:00:36.348655 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f0b21-66fa-489a-967c-410ec67dbecc None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:36.349069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f0b21-66fa-489a-967c-410ec67dbecc None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:36.349212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f0b21-66fa-489a-967c-410ec67dbecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:36.367413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-375f0b21-66fa-489a-967c-410ec67dbecc None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:36.368573 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-375f0b21-66fa-489a-967c-410ec67dbecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:36.378126 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:36.434684 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 557/1108] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 14:00:36.700590 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942f9f0-2bc4-45f4-9258-16be31ac5b8f None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:36.791412 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:36.801812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942f9f0-2bc4-45f4-9258-16be31ac5b8f None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:36.834469 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5523b-260a-40e2-be0e-32c6c3a44a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:36.835080 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5523b-260a-40e2-be0e-32c6c3a44a24 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:36.835352 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5523b-260a-40e2-be0e-32c6c3a44a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:36.835647 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5523b-260a-40e2-be0e-32c6c3a44a24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:36.836724 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5523b-260a-40e2-be0e-32c6c3a44a24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:36.838195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5523b-260a-40e2-be0e-32c6c3a44a24 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:36.839727 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 552/1109] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:00:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:36.846156 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f0b21-66fa-489a-967c-410ec67dbecc None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:36.941635 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f0b21-66fa-489a-967c-410ec67dbecc None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:36.973489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad975a5c-a02d-400a-9179-265b5ce7cb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:36.974080 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad975a5c-a02d-400a-9179-265b5ce7cb2a None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:36.974354 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad975a5c-a02d-400a-9179-265b5ce7cb2a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:36.974621 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad975a5c-a02d-400a-9179-265b5ce7cb2a None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:36.975251 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad975a5c-a02d-400a-9179-265b5ce7cb2a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:36.976663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad975a5c-a02d-400a-9179-265b5ce7cb2a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:36.992323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:37.003183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 558/1110] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 13 14:00:36 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:00:39.132901 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330e115-a9a6-4684-a66c-1dd5625f0b12 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:39.133579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330e115-a9a6-4684-a66c-1dd5625f0b12 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:39.133579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330e115-a9a6-4684-a66c-1dd5625f0b12 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:39.134790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 553/1111] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:00:39.139968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f1143-a998-427f-a607-ca27629971fd None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:39.140366 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f1143-a998-427f-a607-ca27629971fd None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:39.140509 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f1143-a998-427f-a607-ca27629971fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:39.161769 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-351f1143-a998-427f-a607-ca27629971fd None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:39.163306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-351f1143-a998-427f-a607-ca27629971fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:39.230178 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 559/1112] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:00:39.511391 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330e115-a9a6-4684-a66c-1dd5625f0b12 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:39.609116 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330e115-a9a6-4684-a66c-1dd5625f0b12 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:39.642223 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0311d3-ddee-4372-97b3-2248780a5726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:39.643331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0311d3-ddee-4372-97b3-2248780a5726 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:39.643605 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0311d3-ddee-4372-97b3-2248780a5726 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:39.643872 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0311d3-ddee-4372-97b3-2248780a5726 None admin] PATH_INFO: `/v3/roles/cf8554dac8d343549802afd60c56c0d6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:39.645264 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0311d3-ddee-4372-97b3-2248780a5726 None admin] RBAC: Authorizing `identity:get_role(role_id=cf8554dac8d343549802afd60c56c0d6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:39.646616 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0311d3-ddee-4372-97b3-2248780a5726 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:39.647929 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 554/1113] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 14:00:39 2022] GET /identity/v3/roles/cf8554dac8d343549802afd60c56c0d6 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:39.653634 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f1143-a998-427f-a607-ca27629971fd None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:39.746751 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f1143-a998-427f-a607-ca27629971fd None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:39.776412 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:39.783026 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ee6d3-cf5b-458e-ad43-291f19487d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:39.783630 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ee6d3-cf5b-458e-ad43-291f19487d62 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:39.783901 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ee6d3-cf5b-458e-ad43-291f19487d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:39.784161 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ee6d3-cf5b-458e-ad43-291f19487d62 None admin] PATH_INFO: `/v3/users/edb8e50f4f6d4ba3aae4368ea5d8b0a6` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:39.796679 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ee6d3-cf5b-458e-ad43-291f19487d62 None admin] RBAC: Authorizing `identity:get_user(user_id=edb8e50f4f6d4ba3aae4368ea5d8b0a6)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:39.798157 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ee6d3-cf5b-458e-ad43-291f19487d62 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:39.800227 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 560/1114] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 14:00:39 2022] GET /identity/v3/users/edb8e50f4f6d4ba3aae4368ea5d8b0a6 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:39.805899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0311d3-ddee-4372-97b3-2248780a5726 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:39.834243 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:39.910021 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0311d3-ddee-4372-97b3-2248780a5726 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:39.945444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2abc70-859f-4bcf-bad3-15a734fe8278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:39.946039 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2abc70-859f-4bcf-bad3-15a734fe8278 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:39.946318 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2abc70-859f-4bcf-bad3-15a734fe8278 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:39.946597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2abc70-859f-4bcf-bad3-15a734fe8278 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:40.011959 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2abc70-859f-4bcf-bad3-15a734fe8278 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:40.013437 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2abc70-859f-4bcf-bad3-15a734fe8278 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:40.039154 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:40.110456 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 555/1115] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 14:00:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 14:00:40.116880 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ee6d3-cf5b-458e-ad43-291f19487d62 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:40.211499 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ee6d3-cf5b-458e-ad43-291f19487d62 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:40.243655 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db39e5-8bf2-486e-bea6-bda6c6c084c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:40.244254 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db39e5-8bf2-486e-bea6-bda6c6c084c3 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:40.244526 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db39e5-8bf2-486e-bea6-bda6c6c084c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:40.244792 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db39e5-8bf2-486e-bea6-bda6c6c084c3 None admin] PATH_INFO: `/v3/projects/f10c7b183b5c4a5aaeebc30fbf73e9b2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:40.245903 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db39e5-8bf2-486e-bea6-bda6c6c084c3 None admin] RBAC: Authorizing `identity:get_project(project_id=f10c7b183b5c4a5aaeebc30fbf73e9b2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:40.247310 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db39e5-8bf2-486e-bea6-bda6c6c084c3 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:40.248886 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 561/1116] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 14:00:40 2022] GET /identity/v3/projects/f10c7b183b5c4a5aaeebc30fbf73e9b2 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:40.255376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2abc70-859f-4bcf-bad3-15a734fe8278 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:40.351243 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2abc70-859f-4bcf-bad3-15a734fe8278 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:40.376631 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:40.384609 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8ef67-26a2-49a6-826c-9b654a8690c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:40.385212 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8ef67-26a2-49a6-826c-9b654a8690c4 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:40.385487 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8ef67-26a2-49a6-826c-9b654a8690c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:40.385751 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8ef67-26a2-49a6-826c-9b654a8690c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:40.386465 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8ef67-26a2-49a6-826c-9b654a8690c4 None admin] RBAC: Adding query filter params (role.id=cf8554dac8d343549802afd60c56c0d6, scope.project.id=f10c7b183b5c4a5aaeebc30fbf73e9b2, user.id=edb8e50f4f6d4ba3aae4368ea5d8b0a6) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:40.386766 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8ef67-26a2-49a6-826c-9b654a8690c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:40.388168 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8ef67-26a2-49a6-826c-9b654a8690c4 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:40.393453 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 556/1117] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 14:00:40 2022] GET /identity/v3/role_assignments?user.id=edb8e50f4f6d4ba3aae4368ea5d8b0a6&scope.project.id=f10c7b183b5c4a5aaeebc30fbf73e9b2&role.id=cf8554dac8d343549802afd60c56c0d6 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:42.488546 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6138e6-0230-4168-911c-15bddca7e03b None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:42.489172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6138e6-0230-4168-911c-15bddca7e03b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:42.489172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6138e6-0230-4168-911c-15bddca7e03b None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:42.490453 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 562/1118] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:00:42.495586 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea92022-bc8a-45e5-a917-db5534e2607c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:42.496016 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea92022-bc8a-45e5-a917-db5534e2607c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:42.496122 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea92022-bc8a-45e5-a917-db5534e2607c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:42.514721 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-aea92022-bc8a-45e5-a917-db5534e2607c None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:42.515910 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-aea92022-bc8a-45e5-a917-db5534e2607c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:42.581479 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 557/1119] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:00:42.849831 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6138e6-0230-4168-911c-15bddca7e03b None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:42.905294 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:42.948542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6138e6-0230-4168-911c-15bddca7e03b None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:42.980734 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fb760-7451-4852-b46b-6316d01e6caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:42.981400 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fb760-7451-4852-b46b-6316d01e6caa None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:42.981672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fb760-7451-4852-b46b-6316d01e6caa None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:42.981934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fb760-7451-4852-b46b-6316d01e6caa None admin] PATH_INFO: `/v3/roles/cf8554dac8d343549802afd60c56c0d6` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:42.983298 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fb760-7451-4852-b46b-6316d01e6caa None admin] RBAC: Authorizing `identity:get_role(role_id=cf8554dac8d343549802afd60c56c0d6)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:42.984645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fb760-7451-4852-b46b-6316d01e6caa None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:42.986682 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 563/1120] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 14:00:42 2022] GET /identity/v3/roles/cf8554dac8d343549802afd60c56c0d6 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:42.992591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea92022-bc8a-45e5-a917-db5534e2607c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:43.088949 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea92022-bc8a-45e5-a917-db5534e2607c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:43.110328 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:43.122355 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30723ae-5a6a-4911-840a-25bbd5bf4044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:43.122970 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30723ae-5a6a-4911-840a-25bbd5bf4044 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:43.123244 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30723ae-5a6a-4911-840a-25bbd5bf4044 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:43.123510 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30723ae-5a6a-4911-840a-25bbd5bf4044 None admin] PATH_INFO: `/v3/users/edb8e50f4f6d4ba3aae4368ea5d8b0a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:43.124599 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30723ae-5a6a-4911-840a-25bbd5bf4044 None admin] RBAC: Authorizing `identity:get_user(user_id=edb8e50f4f6d4ba3aae4368ea5d8b0a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:43.126052 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30723ae-5a6a-4911-840a-25bbd5bf4044 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:43.128161 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 558/1121] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 14:00:42 2022] GET /identity/v3/users/edb8e50f4f6d4ba3aae4368ea5d8b0a6 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:43.133998 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fb760-7451-4852-b46b-6316d01e6caa None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:43.228848 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fb760-7451-4852-b46b-6316d01e6caa None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:43.251211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:43.261997 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898d036-6988-4fb6-9a99-263987139cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:43.262596 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898d036-6988-4fb6-9a99-263987139cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:43.262867 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898d036-6988-4fb6-9a99-263987139cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:43.263128 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898d036-6988-4fb6-9a99-263987139cd7 None admin] PATH_INFO: `/v3/projects/f10c7b183b5c4a5aaeebc30fbf73e9b2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:43.264211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898d036-6988-4fb6-9a99-263987139cd7 None admin] RBAC: Authorizing `identity:get_project(project_id=f10c7b183b5c4a5aaeebc30fbf73e9b2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:43.265647 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898d036-6988-4fb6-9a99-263987139cd7 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:43.267278 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 564/1122] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 14:00:43 2022] GET /identity/v3/projects/f10c7b183b5c4a5aaeebc30fbf73e9b2 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:00:43.272934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30723ae-5a6a-4911-840a-25bbd5bf4044 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:43.369225 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30723ae-5a6a-4911-840a-25bbd5bf4044 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:43.400619 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14468a9-0eb6-4a1d-a97a-8e10f138063e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:43.401275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14468a9-0eb6-4a1d-a97a-8e10f138063e None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:43.401550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14468a9-0eb6-4a1d-a97a-8e10f138063e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:43.401844 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14468a9-0eb6-4a1d-a97a-8e10f138063e None admin] PATH_INFO: `/v3/projects/f10c7b183b5c4a5aaeebc30fbf73e9b2/users/edb8e50f4f6d4ba3aae4368ea5d8b0a6/roles/cf8554dac8d343549802afd60c56c0d6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:43.403923 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14468a9-0eb6-4a1d-a97a-8e10f138063e None admin] RBAC: Authorizing `identity:create_grant(project_id=f10c7b183b5c4a5aaeebc30fbf73e9b2, user_id=edb8e50f4f6d4ba3aae4368ea5d8b0a6, role_id=cf8554dac8d343549802afd60c56c0d6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:43.405359 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14468a9-0eb6-4a1d-a97a-8e10f138063e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:43.418382 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 559/1123] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 13 14:00:43 2022] PUT /identity/v3/projects/f10c7b183b5c4a5aaeebc30fbf73e9b2/users/edb8e50f4f6d4ba3aae4368ea5d8b0a6/roles/cf8554dac8d343549802afd60c56c0d6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:00:45.517315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34fe54-080a-4c86-b14f-f1080c6dd44d None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:45.517840 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34fe54-080a-4c86-b14f-f1080c6dd44d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:45.517840 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34fe54-080a-4c86-b14f-f1080c6dd44d None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:45.519206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 565/1124] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:00:45.524717 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d3eb9-2e75-4749-b7a1-e716a7546748 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:45.525176 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d3eb9-2e75-4749-b7a1-e716a7546748 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:45.525298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d3eb9-2e75-4749-b7a1-e716a7546748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:45.543895 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-af9d3eb9-2e75-4749-b7a1-e716a7546748 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:45.545079 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-af9d3eb9-2e75-4749-b7a1-e716a7546748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:45.589712 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:45.611600 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 560/1125] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:00:45.875262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34fe54-080a-4c86-b14f-f1080c6dd44d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:45.974290 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34fe54-080a-4c86-b14f-f1080c6dd44d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:46.005897 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc496c4-d4fd-43a0-a2bd-1269d77e6d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:46.006494 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc496c4-d4fd-43a0-a2bd-1269d77e6d85 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:46.006766 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc496c4-d4fd-43a0-a2bd-1269d77e6d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:46.007031 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc496c4-d4fd-43a0-a2bd-1269d77e6d85 None admin] PATH_INFO: `/v3/roles/cf8554dac8d343549802afd60c56c0d6` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:46.008385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc496c4-d4fd-43a0-a2bd-1269d77e6d85 None admin] RBAC: Authorizing `identity:get_role(role_id=cf8554dac8d343549802afd60c56c0d6)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:46.009763 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc496c4-d4fd-43a0-a2bd-1269d77e6d85 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:46.011068 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 566/1126] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 14:00:45 2022] GET /identity/v3/roles/cf8554dac8d343549802afd60c56c0d6 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:46.016827 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d3eb9-2e75-4749-b7a1-e716a7546748 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:46.114906 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d3eb9-2e75-4749-b7a1-e716a7546748 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:46.148782 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12dd3e-1776-4393-bd56-a4616c119bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:46.149364 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12dd3e-1776-4393-bd56-a4616c119bbf None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:46.149644 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12dd3e-1776-4393-bd56-a4616c119bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:46.149915 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12dd3e-1776-4393-bd56-a4616c119bbf None admin] PATH_INFO: `/v3/users/edb8e50f4f6d4ba3aae4368ea5d8b0a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:46.151022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac12dd3e-1776-4393-bd56-a4616c119bbf None admin] RBAC: Authorizing `identity:get_user(user_id=edb8e50f4f6d4ba3aae4368ea5d8b0a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:46.152460 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac12dd3e-1776-4393-bd56-a4616c119bbf None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:46.154062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 561/1127] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 14:00:46 2022] GET /identity/v3/users/edb8e50f4f6d4ba3aae4368ea5d8b0a6 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:46.160138 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc496c4-d4fd-43a0-a2bd-1269d77e6d85 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:46.219179 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:46.258580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc496c4-d4fd-43a0-a2bd-1269d77e6d85 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:46.291323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae3ac4-ce8e-4a48-9f1e-1f9edf4d3f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:46.291902 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae3ac4-ce8e-4a48-9f1e-1f9edf4d3f90 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:46.292172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae3ac4-ce8e-4a48-9f1e-1f9edf4d3f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:46.292436 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae3ac4-ce8e-4a48-9f1e-1f9edf4d3f90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:46.356203 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae3ac4-ce8e-4a48-9f1e-1f9edf4d3f90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:46.357649 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae3ac4-ce8e-4a48-9f1e-1f9edf4d3f90 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:46.411902 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:46.451900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 567/1128] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 14:00:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 14:00:46.458311 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12dd3e-1776-4393-bd56-a4616c119bbf None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:46.506182 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:46.556415 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12dd3e-1776-4393-bd56-a4616c119bbf None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:46.588984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657bb26-59bd-4a79-a7d2-84e0c3af8da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:46.589627 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657bb26-59bd-4a79-a7d2-84e0c3af8da5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:46.589911 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657bb26-59bd-4a79-a7d2-84e0c3af8da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:46.590182 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657bb26-59bd-4a79-a7d2-84e0c3af8da5 None admin] PATH_INFO: `/v3/projects/f10c7b183b5c4a5aaeebc30fbf73e9b2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:46.591286 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657bb26-59bd-4a79-a7d2-84e0c3af8da5 None admin] RBAC: Authorizing `identity:get_project(project_id=f10c7b183b5c4a5aaeebc30fbf73e9b2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:46.592713 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657bb26-59bd-4a79-a7d2-84e0c3af8da5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:46.594362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 562/1129] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 14:00:46 2022] GET /identity/v3/projects/f10c7b183b5c4a5aaeebc30fbf73e9b2 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:46.600493 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae3ac4-ce8e-4a48-9f1e-1f9edf4d3f90 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:46.696840 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae3ac4-ce8e-4a48-9f1e-1f9edf4d3f90 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:46.728909 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed3db2-e7cb-4c8e-9322-df9cdc2ebb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:46.729510 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed3db2-e7cb-4c8e-9322-df9cdc2ebb21 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:46.729785 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed3db2-e7cb-4c8e-9322-df9cdc2ebb21 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:46.730051 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed3db2-e7cb-4c8e-9322-df9cdc2ebb21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:46.730765 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed3db2-e7cb-4c8e-9322-df9cdc2ebb21 None admin] RBAC: Adding query filter params (role.id=cf8554dac8d343549802afd60c56c0d6, scope.project.id=f10c7b183b5c4a5aaeebc30fbf73e9b2, user.id=edb8e50f4f6d4ba3aae4368ea5d8b0a6) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:46.731091 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed3db2-e7cb-4c8e-9322-df9cdc2ebb21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:46.732492 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed3db2-e7cb-4c8e-9322-df9cdc2ebb21 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:46.738587 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 568/1130] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 14:00:46 2022] GET /identity/v3/role_assignments?user.id=edb8e50f4f6d4ba3aae4368ea5d8b0a6&scope.project.id=f10c7b183b5c4a5aaeebc30fbf73e9b2&role.id=cf8554dac8d343549802afd60c56c0d6 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:48.862715 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b8611-ec9f-4051-ae3b-e8818466b4f1 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:48.863259 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b8611-ec9f-4051-ae3b-e8818466b4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:48.863259 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b8611-ec9f-4051-ae3b-e8818466b4f1 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:48.864609 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 563/1131] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:00:48.869923 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d58093-0a95-4716-9eed-ae039a693f57 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:48.870290 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d58093-0a95-4716-9eed-ae039a693f57 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:48.870415 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d58093-0a95-4716-9eed-ae039a693f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:48.896752 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-c8d58093-0a95-4716-9eed-ae039a693f57 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:48.897978 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c8d58093-0a95-4716-9eed-ae039a693f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:48.915307 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:48.962801 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 569/1132] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:00:49.235427 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b8611-ec9f-4051-ae3b-e8818466b4f1 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:49.336424 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b8611-ec9f-4051-ae3b-e8818466b4f1 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:49.351911 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:49.369187 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9c4e0-780e-4099-badd-083bab4ae08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:49.369794 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9c4e0-780e-4099-badd-083bab4ae08f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:49.370065 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9c4e0-780e-4099-badd-083bab4ae08f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:49.370331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9c4e0-780e-4099-badd-083bab4ae08f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:49.371413 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9c4e0-780e-4099-badd-083bab4ae08f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:49.372830 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9c4e0-780e-4099-badd-083bab4ae08f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:49.374392 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 564/1133] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:00:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:49.380635 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d58093-0a95-4716-9eed-ae039a693f57 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:49.475866 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d58093-0a95-4716-9eed-ae039a693f57 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:49.508340 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e993fc48-a5e3-40ea-a4a0-7648f856e9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:49.508872 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993fc48-a5e3-40ea-a4a0-7648f856e9fe None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:49.509174 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993fc48-a5e3-40ea-a4a0-7648f856e9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:49.509454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993fc48-a5e3-40ea-a4a0-7648f856e9fe None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:49.510086 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e993fc48-a5e3-40ea-a4a0-7648f856e9fe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:49.511506 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e993fc48-a5e3-40ea-a4a0-7648f856e9fe None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:49.545023 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 570/1134] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Sep 13 14:00:49 2022] POST /identity/v3/projects => generated 311 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:00:51.692132 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d17d62-0862-44a9-b9f0-2dfbdc6816c9 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:51.692657 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d17d62-0862-44a9-b9f0-2dfbdc6816c9 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:51.692657 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d17d62-0862-44a9-b9f0-2dfbdc6816c9 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:51.694059 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 565/1135] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:00:51.700287 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579ac47-3aa5-4b89-821e-a9b715101b90 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:51.700687 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579ac47-3aa5-4b89-821e-a9b715101b90 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:51.700831 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579ac47-3aa5-4b89-821e-a9b715101b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:51.714062 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:51.720106 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-6579ac47-3aa5-4b89-821e-a9b715101b90 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:51.721305 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-6579ac47-3aa5-4b89-821e-a9b715101b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:51.785467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 571/1136] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:00:52.051152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d17d62-0862-44a9-b9f0-2dfbdc6816c9 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:52.151754 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d17d62-0862-44a9-b9f0-2dfbdc6816c9 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:52.184728 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ea4ae-7118-4cf3-a032-53dd56d30715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:52.185373 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ea4ae-7118-4cf3-a032-53dd56d30715 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:52.185654 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ea4ae-7118-4cf3-a032-53dd56d30715 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:52.185926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ea4ae-7118-4cf3-a032-53dd56d30715 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:52.187034 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ea4ae-7118-4cf3-a032-53dd56d30715 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:52.188494 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ea4ae-7118-4cf3-a032-53dd56d30715 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:52.190582 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 566/1137] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:00:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:52.196231 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579ac47-3aa5-4b89-821e-a9b715101b90 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:52.291350 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579ac47-3aa5-4b89-821e-a9b715101b90 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:52.324792 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3238c-882d-4bd4-a706-0e2750e7eb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:52.325355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3238c-882d-4bd4-a706-0e2750e7eb88 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:52.325633 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3238c-882d-4bd4-a706-0e2750e7eb88 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:52.325898 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3238c-882d-4bd4-a706-0e2750e7eb88 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:52.326544 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3238c-882d-4bd4-a706-0e2750e7eb88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:52.327965 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3238c-882d-4bd4-a706-0e2750e7eb88 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:52.336735 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:52.348882 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 572/1138] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 13 14:00:52 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:00:54.488971 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63845ea-6616-415e-9bed-f888bc3661f1 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:54.489567 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63845ea-6616-415e-9bed-f888bc3661f1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:54.489567 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63845ea-6616-415e-9bed-f888bc3661f1 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:54.490894 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 567/1139] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:00:54.496278 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c83a8a-6c15-45ea-ac14-90de5e62f315 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:54.496712 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c83a8a-6c15-45ea-ac14-90de5e62f315 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:54.496805 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c83a8a-6c15-45ea-ac14-90de5e62f315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:54.518014 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-c5c83a8a-6c15-45ea-ac14-90de5e62f315 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:54.519193 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c5c83a8a-6c15-45ea-ac14-90de5e62f315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:54.583103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 573/1140] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:00:54.848165 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63845ea-6616-415e-9bed-f888bc3661f1 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:54.905196 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:54.952056 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63845ea-6616-415e-9bed-f888bc3661f1 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:54.983820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7075366-2963-468a-bd25-0b72e3cf2b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:54.984423 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7075366-2963-468a-bd25-0b72e3cf2b9b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:54.984697 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7075366-2963-468a-bd25-0b72e3cf2b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:54.984963 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7075366-2963-468a-bd25-0b72e3cf2b9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:54.995140 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7075366-2963-468a-bd25-0b72e3cf2b9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 14:00:54.999832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-f7075366-2963-468a-bd25-0b72e3cf2b9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 14:00:54.999832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:54.999832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:54.999832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:54.999832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:54.999832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:54.999832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:54.999832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:54.999832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:54.999832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:54.999832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:54.999832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:54.999832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 14:00:54.999832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 14:00:54.999832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 14:00:54.999832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 14:00:55.000888 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 14:00:55.000888 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 14:00:55.000888 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 14:00:55.000888 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 14:00:55.000888 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:55.000888 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:55.000888 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:55.000888 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:55.000888 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:55.000888 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:55.000888 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:55.000888 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:55.000888 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:55.000888 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:55.000888 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:55.000888 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:55.002439 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:55.002439 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:55.002439 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:55.002439 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:55.002439 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 14:00:55.002439 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 14:00:55.002439 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 14:00:55.002439 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 14:00:55.002439 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 14:00:55.002439 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 14:00:55.002439 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 14:00:55.002439 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:55.002439 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 568/1141] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 14:00:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:55.007462 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c83a8a-6c15-45ea-ac14-90de5e62f315 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:55.102446 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c83a8a-6c15-45ea-ac14-90de5e62f315 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:55.124177 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:55.137283 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a2a7e-3283-48ac-86fc-a5f3d94e3a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:55.137877 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a2a7e-3283-48ac-86fc-a5f3d94e3a29 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:55.138157 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a2a7e-3283-48ac-86fc-a5f3d94e3a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:55.138428 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a2a7e-3283-48ac-86fc-a5f3d94e3a29 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:55.139088 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a2a7e-3283-48ac-86fc-a5f3d94e3a29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:55.139392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a2a7e-3283-48ac-86fc-a5f3d94e3a29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:55.140755 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a2a7e-3283-48ac-86fc-a5f3d94e3a29 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:55.149302 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 574/1142] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 14:00:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:55.155216 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7075366-2963-468a-bd25-0b72e3cf2b9b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:55.253305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7075366-2963-468a-bd25-0b72e3cf2b9b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:55.265908 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:55.287457 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea65887-4532-45af-b03f-691178e98158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:55.288145 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea65887-4532-45af-b03f-691178e98158 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:55.288504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea65887-4532-45af-b03f-691178e98158 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:55.288778 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea65887-4532-45af-b03f-691178e98158 None admin] PATH_INFO: `/v3/users/0e18a07f4390481d86621e508ff377d9` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:55.302439 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea65887-4532-45af-b03f-691178e98158 None admin] RBAC: Authorizing `identity:get_user(user_id=0e18a07f4390481d86621e508ff377d9)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:55.303871 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea65887-4532-45af-b03f-691178e98158 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:55.305535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 569/1143] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 14:00:55 2022] GET /identity/v3/users/0e18a07f4390481d86621e508ff377d9 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:55.311274 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a2a7e-3283-48ac-86fc-a5f3d94e3a29 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:55.407814 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a2a7e-3283-48ac-86fc-a5f3d94e3a29 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:55.439847 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d5a01-49ca-4b8f-a9cb-4da47453a979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:55.440424 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d5a01-49ca-4b8f-a9cb-4da47453a979 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:55.440695 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d5a01-49ca-4b8f-a9cb-4da47453a979 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:55.440960 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d5a01-49ca-4b8f-a9cb-4da47453a979 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:55.493755 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:55.509863 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d5a01-49ca-4b8f-a9cb-4da47453a979 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:55.511302 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d5a01-49ca-4b8f-a9cb-4da47453a979 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:55.604682 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 575/1144] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 14:00:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 14:00:55.611045 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea65887-4532-45af-b03f-691178e98158 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:55.708428 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea65887-4532-45af-b03f-691178e98158 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:55.742407 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7892b-0327-4a40-a416-4cefdea326d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:55.743022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7892b-0327-4a40-a416-4cefdea326d7 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:55.743302 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7892b-0327-4a40-a416-4cefdea326d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:55.743573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7892b-0327-4a40-a416-4cefdea326d7 None admin] PATH_INFO: `/v3/projects/f22c098304ed4bbbb52054267e812274` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:55.744673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7892b-0327-4a40-a416-4cefdea326d7 None admin] RBAC: Authorizing `identity:get_project(project_id=f22c098304ed4bbbb52054267e812274)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:55.746132 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7892b-0327-4a40-a416-4cefdea326d7 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:55.747748 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 570/1145] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 14:00:55 2022] GET /identity/v3/projects/f22c098304ed4bbbb52054267e812274 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:55.753824 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d5a01-49ca-4b8f-a9cb-4da47453a979 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:55.834912 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:55.850901 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d5a01-49ca-4b8f-a9cb-4da47453a979 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:55.883602 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0d277-ddbf-4341-81cc-e94116606731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:55.884189 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0d277-ddbf-4341-81cc-e94116606731 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:55.884465 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0d277-ddbf-4341-81cc-e94116606731 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:55.884731 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0d277-ddbf-4341-81cc-e94116606731 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:55.885478 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0d277-ddbf-4341-81cc-e94116606731 None admin] RBAC: Adding query filter params (role.id=6dcc8495d2b24b3eab63dd656eb4eb6d, scope.project.id=f22c098304ed4bbbb52054267e812274, user.id=0e18a07f4390481d86621e508ff377d9) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:55.885782 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0d277-ddbf-4341-81cc-e94116606731 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:55.887195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0d277-ddbf-4341-81cc-e94116606731 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:55.892954 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 576/1146] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 14:00:55 2022] GET /identity/v3/role_assignments?user.id=0e18a07f4390481d86621e508ff377d9&scope.project.id=f22c098304ed4bbbb52054267e812274&role.id=6dcc8495d2b24b3eab63dd656eb4eb6d => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:57.981450 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b6e1b-3c9a-407e-a755-1c56e3b29e3b None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:57.981965 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b6e1b-3c9a-407e-a755-1c56e3b29e3b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:57.982073 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b6e1b-3c9a-407e-a755-1c56e3b29e3b None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:57.983326 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 571/1147] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:00:57.989414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a675d-c667-4d1e-8702-ae9040df52fe None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:57.989904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a675d-c667-4d1e-8702-ae9040df52fe None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:57.990235 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a675d-c667-4d1e-8702-ae9040df52fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:58.011023 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-5d6a675d-c667-4d1e-8702-ae9040df52fe None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:00:58.012195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5d6a675d-c667-4d1e-8702-ae9040df52fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:00:58.076457 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 577/1148] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:00:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 14:00:58.347102 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b6e1b-3c9a-407e-a755-1c56e3b29e3b None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:58.387418 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:58.447524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b6e1b-3c9a-407e-a755-1c56e3b29e3b None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:58.480748 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d1ba7-26a2-4d5c-8880-07fa317a4617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:58.481382 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d1ba7-26a2-4d5c-8880-07fa317a4617 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:58.481663 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d1ba7-26a2-4d5c-8880-07fa317a4617 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:58.481933 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d1ba7-26a2-4d5c-8880-07fa317a4617 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:58.491639 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d1ba7-26a2-4d5c-8880-07fa317a4617 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 14:00:58.496383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-929d1ba7-26a2-4d5c-8880-07fa317a4617 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 14:00:58.496383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:00:58.496383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:00:58.496383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:00:58.496383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:00:58.496383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:00:58.496383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:00:58.496383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:00:58.496383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:00:58.496383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:00:58.496383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:00:58.496383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:00:58.496383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 14:00:58.496383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 14:00:58.496383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 14:00:58.496383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 14:00:58.497509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 14:00:58.497509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 14:00:58.497509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 14:00:58.497509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 14:00:58.497509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:00:58.497509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:00:58.497509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:00:58.497509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:00:58.497509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:00:58.497509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:00:58.497509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:00:58.497509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:00:58.497509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:00:58.497509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:00:58.497509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:00:58.497509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:00:58.498538 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:00:58.498538 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:00:58.498538 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:00:58.498538 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:00:58.498538 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 14:00:58.498538 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 14:00:58.498538 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 14:00:58.498538 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 14:00:58.498538 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 14:00:58.498538 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 14:00:58.498538 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 14:00:58.498538 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:00:58.498538 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 572/1149] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 14:00:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:00:58.503878 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a675d-c667-4d1e-8702-ae9040df52fe None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:58.578500 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:58.599771 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a675d-c667-4d1e-8702-ae9040df52fe None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:58.642329 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca52fcd-4487-40b5-be52-f5f9a3ccd9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:58.642927 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca52fcd-4487-40b5-be52-f5f9a3ccd9a2 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:58.643207 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca52fcd-4487-40b5-be52-f5f9a3ccd9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:58.643480 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca52fcd-4487-40b5-be52-f5f9a3ccd9a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:58.644141 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca52fcd-4487-40b5-be52-f5f9a3ccd9a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:00:58.644440 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca52fcd-4487-40b5-be52-f5f9a3ccd9a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:58.645840 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca52fcd-4487-40b5-be52-f5f9a3ccd9a2 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:58.653792 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 578/1150] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 14:00:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:58.659800 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d1ba7-26a2-4d5c-8880-07fa317a4617 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:58.753363 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:00:58.757472 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d1ba7-26a2-4d5c-8880-07fa317a4617 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:58.790927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707633b-6b48-4244-a6ba-45691db0c81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:58.791536 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707633b-6b48-4244-a6ba-45691db0c81a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:58.791816 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707633b-6b48-4244-a6ba-45691db0c81a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:58.792088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707633b-6b48-4244-a6ba-45691db0c81a None admin] PATH_INFO: `/v3/users/0e18a07f4390481d86621e508ff377d9` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:58.793230 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707633b-6b48-4244-a6ba-45691db0c81a None admin] RBAC: Authorizing `identity:get_user(user_id=0e18a07f4390481d86621e508ff377d9)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:58.794659 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707633b-6b48-4244-a6ba-45691db0c81a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:58.796246 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 573/1151] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 14:00:58 2022] GET /identity/v3/users/0e18a07f4390481d86621e508ff377d9 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:58.802307 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca52fcd-4487-40b5-be52-f5f9a3ccd9a2 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:58.898768 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca52fcd-4487-40b5-be52-f5f9a3ccd9a2 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:58.931547 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0b8cd-d721-4ab8-9500-30f4a4f85a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:58.932154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0b8cd-d721-4ab8-9500-30f4a4f85a83 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:58.932434 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0b8cd-d721-4ab8-9500-30f4a4f85a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:58.932705 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0b8cd-d721-4ab8-9500-30f4a4f85a83 None admin] PATH_INFO: `/v3/projects/f22c098304ed4bbbb52054267e812274` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:58.933834 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0b8cd-d721-4ab8-9500-30f4a4f85a83 None admin] RBAC: Authorizing `identity:get_project(project_id=f22c098304ed4bbbb52054267e812274)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:58.935253 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0b8cd-d721-4ab8-9500-30f4a4f85a83 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:58.936855 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 579/1152] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 14:00:58 2022] GET /identity/v3/projects/f22c098304ed4bbbb52054267e812274 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:00:58.942533 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707633b-6b48-4244-a6ba-45691db0c81a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:00:59.038000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707633b-6b48-4244-a6ba-45691db0c81a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:00:59.070133 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef1f00-077d-40e3-8524-22ec677e9a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:00:59.070764 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef1f00-077d-40e3-8524-22ec677e9a66 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:00:59.071041 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef1f00-077d-40e3-8524-22ec677e9a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:00:59.071313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef1f00-077d-40e3-8524-22ec677e9a66 None admin] PATH_INFO: `/v3/projects/f22c098304ed4bbbb52054267e812274/users/0e18a07f4390481d86621e508ff377d9/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:00:59.073220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef1f00-077d-40e3-8524-22ec677e9a66 None admin] RBAC: Authorizing `identity:create_grant(project_id=f22c098304ed4bbbb52054267e812274, user_id=0e18a07f4390481d86621e508ff377d9, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:00:59.074638 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef1f00-077d-40e3-8524-22ec677e9a66 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:00:59.087704 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 574/1153] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 13 14:00:58 2022] PUT /identity/v3/projects/f22c098304ed4bbbb52054267e812274/users/0e18a07f4390481d86621e508ff377d9/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:01:01.198112 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcc42e-f4ed-4f70-b6aa-0d1e24012216 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:01.198634 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcc42e-f4ed-4f70-b6aa-0d1e24012216 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:01.198634 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcc42e-f4ed-4f70-b6aa-0d1e24012216 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:01.200002 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 580/1154] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:01:01.205282 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62dd14f-d717-4599-8b9d-897cf0595b6b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:01.205711 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62dd14f-d717-4599-8b9d-897cf0595b6b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:01.205818 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62dd14f-d717-4599-8b9d-897cf0595b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:01.223968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a62dd14f-d717-4599-8b9d-897cf0595b6b None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:01:01.225164 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a62dd14f-d717-4599-8b9d-897cf0595b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:01:01.244963 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:01:01.296798 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 575/1155] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:01:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 14:01:01.565866 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddcc42e-f4ed-4f70-b6aa-0d1e24012216 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:01.577153 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:01:01.666642 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddcc42e-f4ed-4f70-b6aa-0d1e24012216 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:01.698510 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32cc64-b312-422b-9e27-b5d01b3cd047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:01.699120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32cc64-b312-422b-9e27-b5d01b3cd047 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:01.699400 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32cc64-b312-422b-9e27-b5d01b3cd047 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:01.699673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32cc64-b312-422b-9e27-b5d01b3cd047 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:01.710360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32cc64-b312-422b-9e27-b5d01b3cd047 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 14:01:01.715155 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-7b32cc64-b312-422b-9e27-b5d01b3cd047 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 14:01:01.715155 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:01:01.715155 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:01:01.715155 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:01:01.715155 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:01:01.715155 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:01:01.715155 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:01:01.715155 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:01:01.715155 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:01:01.715155 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:01:01.715155 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:01:01.715155 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:01:01.715155 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 14:01:01.715155 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 14:01:01.715155 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 14:01:01.715155 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 14:01:01.716320 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 14:01:01.716320 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 14:01:01.716320 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 14:01:01.716320 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 14:01:01.716320 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:01:01.716320 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:01:01.716320 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:01:01.716320 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:01:01.716320 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:01:01.716320 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:01:01.716320 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:01:01.716320 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:01:01.716320 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:01:01.716320 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:01:01.716320 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:01:01.716320 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:01:01.717433 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:01:01.717433 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:01:01.717433 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:01:01.717433 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:01:01.717433 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 14:01:01.717433 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 14:01:01.717433 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 14:01:01.717433 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 14:01:01.717433 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 14:01:01.717433 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 14:01:01.717433 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 14:01:01.717433 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:01:01.717433 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 581/1156] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 14:01:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:01:01.722840 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62dd14f-d717-4599-8b9d-897cf0595b6b None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:01.819813 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62dd14f-d717-4599-8b9d-897cf0595b6b None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:01.852961 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b8fe9-116a-4b4a-a07c-0f86e5e9494d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:01.853573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b8fe9-116a-4b4a-a07c-0f86e5e9494d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:01.853849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b8fe9-116a-4b4a-a07c-0f86e5e9494d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:01.854116 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b8fe9-116a-4b4a-a07c-0f86e5e9494d None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:01.854768 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b8fe9-116a-4b4a-a07c-0f86e5e9494d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:01:01.855065 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b8fe9-116a-4b4a-a07c-0f86e5e9494d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:01:01.856416 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b8fe9-116a-4b4a-a07c-0f86e5e9494d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:01:01.864177 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 576/1157] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 14:01:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:01:01.869989 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32cc64-b312-422b-9e27-b5d01b3cd047 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:01.934263 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:01:01.967247 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32cc64-b312-422b-9e27-b5d01b3cd047 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:01.998910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602692c-7538-4521-a8f8-745156188d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:01.999514 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602692c-7538-4521-a8f8-745156188d5f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:01.999792 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602692c-7538-4521-a8f8-745156188d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:02.000063 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602692c-7538-4521-a8f8-745156188d5f None admin] PATH_INFO: `/v3/users/0e18a07f4390481d86621e508ff377d9` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:02.001807 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602692c-7538-4521-a8f8-745156188d5f None admin] RBAC: Authorizing `identity:get_user(user_id=0e18a07f4390481d86621e508ff377d9)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:01:02.003230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602692c-7538-4521-a8f8-745156188d5f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:01:02.004789 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 582/1158] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 14:01:01 2022] GET /identity/v3/users/0e18a07f4390481d86621e508ff377d9 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:01:02.010376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b8fe9-116a-4b4a-a07c-0f86e5e9494d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:02.029765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:01:02.107371 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b8fe9-116a-4b4a-a07c-0f86e5e9494d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:02.139634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd591e9-ad15-42e9-abe6-d94777a45f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:02.140223 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd591e9-ad15-42e9-abe6-d94777a45f22 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:02.140495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd591e9-ad15-42e9-abe6-d94777a45f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:02.140760 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd591e9-ad15-42e9-abe6-d94777a45f22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:02.205805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd591e9-ad15-42e9-abe6-d94777a45f22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:01:02.207231 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd591e9-ad15-42e9-abe6-d94777a45f22 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:01:02.224567 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:01:02.302618 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 577/1159] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 14:01:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 14:01:02.308523 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602692c-7538-4521-a8f8-745156188d5f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:02.405977 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602692c-7538-4521-a8f8-745156188d5f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:02.438023 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50f56c-a339-4eb4-a0ce-36a285bab06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:02.438653 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50f56c-a339-4eb4-a0ce-36a285bab06b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:02.438931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50f56c-a339-4eb4-a0ce-36a285bab06b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:02.439201 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50f56c-a339-4eb4-a0ce-36a285bab06b None admin] PATH_INFO: `/v3/projects/f22c098304ed4bbbb52054267e812274` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:02.440310 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50f56c-a339-4eb4-a0ce-36a285bab06b None admin] RBAC: Authorizing `identity:get_project(project_id=f22c098304ed4bbbb52054267e812274)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:01:02.441764 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50f56c-a339-4eb4-a0ce-36a285bab06b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:01:02.443373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 583/1160] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 14:01:02 2022] GET /identity/v3/projects/f22c098304ed4bbbb52054267e812274 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:01:02.449472 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd591e9-ad15-42e9-abe6-d94777a45f22 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:02.544457 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd591e9-ad15-42e9-abe6-d94777a45f22 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:02.567936 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:01:02.584903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e356c51-3fe5-439c-8600-e4e58f866795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:02.585521 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e356c51-3fe5-439c-8600-e4e58f866795 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:02.585796 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e356c51-3fe5-439c-8600-e4e58f866795 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:02.586111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e356c51-3fe5-439c-8600-e4e58f866795 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:02.587095 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e356c51-3fe5-439c-8600-e4e58f866795 None admin] RBAC: Adding query filter params (role.id=6dcc8495d2b24b3eab63dd656eb4eb6d, scope.project.id=f22c098304ed4bbbb52054267e812274, user.id=0e18a07f4390481d86621e508ff377d9) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:01:02.587513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e356c51-3fe5-439c-8600-e4e58f866795 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:01:02.589675 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e356c51-3fe5-439c-8600-e4e58f866795 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:01:02.596013 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 578/1161] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 14:01:02 2022] GET /identity/v3/role_assignments?user.id=0e18a07f4390481d86621e508ff377d9&scope.project.id=f22c098304ed4bbbb52054267e812274&role.id=6dcc8495d2b24b3eab63dd656eb4eb6d => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:01:04.720485 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f198a6b-d26d-4550-b05e-ea078d2f6204 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:04.721020 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f198a6b-d26d-4550-b05e-ea078d2f6204 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:04.721020 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f198a6b-d26d-4550-b05e-ea078d2f6204 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:04.722372 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 584/1162] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:01:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:01:04.727442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e1079-2c25-4410-b4bc-e7a74007e64b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:04.727815 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e1079-2c25-4410-b4bc-e7a74007e64b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:04.727981 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e1079-2c25-4410-b4bc-e7a74007e64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:04.745568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-622e1079-2c25-4410-b4bc-e7a74007e64b None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:01:04.746731 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-622e1079-2c25-4410-b4bc-e7a74007e64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:01:04.810291 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 579/1163] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:01:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:01:05.076919 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f198a6b-d26d-4550-b05e-ea078d2f6204 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:05.081361 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:01:05.175467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f198a6b-d26d-4550-b05e-ea078d2f6204 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:05.210442 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70d9ac-72b4-4d50-88b6-dd05eb9bc423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:05.211029 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70d9ac-72b4-4d50-88b6-dd05eb9bc423 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:05.211302 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70d9ac-72b4-4d50-88b6-dd05eb9bc423 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:05.211567 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70d9ac-72b4-4d50-88b6-dd05eb9bc423 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:05.275978 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70d9ac-72b4-4d50-88b6-dd05eb9bc423 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:01:05.277430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70d9ac-72b4-4d50-88b6-dd05eb9bc423 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:01:05.279897 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:01:05.370986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 585/1164] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 14:01:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 14:01:05.377448 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e1079-2c25-4410-b4bc-e7a74007e64b None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:05.472332 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e1079-2c25-4410-b4bc-e7a74007e64b None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:05.484769 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:01:05.506489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfb35e-82a4-4e80-ae61-ae97d6a6b0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:05.507099 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfb35e-82a4-4e80-ae61-ae97d6a6b0ec None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:05.507375 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfb35e-82a4-4e80-ae61-ae97d6a6b0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:05.507644 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfb35e-82a4-4e80-ae61-ae97d6a6b0ec None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:05.514064 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfb35e-82a4-4e80-ae61-ae97d6a6b0ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:01:05.515499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfb35e-82a4-4e80-ae61-ae97d6a6b0ec None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:01:05.527159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-6ddfb35e-82a4-4e80-ae61-ae97d6a6b0ec None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 13 14:01:05.527159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:01:05.527159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 13 14:01:05.527159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 13 14:01:05.527159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 14:01:05.527159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 14:01:05.527159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 14:01:05.527159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 14:01:05.527159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 13 14:01:05.527159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:01:05.527159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 14:01:05.527159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:01:05.527159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:01:05.527159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:01:05.527159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:01:05.527159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:01:05.527159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:01:05.528361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:01:05.528361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:01:05.528361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:01:05.528361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:01:05.528361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:01:05.528361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:01:05.528361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 14:01:05.528361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 14:01:05.528361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 14:01:05.528361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 14:01:05.528361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:01:05.528361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:01:05.528361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:01:05.528361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:01:05.528361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:01:05.528361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:01:05.529441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:01:05.529441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:01:05.529441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:01:05.529441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:01:05.529441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:01:05.529441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:01:05.529441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:01:05.529441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:01:05.529441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:01:05.529441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:01:05.529441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 13 14:01:05.529441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 14:01:05.529441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 13 14:01:05.529441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:01:05.529441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 580/1165] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Sep 13 14:01:05 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:01:05.534673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70d9ac-72b4-4d50-88b6-dd05eb9bc423 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:05.628729 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70d9ac-72b4-4d50-88b6-dd05eb9bc423 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:05.630961 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:01:05.662252 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e073fbf-38f8-4dd0-8dde-10bd107b1472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:05.662860 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e073fbf-38f8-4dd0-8dde-10bd107b1472 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:05.663132 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e073fbf-38f8-4dd0-8dde-10bd107b1472 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:05.663394 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e073fbf-38f8-4dd0-8dde-10bd107b1472 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:05.664021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e073fbf-38f8-4dd0-8dde-10bd107b1472 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:01:05.664313 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e073fbf-38f8-4dd0-8dde-10bd107b1472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:01:05.665818 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e073fbf-38f8-4dd0-8dde-10bd107b1472 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:01:05.672599 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 586/1166] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Sep 13 14:01:05 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:01:07.787885 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81278539-42ea-44b7-ab67-fd0aed543d38 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:07.788437 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81278539-42ea-44b7-ab67-fd0aed543d38 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:07.788437 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81278539-42ea-44b7-ab67-fd0aed543d38 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:07.789879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 581/1167] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:01:07.795153 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdae6b-0824-4ba7-a6cc-77cddd3a1df7 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:07.795566 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdae6b-0824-4ba7-a6cc-77cddd3a1df7 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:07.795679 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdae6b-0824-4ba7-a6cc-77cddd3a1df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:07.814653 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-00cdae6b-0824-4ba7-a6cc-77cddd3a1df7 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:01:07.815831 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-00cdae6b-0824-4ba7-a6cc-77cddd3a1df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:01:07.881422 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 587/1168] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:01:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:01:08.147956 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81278539-42ea-44b7-ab67-fd0aed543d38 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:08.246789 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81278539-42ea-44b7-ab67-fd0aed543d38 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:08.280203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffd039-1e6a-4634-92ad-375c59797e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:08.280809 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffd039-1e6a-4634-92ad-375c59797e36 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:08.281085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffd039-1e6a-4634-92ad-375c59797e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:08.281384 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffd039-1e6a-4634-92ad-375c59797e36 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:08.282046 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dffd039-1e6a-4634-92ad-375c59797e36 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:01:08.283667 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dffd039-1e6a-4634-92ad-375c59797e36 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:01:08.299736 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 582/1169] 10.222.0.26 () {60 vars in 1138 bytes} [Tue Sep 13 14:01:08 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:01:10.436408 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f78d0-a4dd-4f5a-901d-d8e1b85b4782 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:10.436967 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f78d0-a4dd-4f5a-901d-d8e1b85b4782 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:10.436967 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f78d0-a4dd-4f5a-901d-d8e1b85b4782 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:10.438886 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 588/1170] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:01:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:01:10.444275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e099c2-8f31-4e2f-977a-73390549a0b8 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:10.444691 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e099c2-8f31-4e2f-977a-73390549a0b8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:10.444820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e099c2-8f31-4e2f-977a-73390549a0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:10.463178 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-78e099c2-8f31-4e2f-977a-73390549a0b8 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:01:10.464351 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-78e099c2-8f31-4e2f-977a-73390549a0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:01:10.489172 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:01:10.530279 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 583/1171] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:01:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:01:10.798741 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f78d0-a4dd-4f5a-901d-d8e1b85b4782 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:10.893401 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:01:10.898600 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f78d0-a4dd-4f5a-901d-d8e1b85b4782 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:10.932004 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900deffe-67bf-4b34-a3a4-c387b128a18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:10.932604 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900deffe-67bf-4b34-a3a4-c387b128a18d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:10.932877 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900deffe-67bf-4b34-a3a4-c387b128a18d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:10.933167 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900deffe-67bf-4b34-a3a4-c387b128a18d None admin] PATH_INFO: `/v3/domains/6f7c5c61950f492896a9990e2044e6d2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:10.943069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900deffe-67bf-4b34-a3a4-c387b128a18d None admin] RBAC: Authorizing `identity:get_domain(domain_id=6f7c5c61950f492896a9990e2044e6d2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:01:10.944483 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900deffe-67bf-4b34-a3a4-c387b128a18d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:01:10.946067 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 589/1172] 10.222.0.26 () {56 vars in 1183 bytes} [Tue Sep 13 14:01:10 2022] GET /identity/v3/domains/6f7c5c61950f492896a9990e2044e6d2 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:01:10.951760 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e099c2-8f31-4e2f-977a-73390549a0b8 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:11.046959 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e099c2-8f31-4e2f-977a-73390549a0b8 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:11.079756 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec6bdb-1e5e-4005-baa8-94c189886e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:11.080287 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec6bdb-1e5e-4005-baa8-94c189886e63 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:11.080564 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec6bdb-1e5e-4005-baa8-94c189886e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:11.080832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec6bdb-1e5e-4005-baa8-94c189886e63 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:11.081507 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec6bdb-1e5e-4005-baa8-94c189886e63 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:01:11.082917 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec6bdb-1e5e-4005-baa8-94c189886e63 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:01:11.108597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 584/1173] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Sep 13 14:01:10 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:01:13.247998 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb997ea-0615-4d0c-950b-9a207d51d9c1 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:13.248520 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb997ea-0615-4d0c-950b-9a207d51d9c1 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:13.248520 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb997ea-0615-4d0c-950b-9a207d51d9c1 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:13.249907 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 590/1174] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:01:13.255305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9c5e0-42cf-479e-9b35-4eff671acbb5 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:13.255731 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9c5e0-42cf-479e-9b35-4eff671acbb5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:13.255862 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9c5e0-42cf-479e-9b35-4eff671acbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:13.273811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f3c9c5e0-42cf-479e-9b35-4eff671acbb5 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:01:13.274995 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f3c9c5e0-42cf-479e-9b35-4eff671acbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:01:13.284830 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:01:13.341553 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 585/1175] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:01:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:01:13.609114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb997ea-0615-4d0c-950b-9a207d51d9c1 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:13.708678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb997ea-0615-4d0c-950b-9a207d51d9c1 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:13.740658 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20cb397-00ce-43fc-aa0e-bf446628531d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:13.741357 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cb397-00ce-43fc-aa0e-bf446628531d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:13.741632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cb397-00ce-43fc-aa0e-bf446628531d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:13.741896 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cb397-00ce-43fc-aa0e-bf446628531d None admin] PATH_INFO: `/v3/domains/6f7c5c61950f492896a9990e2044e6d2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:13.742992 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20cb397-00ce-43fc-aa0e-bf446628531d None admin] RBAC: Authorizing `identity:get_domain(domain_id=6f7c5c61950f492896a9990e2044e6d2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:01:13.744408 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20cb397-00ce-43fc-aa0e-bf446628531d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:01:13.745999 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 591/1176] 10.222.0.26 () {56 vars in 1183 bytes} [Tue Sep 13 14:01:13 2022] GET /identity/v3/domains/6f7c5c61950f492896a9990e2044e6d2 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:01:13.752331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9c5e0-42cf-479e-9b35-4eff671acbb5 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:13.846765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9c5e0-42cf-479e-9b35-4eff671acbb5 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:13.880171 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7677e-8d47-4d1d-a4ee-eb084be5d35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:13.880706 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7677e-8d47-4d1d-a4ee-eb084be5d35a None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:13.880980 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7677e-8d47-4d1d-a4ee-eb084be5d35a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:13.881277 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7677e-8d47-4d1d-a4ee-eb084be5d35a None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:13.881922 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7677e-8d47-4d1d-a4ee-eb084be5d35a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:01:13.883337 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7677e-8d47-4d1d-a4ee-eb084be5d35a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:01:13.899885 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:01:13.906067 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 586/1177] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 13 14:01:13 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:01:16.127348 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758614fe-aee3-402f-807d-cf004498d3fc None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:16.127889 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758614fe-aee3-402f-807d-cf004498d3fc None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:16.127889 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758614fe-aee3-402f-807d-cf004498d3fc None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:16.129256 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 592/1178] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:01:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:01:16.134346 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafcf17-12c4-4a37-8663-6eb438324a3c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:16.134748 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafcf17-12c4-4a37-8663-6eb438324a3c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:16.134890 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafcf17-12c4-4a37-8663-6eb438324a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:16.152594 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-9aafcf17-12c4-4a37-8663-6eb438324a3c None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:01:16.153785 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9aafcf17-12c4-4a37-8663-6eb438324a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:01:16.218438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 587/1179] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:01:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:01:16.489082 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758614fe-aee3-402f-807d-cf004498d3fc None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:16.516691 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:01:16.589845 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758614fe-aee3-402f-807d-cf004498d3fc None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:16.623614 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65630b8-0782-4931-8867-9a838a274780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:16.624237 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65630b8-0782-4931-8867-9a838a274780 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:16.624514 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65630b8-0782-4931-8867-9a838a274780 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:16.624783 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65630b8-0782-4931-8867-9a838a274780 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:16.635178 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65630b8-0782-4931-8867-9a838a274780 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 14:01:16.639970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-a65630b8-0782-4931-8867-9a838a274780 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 14:01:16.639970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:01:16.639970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:01:16.639970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:01:16.639970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:01:16.639970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:01:16.639970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:01:16.639970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:01:16.639970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:01:16.639970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:01:16.639970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:01:16.639970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:01:16.639970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 14:01:16.639970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 14:01:16.639970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 14:01:16.639970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 14:01:16.641625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 14:01:16.641625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 14:01:16.641625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 14:01:16.641625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 14:01:16.641625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:01:16.641625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:01:16.641625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:01:16.641625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:01:16.641625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:01:16.641625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:01:16.641625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:01:16.641625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:01:16.641625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:01:16.641625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:01:16.641625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:01:16.641625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:01:16.642665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:01:16.642665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:01:16.642665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:01:16.642665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:01:16.642665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 14:01:16.642665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 14:01:16.642665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 14:01:16.642665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 14:01:16.642665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 14:01:16.642665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 14:01:16.642665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 14:01:16.642665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:01:16.642665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 593/1180] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 14:01:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:01:16.647677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafcf17-12c4-4a37-8663-6eb438324a3c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:16.748560 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafcf17-12c4-4a37-8663-6eb438324a3c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:16.778128 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:01:16.784943 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68538d-40e8-4370-9178-8093cb61fbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:16.785570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68538d-40e8-4370-9178-8093cb61fbce None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:16.785848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68538d-40e8-4370-9178-8093cb61fbce None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:16.786118 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68538d-40e8-4370-9178-8093cb61fbce None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:16.786773 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec68538d-40e8-4370-9178-8093cb61fbce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:01:16.787074 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec68538d-40e8-4370-9178-8093cb61fbce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:01:16.788442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec68538d-40e8-4370-9178-8093cb61fbce None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:01:16.796268 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 588/1181] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 14:01:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:01:16.802243 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65630b8-0782-4931-8867-9a838a274780 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:16.884583 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:01:16.899738 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65630b8-0782-4931-8867-9a838a274780 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:16.931711 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb7edf-6cdd-4720-a05c-58b158fffb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:16.932313 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb7edf-6cdd-4720-a05c-58b158fffb1f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:16.932587 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb7edf-6cdd-4720-a05c-58b158fffb1f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:16.932854 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb7edf-6cdd-4720-a05c-58b158fffb1f None admin] PATH_INFO: `/v3/users/681d5e92ceb24ac9832aa02982a521bd` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:16.945945 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb7edf-6cdd-4720-a05c-58b158fffb1f None admin] RBAC: Authorizing `identity:get_user(user_id=681d5e92ceb24ac9832aa02982a521bd)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:01:16.947313 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb7edf-6cdd-4720-a05c-58b158fffb1f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:01:16.948873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 594/1182] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 14:01:16 2022] GET /identity/v3/users/681d5e92ceb24ac9832aa02982a521bd => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:01:16.955168 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68538d-40e8-4370-9178-8093cb61fbce None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:17.049940 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68538d-40e8-4370-9178-8093cb61fbce None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:17.081821 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e00e1-fa49-4fe7-92d5-9e1d4f8dce91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:17.082397 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e00e1-fa49-4fe7-92d5-9e1d4f8dce91 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:17.082667 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e00e1-fa49-4fe7-92d5-9e1d4f8dce91 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:17.082929 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e00e1-fa49-4fe7-92d5-9e1d4f8dce91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:17.137961 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:01:17.147873 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e00e1-fa49-4fe7-92d5-9e1d4f8dce91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:01:17.149324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e00e1-fa49-4fe7-92d5-9e1d4f8dce91 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:01:17.243775 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 589/1183] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 14:01:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 14:01:17.249583 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb7edf-6cdd-4720-a05c-58b158fffb1f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:17.344115 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb7edf-6cdd-4720-a05c-58b158fffb1f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:17.376412 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e8705-c29f-4f08-941f-99bbde9b4dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:17.377012 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e8705-c29f-4f08-941f-99bbde9b4dba None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:17.377314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e8705-c29f-4f08-941f-99bbde9b4dba None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:17.377582 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e8705-c29f-4f08-941f-99bbde9b4dba None admin] PATH_INFO: `/v3/projects/d46e408753114f75a44be257f31e65c5` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:17.378682 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e8705-c29f-4f08-941f-99bbde9b4dba None admin] RBAC: Authorizing `identity:get_project(project_id=d46e408753114f75a44be257f31e65c5)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:01:17.380087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e8705-c29f-4f08-941f-99bbde9b4dba None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:01:17.381714 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 595/1184] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 14:01:17 2022] GET /identity/v3/projects/d46e408753114f75a44be257f31e65c5 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:01:17.387525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e00e1-fa49-4fe7-92d5-9e1d4f8dce91 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:17.475900 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:01:17.484620 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e00e1-fa49-4fe7-92d5-9e1d4f8dce91 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:17.517590 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff422e-a09f-4f68-b632-581b2d32041c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:17.518178 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff422e-a09f-4f68-b632-581b2d32041c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:17.518458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff422e-a09f-4f68-b632-581b2d32041c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:17.518726 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff422e-a09f-4f68-b632-581b2d32041c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:17.519434 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff422e-a09f-4f68-b632-581b2d32041c None admin] RBAC: Adding query filter params (role.id=6dcc8495d2b24b3eab63dd656eb4eb6d, scope.project.id=d46e408753114f75a44be257f31e65c5, user.id=681d5e92ceb24ac9832aa02982a521bd) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:01:17.519739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff422e-a09f-4f68-b632-581b2d32041c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:01:17.521177 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff422e-a09f-4f68-b632-581b2d32041c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:01:17.526398 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 590/1185] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 14:01:17 2022] GET /identity/v3/role_assignments?user.id=681d5e92ceb24ac9832aa02982a521bd&scope.project.id=d46e408753114f75a44be257f31e65c5&role.id=6dcc8495d2b24b3eab63dd656eb4eb6d => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:01:19.622911 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3be4b-720f-4588-9135-786edd686d16 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:19.623336 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3be4b-720f-4588-9135-786edd686d16 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:19.623449 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3be4b-720f-4588-9135-786edd686d16 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:19.624802 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 596/1186] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:01:19.630817 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08e66a-73f6-4f44-8f5e-183a2919de48 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:19.631225 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08e66a-73f6-4f44-8f5e-183a2919de48 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:19.631364 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08e66a-73f6-4f44-8f5e-183a2919de48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:19.649172 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5e08e66a-73f6-4f44-8f5e-183a2919de48 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:01:19.650340 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5e08e66a-73f6-4f44-8f5e-183a2919de48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:01:19.714557 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 591/1187] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:01:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:01:19.987238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3be4b-720f-4588-9135-786edd686d16 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:20.001775 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:01:20.085003 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3be4b-720f-4588-9135-786edd686d16 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:20.117736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd96ea9-ce3a-45eb-bed5-c2ee2397952e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:20.118334 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd96ea9-ce3a-45eb-bed5-c2ee2397952e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:20.118605 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd96ea9-ce3a-45eb-bed5-c2ee2397952e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:20.118867 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd96ea9-ce3a-45eb-bed5-c2ee2397952e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:20.128655 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd96ea9-ce3a-45eb-bed5-c2ee2397952e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 14:01:20.133401 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-dbd96ea9-ce3a-45eb-bed5-c2ee2397952e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 14:01:20.133401 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:01:20.133401 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:01:20.133401 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:01:20.133401 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:01:20.133401 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:01:20.133401 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:01:20.133401 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:01:20.133401 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:01:20.133401 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:01:20.133401 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:01:20.133401 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:01:20.133401 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 14:01:20.133401 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 14:01:20.133401 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 14:01:20.133401 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 14:01:20.134493 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 14:01:20.134493 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 14:01:20.134493 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 14:01:20.134493 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 14:01:20.134493 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:01:20.134493 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:01:20.134493 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:01:20.134493 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:01:20.134493 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:01:20.134493 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:01:20.134493 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:01:20.134493 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:01:20.134493 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:01:20.134493 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:01:20.134493 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:01:20.134493 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:01:20.135637 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:01:20.135637 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:01:20.135637 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:01:20.135637 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:01:20.135637 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 14:01:20.135637 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 14:01:20.135637 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 14:01:20.135637 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 14:01:20.135637 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 14:01:20.135637 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 14:01:20.135637 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 14:01:20.135637 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:01:20.135637 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 597/1188] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 14:01:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:01:20.140481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08e66a-73f6-4f44-8f5e-183a2919de48 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:20.231707 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:01:20.247748 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08e66a-73f6-4f44-8f5e-183a2919de48 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:20.284454 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4087a85-7cf2-4fb2-b16f-a683a0cd5e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:20.285050 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4087a85-7cf2-4fb2-b16f-a683a0cd5e63 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:20.285356 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4087a85-7cf2-4fb2-b16f-a683a0cd5e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:20.285627 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4087a85-7cf2-4fb2-b16f-a683a0cd5e63 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:20.286286 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4087a85-7cf2-4fb2-b16f-a683a0cd5e63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:01:20.286588 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4087a85-7cf2-4fb2-b16f-a683a0cd5e63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:01:20.287966 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4087a85-7cf2-4fb2-b16f-a683a0cd5e63 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:01:20.295868 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 592/1189] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 14:01:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:01:20.303227 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd96ea9-ce3a-45eb-bed5-c2ee2397952e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:20.370347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:01:20.398592 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd96ea9-ce3a-45eb-bed5-c2ee2397952e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:20.431074 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ece8c-f5df-4484-b1b1-6f20d37b9164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:20.431666 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ece8c-f5df-4484-b1b1-6f20d37b9164 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:20.431938 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ece8c-f5df-4484-b1b1-6f20d37b9164 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:20.432203 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ece8c-f5df-4484-b1b1-6f20d37b9164 None admin] PATH_INFO: `/v3/users/681d5e92ceb24ac9832aa02982a521bd` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:20.433319 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ece8c-f5df-4484-b1b1-6f20d37b9164 None admin] RBAC: Authorizing `identity:get_user(user_id=681d5e92ceb24ac9832aa02982a521bd)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:01:20.434729 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ece8c-f5df-4484-b1b1-6f20d37b9164 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:01:20.436270 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 598/1190] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 14:01:20 2022] GET /identity/v3/users/681d5e92ceb24ac9832aa02982a521bd => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:01:20.441875 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4087a85-7cf2-4fb2-b16f-a683a0cd5e63 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:20.542918 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4087a85-7cf2-4fb2-b16f-a683a0cd5e63 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:20.576462 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f1d7c-2769-45eb-85d1-219e09e84d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:20.577071 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f1d7c-2769-45eb-85d1-219e09e84d50 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:20.577381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f1d7c-2769-45eb-85d1-219e09e84d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:20.577647 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f1d7c-2769-45eb-85d1-219e09e84d50 None admin] PATH_INFO: `/v3/projects/d46e408753114f75a44be257f31e65c5` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:20.578769 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f1d7c-2769-45eb-85d1-219e09e84d50 None admin] RBAC: Authorizing `identity:get_project(project_id=d46e408753114f75a44be257f31e65c5)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:01:20.580193 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f1d7c-2769-45eb-85d1-219e09e84d50 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:01:20.581849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 593/1191] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 14:01:20 2022] GET /identity/v3/projects/d46e408753114f75a44be257f31e65c5 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:01:20.587790 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ece8c-f5df-4484-b1b1-6f20d37b9164 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:20.686792 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ece8c-f5df-4484-b1b1-6f20d37b9164 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:20.718380 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dc54d-cbdf-48f8-bce3-431d0aee7008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:20.719498 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dc54d-cbdf-48f8-bce3-431d0aee7008 None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:20.719772 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dc54d-cbdf-48f8-bce3-431d0aee7008 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:20.720032 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dc54d-cbdf-48f8-bce3-431d0aee7008 None admin] PATH_INFO: `/v3/projects/d46e408753114f75a44be257f31e65c5/users/681d5e92ceb24ac9832aa02982a521bd/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:20.722062 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90dc54d-cbdf-48f8-bce3-431d0aee7008 None admin] RBAC: Authorizing `identity:create_grant(project_id=d46e408753114f75a44be257f31e65c5, user_id=681d5e92ceb24ac9832aa02982a521bd, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:01:20.723465 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90dc54d-cbdf-48f8-bce3-431d0aee7008 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:01:20.731879 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:01:20.737628 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 599/1192] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 13 14:01:20 2022] PUT /identity/v3/projects/d46e408753114f75a44be257f31e65c5/users/681d5e92ceb24ac9832aa02982a521bd/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:01:22.818373 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2ec85-690c-49a4-acda-d4db7387e972 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:22.818910 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2ec85-690c-49a4-acda-d4db7387e972 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:22.818910 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2ec85-690c-49a4-acda-d4db7387e972 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:22.820285 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 594/1193] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:01:22.825508 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e928d-e2e2-4170-a409-98ab9cafe994 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:22.825962 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e928d-e2e2-4170-a409-98ab9cafe994 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:22.826062 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e928d-e2e2-4170-a409-98ab9cafe994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:22.843635 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-8e8e928d-e2e2-4170-a409-98ab9cafe994 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:01:22.844834 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8e8e928d-e2e2-4170-a409-98ab9cafe994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:01:22.908483 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 600/1194] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:01:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:01:23.174370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2ec85-690c-49a4-acda-d4db7387e972 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:23.193062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:01:23.273875 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2ec85-690c-49a4-acda-d4db7387e972 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:23.306876 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51eb76d-797f-4b71-ae6c-6f90b69e026d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:23.307481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51eb76d-797f-4b71-ae6c-6f90b69e026d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:23.307756 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51eb76d-797f-4b71-ae6c-6f90b69e026d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:23.308023 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51eb76d-797f-4b71-ae6c-6f90b69e026d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:23.318380 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51eb76d-797f-4b71-ae6c-6f90b69e026d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 14:01:23.323144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-b51eb76d-797f-4b71-ae6c-6f90b69e026d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 14:01:23.323144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:01:23.323144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:01:23.323144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:01:23.323144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:01:23.323144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:01:23.323144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:01:23.323144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:01:23.323144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:01:23.323144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:01:23.323144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:01:23.323144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:01:23.323144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 14:01:23.323144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 14:01:23.323144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 14:01:23.323144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 14:01:23.324195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 14:01:23.324195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 14:01:23.324195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 14:01:23.324195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 14:01:23.324195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:01:23.324195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:01:23.324195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:01:23.324195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:01:23.324195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:01:23.324195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:01:23.324195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:01:23.324195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:01:23.324195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:01:23.324195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:01:23.324195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:01:23.324195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:01:23.325241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:01:23.325241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:01:23.325241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:01:23.325241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:01:23.325241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 14:01:23.325241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 14:01:23.325241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 14:01:23.325241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 14:01:23.325241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 14:01:23.325241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 14:01:23.325241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 14:01:23.325241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:01:23.325241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 595/1195] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 14:01:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:01:23.330252 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e928d-e2e2-4170-a409-98ab9cafe994 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:23.424542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e928d-e2e2-4170-a409-98ab9cafe994 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:23.451696 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:01:23.457841 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226f776-665c-4466-82b0-19f88b5ca58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:23.458421 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226f776-665c-4466-82b0-19f88b5ca58c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:23.458690 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226f776-665c-4466-82b0-19f88b5ca58c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:23.458953 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226f776-665c-4466-82b0-19f88b5ca58c None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:23.459597 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226f776-665c-4466-82b0-19f88b5ca58c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:01:23.459891 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226f776-665c-4466-82b0-19f88b5ca58c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:01:23.461276 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226f776-665c-4466-82b0-19f88b5ca58c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:01:23.469041 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 601/1196] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 14:01:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:01:23.474829 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51eb76d-797f-4b71-ae6c-6f90b69e026d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:23.549984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:01:23.573061 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51eb76d-797f-4b71-ae6c-6f90b69e026d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:23.605385 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51c63c-66a9-4409-bfc1-451b6caf2d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:23.605988 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51c63c-66a9-4409-bfc1-451b6caf2d5d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:23.606264 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51c63c-66a9-4409-bfc1-451b6caf2d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:23.606531 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51c63c-66a9-4409-bfc1-451b6caf2d5d None admin] PATH_INFO: `/v3/users/681d5e92ceb24ac9832aa02982a521bd` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:23.607633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51c63c-66a9-4409-bfc1-451b6caf2d5d None admin] RBAC: Authorizing `identity:get_user(user_id=681d5e92ceb24ac9832aa02982a521bd)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:01:23.609051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51c63c-66a9-4409-bfc1-451b6caf2d5d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:01:23.611147 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 596/1197] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Sep 13 14:01:23 2022] GET /identity/v3/users/681d5e92ceb24ac9832aa02982a521bd => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:01:23.616823 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226f776-665c-4466-82b0-19f88b5ca58c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:23.712826 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226f776-665c-4466-82b0-19f88b5ca58c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:23.745064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71109070-fd9e-49a1-87f9-411822b182cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:23.745677 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71109070-fd9e-49a1-87f9-411822b182cf None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:23.745949 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71109070-fd9e-49a1-87f9-411822b182cf None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:23.746213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71109070-fd9e-49a1-87f9-411822b182cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:23.801463 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:01:23.811079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71109070-fd9e-49a1-87f9-411822b182cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:01:23.812507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71109070-fd9e-49a1-87f9-411822b182cf None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:01:23.908185 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 602/1198] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 14:01:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 14:01:23.914062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51c63c-66a9-4409-bfc1-451b6caf2d5d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:24.010627 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51c63c-66a9-4409-bfc1-451b6caf2d5d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:24.043400 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7536cd-5ec2-4bd0-9be0-6b770014464b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:24.044004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7536cd-5ec2-4bd0-9be0-6b770014464b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:24.044281 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7536cd-5ec2-4bd0-9be0-6b770014464b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:24.044549 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7536cd-5ec2-4bd0-9be0-6b770014464b None admin] PATH_INFO: `/v3/projects/d46e408753114f75a44be257f31e65c5` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:24.045666 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7536cd-5ec2-4bd0-9be0-6b770014464b None admin] RBAC: Authorizing `identity:get_project(project_id=d46e408753114f75a44be257f31e65c5)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:01:24.047610 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7536cd-5ec2-4bd0-9be0-6b770014464b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:01:24.049217 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 597/1199] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Sep 13 14:01:23 2022] GET /identity/v3/projects/d46e408753114f75a44be257f31e65c5 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:01:24.055197 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71109070-fd9e-49a1-87f9-411822b182cf None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:01:24.140888 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:01:24.150027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71109070-fd9e-49a1-87f9-411822b182cf None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:01:24.182748 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf49a6e-3adc-4d0e-93db-9124781f2d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:01:24.183322 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf49a6e-3adc-4d0e-93db-9124781f2d6d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:01:24.183591 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf49a6e-3adc-4d0e-93db-9124781f2d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:01:24.183853 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf49a6e-3adc-4d0e-93db-9124781f2d6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:01:24.184561 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf49a6e-3adc-4d0e-93db-9124781f2d6d None admin] RBAC: Adding query filter params (role.id=6dcc8495d2b24b3eab63dd656eb4eb6d, scope.project.id=d46e408753114f75a44be257f31e65c5, user.id=681d5e92ceb24ac9832aa02982a521bd) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:01:24.184859 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf49a6e-3adc-4d0e-93db-9124781f2d6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:01:24.186292 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf49a6e-3adc-4d0e-93db-9124781f2d6d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:01:24.192349 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 603/1200] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 14:01:24 2022] GET /identity/v3/role_assignments?user.id=681d5e92ceb24ac9832aa02982a521bd&scope.project.id=d46e408753114f75a44be257f31e65c5&role.id=6dcc8495d2b24b3eab63dd656eb4eb6d => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:01:34.039355 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=94 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:01:34.189873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=22 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:19.339450 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195df2b-7324-4a92-a6f2-3927b88acca8 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:19.340070 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195df2b-7324-4a92-a6f2-3927b88acca8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:19.340070 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195df2b-7324-4a92-a6f2-3927b88acca8 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:19.341759 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 598/1201] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:02:19.348466 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c4faf-38cd-4628-901e-46a8424c357c None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:19.348948 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c4faf-38cd-4628-901e-46a8424c357c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:19.349049 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c4faf-38cd-4628-901e-46a8424c357c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:19.369559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-446c4faf-38cd-4628-901e-46a8424c357c None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:02:19.370870 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-446c4faf-38cd-4628-901e-46a8424c357c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:02:19.457613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 604/1202] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:02:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:02:19.757185 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195df2b-7324-4a92-a6f2-3927b88acca8 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:19.896478 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195df2b-7324-4a92-a6f2-3927b88acca8 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:19.938808 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bc88c-9424-443c-9c6c-4486bf8dfd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:19.939493 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bc88c-9424-443c-9c6c-4486bf8dfd2b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:19.939772 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bc88c-9424-443c-9c6c-4486bf8dfd2b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:19.940043 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bc88c-9424-443c-9c6c-4486bf8dfd2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:19.953912 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bc88c-9424-443c-9c6c-4486bf8dfd2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:19.955405 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bc88c-9424-443c-9c6c-4486bf8dfd2b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:19.971499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-123bc88c-9424-443c-9c6c-4486bf8dfd2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:02:19.971499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:19.971499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:19.971499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:19.971499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:19.971499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:19.971499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:19.971499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:19.971499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:19.971499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:19.971499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:19.971499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:19.971499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 14:02:19.971499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 14:02:19.971499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 14:02:19.971499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 14:02:19.972786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:19.972786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:19.972786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:19.972786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:19.972786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:19.972786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:19.972786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:19.972786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:19.972786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:19.972786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:19.972786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:19.972786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:19.972786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:19.972786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:19.972786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:19.972786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:19.972786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 14:02:19.973799 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 14:02:19.973799 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:02:19.973799 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:02:19.973799 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 599/1203] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:02:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:19.978839 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c4faf-38cd-4628-901e-46a8424c357c None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:20.110529 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c4faf-38cd-4628-901e-46a8424c357c None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:20.151027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:20.157961 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b1e24-840d-4a74-b9bd-2a79de7dbfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:20.158588 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b1e24-840d-4a74-b9bd-2a79de7dbfbb None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:20.158902 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b1e24-840d-4a74-b9bd-2a79de7dbfbb None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:20.159128 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b1e24-840d-4a74-b9bd-2a79de7dbfbb None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:20.159760 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b1e24-840d-4a74-b9bd-2a79de7dbfbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:20.160060 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b1e24-840d-4a74-b9bd-2a79de7dbfbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:20.161456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b1e24-840d-4a74-b9bd-2a79de7dbfbb None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:20.178034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 605/1204] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 14:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:20.183934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bc88c-9424-443c-9c6c-4486bf8dfd2b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:20.245270 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:20.314577 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bc88c-9424-443c-9c6c-4486bf8dfd2b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:20.361669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c02a0-96d6-4a88-ad64-4530a0f91d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:20.363476 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c02a0-96d6-4a88-ad64-4530a0f91d7c None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:20.363790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c02a0-96d6-4a88-ad64-4530a0f91d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:20.364039 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c02a0-96d6-4a88-ad64-4530a0f91d7c None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:20.364690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c02a0-96d6-4a88-ad64-4530a0f91d7c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:20.366543 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c02a0-96d6-4a88-ad64-4530a0f91d7c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:20.413190 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 600/1205] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Sep 13 14:02:20 2022] POST /identity/v3/users => generated 251 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:02:22.817011 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c00cb9-95b4-42f5-9cef-5402084f58e5 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:22.817605 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c00cb9-95b4-42f5-9cef-5402084f58e5 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:22.817605 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c00cb9-95b4-42f5-9cef-5402084f58e5 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:22.818922 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 606/1206] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:02:22.827297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97687c5d-62b3-45ca-a5bb-70dc67c8c367 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:22.829271 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97687c5d-62b3-45ca-a5bb-70dc67c8c367 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:22.829271 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97687c5d-62b3-45ca-a5bb-70dc67c8c367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:22.847028 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-97687c5d-62b3-45ca-a5bb-70dc67c8c367 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:02:22.848217 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-97687c5d-62b3-45ca-a5bb-70dc67c8c367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:02:22.928668 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 601/1207] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:02:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:02:23.244088 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c00cb9-95b4-42f5-9cef-5402084f58e5 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:23.367285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c00cb9-95b4-42f5-9cef-5402084f58e5 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:23.406825 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b633c-6550-4b98-a333-3a67e3695273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:23.407991 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b633c-6550-4b98-a333-3a67e3695273 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:23.408267 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b633c-6550-4b98-a333-3a67e3695273 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:23.408572 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b633c-6550-4b98-a333-3a67e3695273 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:23.423807 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b633c-6550-4b98-a333-3a67e3695273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 14:02:23.428827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-c12b633c-6550-4b98-a333-3a67e3695273 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 14:02:23.428827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:23.428827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:23.428827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:23.428827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:23.428827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:23.428827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:23.428827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:23.428827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:23.428827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:23.428827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:23.428827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:23.428827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 14:02:23.428827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 14:02:23.428827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 14:02:23.428827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 14:02:23.430043 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 14:02:23.430043 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 14:02:23.430043 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 14:02:23.430043 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 14:02:23.430043 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:23.430043 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:23.430043 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:23.430043 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:23.430043 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:23.430043 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:23.430043 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:23.430043 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:23.430043 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:23.430043 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:23.430043 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:23.430043 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:23.430904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:23.430904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:23.430904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:23.430904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:23.430904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 14:02:23.430904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 14:02:23.430904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 14:02:23.430904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 14:02:23.430904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 14:02:23.430904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 14:02:23.430904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 14:02:23.430904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:02:23.430904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 607/1208] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 13 14:02:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:23.437409 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97687c5d-62b3-45ca-a5bb-70dc67c8c367 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:23.487226 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:23.561865 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97687c5d-62b3-45ca-a5bb-70dc67c8c367 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:23.602085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af89eb-7b5f-4517-97de-fba18673e8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:23.603188 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af89eb-7b5f-4517-97de-fba18673e8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:23.603466 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af89eb-7b5f-4517-97de-fba18673e8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:23.603738 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af89eb-7b5f-4517-97de-fba18673e8d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:23.604399 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af89eb-7b5f-4517-97de-fba18673e8d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:23.604697 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af89eb-7b5f-4517-97de-fba18673e8d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:23.606094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af89eb-7b5f-4517-97de-fba18673e8d0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:23.617472 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 602/1209] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 13 14:02:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:23.622787 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b633c-6550-4b98-a333-3a67e3695273 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:23.690196 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:23.755106 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b633c-6550-4b98-a333-3a67e3695273 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:23.795186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4a0be-c38b-49eb-9495-7c92ba832605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:23.795821 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4a0be-c38b-49eb-9495-7c92ba832605 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:23.796098 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4a0be-c38b-49eb-9495-7c92ba832605 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:23.796370 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4a0be-c38b-49eb-9495-7c92ba832605 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:23.807811 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4a0be-c38b-49eb-9495-7c92ba832605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:23.809334 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4a0be-c38b-49eb-9495-7c92ba832605 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:23.827673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-aaf4a0be-c38b-49eb-9495-7c92ba832605 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:02:23.827673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:23.827673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:23.827673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:23.827673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:23.827673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:23.827673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:23.827673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:23.827673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:23.827673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:23.827673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:23.827673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:23.827673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 14:02:23.827673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 14:02:23.827673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 14:02:23.827673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 14:02:23.829285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:23.829285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:23.829285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:23.829285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:23.829285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:23.829285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:23.829285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:23.829285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:23.829285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:23.829285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:23.829285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:23.829285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:23.829285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:23.829285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:23.829285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:23.829285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:23.829285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 14:02:23.830195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 14:02:23.830195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:02:23.830195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:02:23.830195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 608/1210] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:02:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:23.835359 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af89eb-7b5f-4517-97de-fba18673e8d0 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:23.951433 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:23.955741 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af89eb-7b5f-4517-97de-fba18673e8d0 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:24.001791 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4248253-da1b-46be-9f62-3254d66dbf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:24.004120 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4248253-da1b-46be-9f62-3254d66dbf6f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:24.004120 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4248253-da1b-46be-9f62-3254d66dbf6f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:24.004120 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4248253-da1b-46be-9f62-3254d66dbf6f None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:24.004120 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4248253-da1b-46be-9f62-3254d66dbf6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:24.004413 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4248253-da1b-46be-9f62-3254d66dbf6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:24.005766 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4248253-da1b-46be-9f62-3254d66dbf6f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:24.018345 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 603/1211] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 14:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:24.023826 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4a0be-c38b-49eb-9495-7c92ba832605 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:24.138415 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4a0be-c38b-49eb-9495-7c92ba832605 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:24.139892 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:24.179346 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1b046-08cd-4793-b903-7abd4522eaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:24.180009 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1b046-08cd-4793-b903-7abd4522eaf3 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:24.180286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1b046-08cd-4793-b903-7abd4522eaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:24.180549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1b046-08cd-4793-b903-7abd4522eaf3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:24.190296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1b046-08cd-4793-b903-7abd4522eaf3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:24.191934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1b046-08cd-4793-b903-7abd4522eaf3 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:24.205393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-6cd1b046-08cd-4793-b903-7abd4522eaf3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 14:02:24.205393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:24.205393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:24.205393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:24.205393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:24.205393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:24.205393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:24.205393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:24.205393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:24.205393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:24.205393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:24.205393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:24.205393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 14:02:24.205393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 14:02:24.205393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 14:02:24.205393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 14:02:24.209280 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:24.209280 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:24.209280 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 14:02:24.209280 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 14:02:24.209280 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 14:02:24.209280 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 14:02:24.209280 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:24.209280 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:24.209280 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:24.209280 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:24.209280 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:24.209280 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:24.209280 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:24.209280 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:24.209280 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:24.209280 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:24.209280 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:24.209280 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:24.210479 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:24.210479 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:24.210479 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 14:02:24.210479 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 14:02:24.210479 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 14:02:24.210479 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 14:02:24.210479 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 14:02:24.210479 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 14:02:24.210479 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 14:02:24.210479 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:02:24.210479 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 609/1212] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:02:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 14:02:24.213473 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4248253-da1b-46be-9f62-3254d66dbf6f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:24.369343 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4248253-da1b-46be-9f62-3254d66dbf6f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:24.408970 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d3460-41a3-43b1-b9f1-46906733271f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:24.408970 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d3460-41a3-43b1-b9f1-46906733271f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:24.408970 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d3460-41a3-43b1-b9f1-46906733271f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:24.409497 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d3460-41a3-43b1-b9f1-46906733271f None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:24.409772 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d3460-41a3-43b1-b9f1-46906733271f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:24.410068 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d3460-41a3-43b1-b9f1-46906733271f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:24.411560 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d3460-41a3-43b1-b9f1-46906733271f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:24.439486 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 604/1213] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Sep 13 14:02:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:24.440867 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1b046-08cd-4793-b903-7abd4522eaf3 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:24.550792 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1b046-08cd-4793-b903-7abd4522eaf3 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:24.585683 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ffd02-95b2-4586-99c2-9db337443d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:24.586281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ffd02-95b2-4586-99c2-9db337443d35 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:24.586562 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ffd02-95b2-4586-99c2-9db337443d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:24.586830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ffd02-95b2-4586-99c2-9db337443d35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:24.618378 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:24.661496 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ffd02-95b2-4586-99c2-9db337443d35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:24.662862 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ffd02-95b2-4586-99c2-9db337443d35 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:24.774814 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 610/1214] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 14:02:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 14:02:24.780519 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d3460-41a3-43b1-b9f1-46906733271f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:24.802714 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:24.896529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d3460-41a3-43b1-b9f1-46906733271f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:24.936214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3efb8-1e4f-4eb8-92bc-c0a5d2305508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:24.936790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3efb8-1e4f-4eb8-92bc-c0a5d2305508 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:24.937069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3efb8-1e4f-4eb8-92bc-c0a5d2305508 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:24.937367 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3efb8-1e4f-4eb8-92bc-c0a5d2305508 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:24.948761 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3efb8-1e4f-4eb8-92bc-c0a5d2305508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:24.950245 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3efb8-1e4f-4eb8-92bc-c0a5d2305508 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:24.967019 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-60b3efb8-1e4f-4eb8-92bc-c0a5d2305508 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:02:24.967019 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:24.967019 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:24.967019 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:24.967019 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:24.967019 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:24.967019 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:24.967019 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:24.967019 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:24.967019 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:24.967019 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:24.967019 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:24.967019 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 14:02:24.967019 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 14:02:24.967019 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 14:02:24.967019 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 14:02:24.968568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:24.968568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:24.968568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:24.968568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:24.968568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:24.968568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:24.968568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:24.968568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:24.968568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:24.968568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:24.968568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:24.968568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:24.968568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:24.968568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:24.968568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:24.968568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:24.968568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 14:02:24.969637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 14:02:24.969637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:02:24.969637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:02:24.969637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 605/1215] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:02:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 14:02:24.974733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ffd02-95b2-4586-99c2-9db337443d35 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:25.059778 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:25.111238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ffd02-95b2-4586-99c2-9db337443d35 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:25.155849 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69aae3-0498-45ef-8c7f-14699d13985f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:25.156485 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69aae3-0498-45ef-8c7f-14699d13985f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:25.156761 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69aae3-0498-45ef-8c7f-14699d13985f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:25.157119 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69aae3-0498-45ef-8c7f-14699d13985f None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:25.158099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e69aae3-0498-45ef-8c7f-14699d13985f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:25.158375 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e69aae3-0498-45ef-8c7f-14699d13985f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:25.159764 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e69aae3-0498-45ef-8c7f-14699d13985f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:25.176566 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 611/1216] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 14:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:25.178076 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3efb8-1e4f-4eb8-92bc-c0a5d2305508 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:25.265453 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:25.299655 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3efb8-1e4f-4eb8-92bc-c0a5d2305508 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:25.353562 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70382c24-7b93-4633-8bcb-1100f978f04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:25.354254 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70382c24-7b93-4633-8bcb-1100f978f04e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:25.354599 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70382c24-7b93-4633-8bcb-1100f978f04e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:25.355045 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70382c24-7b93-4633-8bcb-1100f978f04e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:25.366728 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70382c24-7b93-4633-8bcb-1100f978f04e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:25.368748 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70382c24-7b93-4633-8bcb-1100f978f04e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:25.382336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-70382c24-7b93-4633-8bcb-1100f978f04e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 14:02:25.382336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:25.382336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:25.382336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:25.382336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:25.382336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:25.382336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:25.382336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:25.382336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:25.382336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:25.382336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:25.382336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:25.382336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 14:02:25.382336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 14:02:25.382336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 14:02:25.383628 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 14:02:25.383628 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:25.383628 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:25.383628 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:25.383628 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:25.383628 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:25.383628 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:25.383628 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:25.383628 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:25.383628 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:25.383628 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:25.383628 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:25.383628 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:25.383628 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:25.383628 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:25.383628 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:25.383628 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:25.385130 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 14:02:25.385130 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 14:02:25.385130 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 14:02:25.385130 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 14:02:25.385130 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 14:02:25.385130 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 14:02:25.385130 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 14:02:25.385130 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:02:25.385130 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 606/1217] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 14:02:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:25.390006 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69aae3-0498-45ef-8c7f-14699d13985f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:25.516831 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69aae3-0498-45ef-8c7f-14699d13985f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:25.542431 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:25.554655 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b863b7-6caf-498e-9e7d-674bba47103c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:25.555251 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b863b7-6caf-498e-9e7d-674bba47103c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:25.555526 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b863b7-6caf-498e-9e7d-674bba47103c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:25.555794 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b863b7-6caf-498e-9e7d-674bba47103c None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:25.556475 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b863b7-6caf-498e-9e7d-674bba47103c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:25.556773 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b863b7-6caf-498e-9e7d-674bba47103c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:25.558245 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b863b7-6caf-498e-9e7d-674bba47103c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:25.572693 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 612/1218] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 14:02:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:25.579328 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70382c24-7b93-4633-8bcb-1100f978f04e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:25.701030 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70382c24-7b93-4633-8bcb-1100f978f04e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:25.733430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:25.740241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02fd93-0f0a-43ce-932d-c5a06c19f093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:25.740913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02fd93-0f0a-43ce-932d-c5a06c19f093 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:25.741249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02fd93-0f0a-43ce-932d-c5a06c19f093 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:25.741534 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02fd93-0f0a-43ce-932d-c5a06c19f093 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:25.742390 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02fd93-0f0a-43ce-932d-c5a06c19f093 None admin] RBAC: Adding query filter params (role.id=0c389f21d4434ae0a32fc453a8f2050a, scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086, user.id=311397bfe2c04569852fca0cfcdbad66) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:25.742654 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02fd93-0f0a-43ce-932d-c5a06c19f093 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:25.744197 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02fd93-0f0a-43ce-932d-c5a06c19f093 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:25.750692 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 607/1219] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 14:02:25 2022] GET /identity/v3/role_assignments?user.id=311397bfe2c04569852fca0cfcdbad66&scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086&role.id=0c389f21d4434ae0a32fc453a8f2050a => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:27.903809 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec575475-b554-43e5-867d-a17a4b267e99 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:27.904414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec575475-b554-43e5-867d-a17a4b267e99 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:27.904414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec575475-b554-43e5-867d-a17a4b267e99 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:27.906217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 613/1220] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:02:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:02:27.911757 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d318c-b45a-4a3a-ae70-d4006312426d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:27.912205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d318c-b45a-4a3a-ae70-d4006312426d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:27.912314 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d318c-b45a-4a3a-ae70-d4006312426d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:27.932283 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-957d318c-b45a-4a3a-ae70-d4006312426d None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:02:27.933843 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-957d318c-b45a-4a3a-ae70-d4006312426d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:02:28.010587 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 608/1221] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:02:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:02:28.285213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec575475-b554-43e5-867d-a17a4b267e99 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:28.399797 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec575475-b554-43e5-867d-a17a4b267e99 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:28.437400 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82005f8-850e-4f65-b981-07d109592f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:28.438052 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82005f8-850e-4f65-b981-07d109592f40 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:28.438329 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82005f8-850e-4f65-b981-07d109592f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:28.438597 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82005f8-850e-4f65-b981-07d109592f40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:28.448982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82005f8-850e-4f65-b981-07d109592f40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 14:02:28.454394 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-e82005f8-850e-4f65-b981-07d109592f40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 14:02:28.454394 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:28.454394 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:28.454394 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:28.454394 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:28.454394 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:28.454394 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:28.454394 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:28.454394 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:28.454394 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:28.454394 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:28.454394 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:28.454394 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 14:02:28.454394 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 14:02:28.454394 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 14:02:28.454394 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 14:02:28.455511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 14:02:28.455511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 14:02:28.455511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 14:02:28.455511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 14:02:28.455511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:28.455511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:28.455511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:28.455511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:28.455511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:28.455511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:28.455511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:28.455511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:28.455511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:28.455511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:28.455511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:28.455511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:28.456432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:28.456432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:28.456432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:28.456432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:28.456432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 14:02:28.456432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 14:02:28.456432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 14:02:28.456432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 14:02:28.456432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 14:02:28.456432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 14:02:28.456432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 14:02:28.456432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:02:28.456432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 614/1222] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 13 14:02:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:28.461968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d318c-b45a-4a3a-ae70-d4006312426d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:28.579110 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d318c-b45a-4a3a-ae70-d4006312426d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:28.605519 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:28.620934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6a438-cec2-41f4-979b-9f045b6d3d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:28.621585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6a438-cec2-41f4-979b-9f045b6d3d89 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:28.621866 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6a438-cec2-41f4-979b-9f045b6d3d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:28.622137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6a438-cec2-41f4-979b-9f045b6d3d89 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:28.622832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6a438-cec2-41f4-979b-9f045b6d3d89 None admin] RBAC: Adding query filter params (name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:28.623134 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6a438-cec2-41f4-979b-9f045b6d3d89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:28.625111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6a438-cec2-41f4-979b-9f045b6d3d89 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:28.634282 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 609/1223] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 13 14:02:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:28.640651 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82005f8-850e-4f65-b981-07d109592f40 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:28.685870 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:28.745197 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82005f8-850e-4f65-b981-07d109592f40 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:28.780096 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2096f9-a854-4af4-ae38-8a2f343c42ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:28.780718 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2096f9-a854-4af4-ae38-8a2f343c42ff None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:28.780990 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2096f9-a854-4af4-ae38-8a2f343c42ff None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:28.781285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2096f9-a854-4af4-ae38-8a2f343c42ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:28.791473 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2096f9-a854-4af4-ae38-8a2f343c42ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:28.792906 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2096f9-a854-4af4-ae38-8a2f343c42ff None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:28.808036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-5c2096f9-a854-4af4-ae38-8a2f343c42ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:02:28.808036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:28.808036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:28.808036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:28.808036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:28.808036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:28.808036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:28.808036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:28.808036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:28.808036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:28.808036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:28.808036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:28.808036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 14:02:28.808036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 14:02:28.808036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 14:02:28.808036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 14:02:28.809186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:28.809186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:28.809186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:28.809186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:28.809186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:28.809186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:28.809186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:28.809186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:28.809186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:28.809186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:28.809186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:28.809186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:28.809186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:28.809186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:28.809186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:28.809186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:28.809186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 14:02:28.810076 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 14:02:28.810076 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:02:28.810076 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:02:28.810076 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 615/1224] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:02:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:28.816038 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6a438-cec2-41f4-979b-9f045b6d3d89 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:28.918219 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6a438-cec2-41f4-979b-9f045b6d3d89 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:28.953836 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f8f3e-b937-466e-aa27-59561df3477c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:28.954440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f8f3e-b937-466e-aa27-59561df3477c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:28.954714 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f8f3e-b937-466e-aa27-59561df3477c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:28.954981 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f8f3e-b937-466e-aa27-59561df3477c None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:28.955620 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f8f3e-b937-466e-aa27-59561df3477c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:28.955921 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f8f3e-b937-466e-aa27-59561df3477c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:28.957357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f8f3e-b937-466e-aa27-59561df3477c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:28.969754 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 610/1225] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 14:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:28.975440 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2096f9-a854-4af4-ae38-8a2f343c42ff None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:29.078916 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:29.086421 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2096f9-a854-4af4-ae38-8a2f343c42ff None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:29.123002 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18a17d-9b3b-4c93-8124-a45b5fddea38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:29.123674 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18a17d-9b3b-4c93-8124-a45b5fddea38 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:29.123962 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18a17d-9b3b-4c93-8124-a45b5fddea38 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:29.124215 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18a17d-9b3b-4c93-8124-a45b5fddea38 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:29.133260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b18a17d-9b3b-4c93-8124-a45b5fddea38 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:29.135036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b18a17d-9b3b-4c93-8124-a45b5fddea38 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:29.147454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-5b18a17d-9b3b-4c93-8124-a45b5fddea38 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 14:02:29.147454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:29.147454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:29.147454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:29.147454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:29.147454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:29.147454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:29.147454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:29.147454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:29.147454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:29.147454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:29.147454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:29.147454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 14:02:29.147454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 14:02:29.147454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 14:02:29.147454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 14:02:29.148437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:29.148437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:29.148437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 14:02:29.148437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 14:02:29.148437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 14:02:29.148437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 14:02:29.148437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:29.148437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:29.148437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:29.148437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:29.148437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:29.148437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:29.148437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:29.148437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:29.148437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:29.148437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:29.148437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:29.148437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:29.149423 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:29.149423 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:29.149423 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 14:02:29.149423 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 14:02:29.149423 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 14:02:29.149423 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 14:02:29.149423 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 14:02:29.149423 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 14:02:29.149423 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 14:02:29.149423 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:02:29.149423 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 616/1226] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:02:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:29.154451 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f8f3e-b937-466e-aa27-59561df3477c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:29.204074 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:29.264588 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f8f3e-b937-466e-aa27-59561df3477c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:29.302993 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23691f0d-fac6-436d-8388-9ce148e799c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:29.303825 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23691f0d-fac6-436d-8388-9ce148e799c4 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:29.304134 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23691f0d-fac6-436d-8388-9ce148e799c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:29.304530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23691f0d-fac6-436d-8388-9ce148e799c4 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:29.305406 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23691f0d-fac6-436d-8388-9ce148e799c4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:29.305789 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23691f0d-fac6-436d-8388-9ce148e799c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:29.308531 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23691f0d-fac6-436d-8388-9ce148e799c4 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:29.330443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 611/1227] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Sep 13 14:02:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:29.336402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18a17d-9b3b-4c93-8124-a45b5fddea38 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:29.456353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18a17d-9b3b-4c93-8124-a45b5fddea38 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:29.493540 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e08726-8dab-4543-8570-d3a6ee35e26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:29.494349 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e08726-8dab-4543-8570-d3a6ee35e26e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:29.494464 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e08726-8dab-4543-8570-d3a6ee35e26e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:29.494826 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e08726-8dab-4543-8570-d3a6ee35e26e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:29.508443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e08726-8dab-4543-8570-d3a6ee35e26e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:29.510482 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e08726-8dab-4543-8570-d3a6ee35e26e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:29.532843 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-23e08726-8dab-4543-8570-d3a6ee35e26e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:02:29.532843 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:29.532843 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:29.532843 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:29.532843 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:29.532843 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:29.532843 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:29.532843 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:29.532843 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:29.532843 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:29.532843 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:29.532843 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:29.532843 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 14:02:29.532843 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 14:02:29.532843 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 14:02:29.532843 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 14:02:29.534297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:29.534297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:29.534297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:29.534297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:29.534297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:29.534297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:29.534297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:29.534297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:29.534297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:29.534297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:29.534297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:29.534297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:29.534297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:29.534297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:29.534297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:29.534297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:29.534297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 14:02:29.535586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 14:02:29.535586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:02:29.535586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:02:29.535586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 617/1228] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:02:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 14:02:29.541624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23691f0d-fac6-436d-8388-9ce148e799c4 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:29.659177 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23691f0d-fac6-436d-8388-9ce148e799c4 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:29.662463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:29.704943 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8484e-efa4-4de3-b5c7-74236d62330c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:29.705584 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8484e-efa4-4de3-b5c7-74236d62330c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:29.705864 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8484e-efa4-4de3-b5c7-74236d62330c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:29.706178 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8484e-efa4-4de3-b5c7-74236d62330c None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:29.706934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8484e-efa4-4de3-b5c7-74236d62330c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:29.707174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8484e-efa4-4de3-b5c7-74236d62330c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:29.708741 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8484e-efa4-4de3-b5c7-74236d62330c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:29.721343 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 612/1229] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 14:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:02:29.727205 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e08726-8dab-4543-8570-d3a6ee35e26e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:29.737026 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:29.836629 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e08726-8dab-4543-8570-d3a6ee35e26e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:29.874574 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41ee4a-9c54-4bd4-b330-58b64c27dc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:29.875470 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41ee4a-9c54-4bd4-b330-58b64c27dc01 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:29.875638 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41ee4a-9c54-4bd4-b330-58b64c27dc01 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:29.875920 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41ee4a-9c54-4bd4-b330-58b64c27dc01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:29.882724 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41ee4a-9c54-4bd4-b330-58b64c27dc01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:29.884141 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41ee4a-9c54-4bd4-b330-58b64c27dc01 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:29.896007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-0a41ee4a-9c54-4bd4-b330-58b64c27dc01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 14:02:29.896007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:29.896007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:29.896007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:29.896007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:29.896007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:29.896007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:29.896007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:29.896007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:29.896007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:29.896007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:29.896007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:29.896007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 14:02:29.896007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 14:02:29.896007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 14:02:29.902135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 14:02:29.902135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:29.902135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:29.902135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:29.902135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:29.902135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:29.902135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:29.902135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:29.902135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:29.902135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:29.902135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:29.902135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:29.902135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:29.902135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:29.902135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:29.902135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:29.902135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:29.903214 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 14:02:29.903214 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 14:02:29.903214 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 14:02:29.903214 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 14:02:29.903214 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 14:02:29.903214 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 14:02:29.903214 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 14:02:29.903214 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:02:29.903214 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 618/1230] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 14:02:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:29.905553 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8484e-efa4-4de3-b5c7-74236d62330c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:30.018042 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8484e-efa4-4de3-b5c7-74236d62330c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:30.058244 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935638a-b20a-4443-9e9d-2a3f9b507f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:30.059284 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935638a-b20a-4443-9e9d-2a3f9b507f4d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:30.059766 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935638a-b20a-4443-9e9d-2a3f9b507f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:30.060118 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935638a-b20a-4443-9e9d-2a3f9b507f4d None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:30.061137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935638a-b20a-4443-9e9d-2a3f9b507f4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:30.061449 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935638a-b20a-4443-9e9d-2a3f9b507f4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:30.063329 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935638a-b20a-4443-9e9d-2a3f9b507f4d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:30.080514 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 613/1231] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 14:02:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:30.088535 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41ee4a-9c54-4bd4-b330-58b64c27dc01 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:30.166645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:30.204862 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41ee4a-9c54-4bd4-b330-58b64c27dc01 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:30.239900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796d07d-282c-463b-998d-6d2429b66ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:30.240555 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796d07d-282c-463b-998d-6d2429b66ac0 None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:30.240839 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796d07d-282c-463b-998d-6d2429b66ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:30.241124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796d07d-282c-463b-998d-6d2429b66ac0 None admin] PATH_INFO: `/v3/projects/17ba27c26bf34daa91cf8f7cc25bf086/users/311397bfe2c04569852fca0cfcdbad66/roles/0c389f21d4434ae0a32fc453a8f2050a` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:30.255921 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796d07d-282c-463b-998d-6d2429b66ac0 None admin] RBAC: Authorizing `identity:create_grant(project_id=17ba27c26bf34daa91cf8f7cc25bf086, user_id=311397bfe2c04569852fca0cfcdbad66, role_id=0c389f21d4434ae0a32fc453a8f2050a)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:30.257389 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796d07d-282c-463b-998d-6d2429b66ac0 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:30.270917 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 619/1232] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 13 14:02:30 2022] PUT /identity/v3/projects/17ba27c26bf34daa91cf8f7cc25bf086/users/311397bfe2c04569852fca0cfcdbad66/roles/0c389f21d4434ae0a32fc453a8f2050a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:02:32.430256 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eceee9-bfd9-4667-a2c1-878a6f8f1d4e None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:32.430969 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eceee9-bfd9-4667-a2c1-878a6f8f1d4e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:32.430969 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eceee9-bfd9-4667-a2c1-878a6f8f1d4e None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:32.432139 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 614/1233] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:02:32.437891 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7968a73-51f2-4d06-809f-ef1d5e1c261c None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:32.438343 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7968a73-51f2-4d06-809f-ef1d5e1c261c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:32.438805 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7968a73-51f2-4d06-809f-ef1d5e1c261c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:32.459526 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-a7968a73-51f2-4d06-809f-ef1d5e1c261c None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:02:32.460726 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a7968a73-51f2-4d06-809f-ef1d5e1c261c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:02:32.536041 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 620/1234] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:02:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:02:32.820542 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eceee9-bfd9-4667-a2c1-878a6f8f1d4e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:32.847087 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:32.930332 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eceee9-bfd9-4667-a2c1-878a6f8f1d4e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:32.966810 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fe279-18e7-41a0-8061-6d29af41b789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:32.967963 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fe279-18e7-41a0-8061-6d29af41b789 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:32.968244 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fe279-18e7-41a0-8061-6d29af41b789 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:32.968511 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fe279-18e7-41a0-8061-6d29af41b789 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:32.980258 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fe279-18e7-41a0-8061-6d29af41b789 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 14:02:32.986000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-df9fe279-18e7-41a0-8061-6d29af41b789 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 14:02:32.986000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:32.986000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:32.986000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:32.986000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:32.986000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:32.986000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:32.986000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:32.986000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:32.986000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:32.986000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:32.986000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:32.986000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 14:02:32.986000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 14:02:32.986000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 14:02:32.986000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 14:02:32.987127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 14:02:32.987127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 14:02:32.987127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 14:02:32.987127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 14:02:32.987127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:32.987127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:32.987127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:32.987127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:32.987127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:32.987127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:32.987127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:32.987127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:32.987127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:32.987127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:32.987127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:32.987127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:32.988083 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:32.988083 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:32.988083 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:32.988083 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:32.988083 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 14:02:32.988083 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 14:02:32.988083 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 14:02:32.988083 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 14:02:32.988083 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 14:02:32.988083 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 14:02:32.988083 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 14:02:32.988083 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:02:32.988083 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 615/1235] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Sep 13 14:02:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:32.993491 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7968a73-51f2-4d06-809f-ef1d5e1c261c None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:33.055188 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:33.116272 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7968a73-51f2-4d06-809f-ef1d5e1c261c None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:33.161882 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb5761-af3a-4739-9562-b7684f5cd6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:33.162514 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb5761-af3a-4739-9562-b7684f5cd6ff None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:33.162795 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb5761-af3a-4739-9562-b7684f5cd6ff None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:33.163064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb5761-af3a-4739-9562-b7684f5cd6ff None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:33.163736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb5761-af3a-4739-9562-b7684f5cd6ff None admin] RBAC: Adding query filter params (name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:33.164033 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb5761-af3a-4739-9562-b7684f5cd6ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:33.165445 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb5761-af3a-4739-9562-b7684f5cd6ff None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:33.174407 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 621/1236] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Sep 13 14:02:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:33.180406 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fe279-18e7-41a0-8061-6d29af41b789 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:33.276605 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:33.292936 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fe279-18e7-41a0-8061-6d29af41b789 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:33.335974 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae45113-d06d-4316-948d-3bf76511204a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:33.336607 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae45113-d06d-4316-948d-3bf76511204a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:33.336891 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae45113-d06d-4316-948d-3bf76511204a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:33.337216 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae45113-d06d-4316-948d-3bf76511204a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:33.352564 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae45113-d06d-4316-948d-3bf76511204a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:33.354894 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae45113-d06d-4316-948d-3bf76511204a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:33.376152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-9ae45113-d06d-4316-948d-3bf76511204a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:02:33.376152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:33.376152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:33.376152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:33.376152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:33.376152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:33.376152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:33.376152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:33.376152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:33.376152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:33.376152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:33.376152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:33.376152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 14:02:33.376152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 14:02:33.376152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 14:02:33.376152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 14:02:33.382189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:33.382189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:33.382189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:33.382189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:33.382189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:33.382189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:33.382189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:33.382189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:33.382189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:33.382189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:33.382189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:33.382189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:33.382189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:33.382189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:33.382189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:33.382189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:33.382189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 14:02:33.383282 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 14:02:33.383282 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:02:33.383282 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:02:33.383282 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 616/1237] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:02:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:33.383568 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb5761-af3a-4739-9562-b7684f5cd6ff None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:33.488319 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb5761-af3a-4739-9562-b7684f5cd6ff None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:33.497522 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:33.531314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4146f-b57f-43e6-9aee-afc0011dd8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:33.531964 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4146f-b57f-43e6-9aee-afc0011dd8c1 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:33.532299 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4146f-b57f-43e6-9aee-afc0011dd8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:33.532849 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4146f-b57f-43e6-9aee-afc0011dd8c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:33.533540 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4146f-b57f-43e6-9aee-afc0011dd8c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:33.533844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4146f-b57f-43e6-9aee-afc0011dd8c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:33.535655 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4146f-b57f-43e6-9aee-afc0011dd8c1 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:33.550983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 622/1238] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 14:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:33.557286 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae45113-d06d-4316-948d-3bf76511204a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:33.667174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae45113-d06d-4316-948d-3bf76511204a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:33.703595 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b805e94-6840-4352-8630-18275aa6b4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:33.704223 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b805e94-6840-4352-8630-18275aa6b4ef None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:33.704506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b805e94-6840-4352-8630-18275aa6b4ef None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:33.704780 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b805e94-6840-4352-8630-18275aa6b4ef None admin] PATH_INFO: `/v3/users/placement` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:33.707573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:33.713137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b805e94-6840-4352-8630-18275aa6b4ef None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:33.714832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b805e94-6840-4352-8630-18275aa6b4ef None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:33.727452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-4b805e94-6840-4352-8630-18275aa6b4ef None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 14:02:33.727452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:33.727452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:33.727452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:33.727452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:33.727452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:33.727452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:33.727452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:33.727452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:33.727452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:33.727452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:33.727452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:33.727452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 14:02:33.727452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 14:02:33.727452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 14:02:33.727452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 14:02:33.728641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:33.728641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:33.728641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 14:02:33.728641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 14:02:33.728641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 14:02:33.728641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 14:02:33.728641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:33.728641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:33.728641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:33.728641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:33.728641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:33.728641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:33.728641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:33.728641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:33.728641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:33.728641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:33.728641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:33.728641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:33.730305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:33.730305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:33.730305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 14:02:33.730305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 14:02:33.730305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 14:02:33.730305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 14:02:33.730305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 14:02:33.730305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 14:02:33.730305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 14:02:33.730305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:02:33.730305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 617/1239] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:02:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:33.735105 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4146f-b57f-43e6-9aee-afc0011dd8c1 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:33.842295 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4146f-b57f-43e6-9aee-afc0011dd8c1 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:33.879631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c184c-a4c1-4f66-a963-bba048167811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:33.880238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c184c-a4c1-4f66-a963-bba048167811 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:33.880517 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c184c-a4c1-4f66-a963-bba048167811 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:33.880787 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c184c-a4c1-4f66-a963-bba048167811 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:33.881546 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c184c-a4c1-4f66-a963-bba048167811 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:33.881912 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c184c-a4c1-4f66-a963-bba048167811 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:33.883264 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c184c-a4c1-4f66-a963-bba048167811 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:33.902066 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 623/1240] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Sep 13 14:02:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:33.908817 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b805e94-6840-4352-8630-18275aa6b4ef None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:34.017390 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b805e94-6840-4352-8630-18275aa6b4ef None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:34.055537 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df1d0a-b74c-42b0-8dcb-fde40359430c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:34.056231 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df1d0a-b74c-42b0-8dcb-fde40359430c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:34.056506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df1d0a-b74c-42b0-8dcb-fde40359430c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:34.056774 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df1d0a-b74c-42b0-8dcb-fde40359430c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:34.123774 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:34.131216 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df1d0a-b74c-42b0-8dcb-fde40359430c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:34.132929 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df1d0a-b74c-42b0-8dcb-fde40359430c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:34.236006 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 618/1241] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 14:02:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 14:02:34.242160 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c184c-a4c1-4f66-a963-bba048167811 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:34.274054 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:34.367643 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c184c-a4c1-4f66-a963-bba048167811 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:34.408009 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9af54-b164-49e6-b188-5b78d7d4b236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:34.408600 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9af54-b164-49e6-b188-5b78d7d4b236 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:34.408874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9af54-b164-49e6-b188-5b78d7d4b236 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:34.409171 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9af54-b164-49e6-b188-5b78d7d4b236 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:34.419367 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9af54-b164-49e6-b188-5b78d7d4b236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:34.420833 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9af54-b164-49e6-b188-5b78d7d4b236 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:34.443741 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-60e9af54-b164-49e6-b188-5b78d7d4b236 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:02:34.443741 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:34.443741 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:34.443741 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:34.443741 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:34.443741 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:34.443741 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:34.443741 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:34.443741 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:34.443741 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:34.443741 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:34.443741 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:34.443741 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 14:02:34.443741 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 14:02:34.443741 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 14:02:34.443741 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 14:02:34.444986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:34.444986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:34.444986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:34.444986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:34.444986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:34.444986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:34.444986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:34.444986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:34.444986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:34.444986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:34.444986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:34.444986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:34.444986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:34.444986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:34.444986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:34.444986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:34.444986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 14:02:34.446167 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 14:02:34.446167 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:02:34.446167 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:02:34.446167 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 624/1242] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:02:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:34.450656 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df1d0a-b74c-42b0-8dcb-fde40359430c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:34.552851 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:34.559470 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df1d0a-b74c-42b0-8dcb-fde40359430c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:34.596211 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32861c5-b930-43c3-8f06-fc513d1e5be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:34.596980 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32861c5-b930-43c3-8f06-fc513d1e5be3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:34.597583 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32861c5-b930-43c3-8f06-fc513d1e5be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:34.598058 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32861c5-b930-43c3-8f06-fc513d1e5be3 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:34.599425 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32861c5-b930-43c3-8f06-fc513d1e5be3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:34.599764 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32861c5-b930-43c3-8f06-fc513d1e5be3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:34.601973 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32861c5-b930-43c3-8f06-fc513d1e5be3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:34.616194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 619/1243] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 14:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:34.621882 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9af54-b164-49e6-b188-5b78d7d4b236 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:34.710373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:34.735676 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9af54-b164-49e6-b188-5b78d7d4b236 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:34.780593 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d4110-ba1f-41d1-ac81-2958cc3e1021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:34.781288 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d4110-ba1f-41d1-ac81-2958cc3e1021 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:34.781610 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d4110-ba1f-41d1-ac81-2958cc3e1021 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:34.781900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d4110-ba1f-41d1-ac81-2958cc3e1021 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:34.789474 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d4110-ba1f-41d1-ac81-2958cc3e1021 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:34.790975 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d4110-ba1f-41d1-ac81-2958cc3e1021 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:34.807397 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-b31d4110-ba1f-41d1-ac81-2958cc3e1021 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 14:02:34.807397 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:34.807397 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:34.807397 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:34.807397 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:34.807397 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:34.807397 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:34.807397 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:34.807397 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:34.807397 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:34.807397 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:34.807397 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:34.807397 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 14:02:34.807397 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 14:02:34.807397 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 14:02:34.808586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 14:02:34.808586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:34.808586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:34.808586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:34.808586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:34.808586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:34.808586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:34.808586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:34.808586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:34.808586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:34.808586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:34.808586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:34.808586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:34.808586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:34.808586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:34.808586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:34.808586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:34.809897 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 14:02:34.809897 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 14:02:34.809897 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 14:02:34.809897 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 14:02:34.809897 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 14:02:34.809897 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 14:02:34.809897 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 14:02:34.809897 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:02:34.809897 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 625/1244] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 14:02:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:34.814579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32861c5-b930-43c3-8f06-fc513d1e5be3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:34.936613 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32861c5-b930-43c3-8f06-fc513d1e5be3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:34.974631 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbe449-bebe-4d39-bae9-c74d20ea83e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:34.975235 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbe449-bebe-4d39-bae9-c74d20ea83e2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:34.975515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbe449-bebe-4d39-bae9-c74d20ea83e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:34.975786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbe449-bebe-4d39-bae9-c74d20ea83e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:34.976473 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dbe449-bebe-4d39-bae9-c74d20ea83e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:34.976774 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dbe449-bebe-4d39-bae9-c74d20ea83e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:34.978255 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dbe449-bebe-4d39-bae9-c74d20ea83e2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:34.990700 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 620/1245] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 14:02:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:02:34.996929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d4110-ba1f-41d1-ac81-2958cc3e1021 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:35.120951 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d4110-ba1f-41d1-ac81-2958cc3e1021 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:35.167827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa47fd-dc95-4764-88c8-4725db792548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:35.168721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa47fd-dc95-4764-88c8-4725db792548 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:35.169139 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa47fd-dc95-4764-88c8-4725db792548 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:35.169507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa47fd-dc95-4764-88c8-4725db792548 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:35.171144 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa47fd-dc95-4764-88c8-4725db792548 None admin] RBAC: Adding query filter params (role.id=0c389f21d4434ae0a32fc453a8f2050a, scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086, user.id=311397bfe2c04569852fca0cfcdbad66) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:35.171774 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa47fd-dc95-4764-88c8-4725db792548 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:35.173309 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa47fd-dc95-4764-88c8-4725db792548 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:35.180292 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 626/1246] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 14:02:34 2022] GET /identity/v3/role_assignments?user.id=311397bfe2c04569852fca0cfcdbad66&scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086&role.id=0c389f21d4434ae0a32fc453a8f2050a => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:37.600442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee355b-ff6d-4399-8939-93ced3ff97df None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:37.601022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee355b-ff6d-4399-8939-93ced3ff97df None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:37.601022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee355b-ff6d-4399-8939-93ced3ff97df None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:37.602435 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 621/1247] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:02:37.607619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee029f39-2e6f-4ebc-aa2b-f0b5b4ed9f65 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:37.608023 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee029f39-2e6f-4ebc-aa2b-f0b5b4ed9f65 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:37.608184 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee029f39-2e6f-4ebc-aa2b-f0b5b4ed9f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:37.614508 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:37.628609 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-ee029f39-2e6f-4ebc-aa2b-f0b5b4ed9f65 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:02:37.629870 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ee029f39-2e6f-4ebc-aa2b-f0b5b4ed9f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:02:37.700593 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 627/1248] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:02:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:02:37.989156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee355b-ff6d-4399-8939-93ced3ff97df None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:38.010598 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:38.102725 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee355b-ff6d-4399-8939-93ced3ff97df None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:38.137465 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed878d73-d55b-4835-b29f-ea8b1afa68ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:38.138079 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed878d73-d55b-4835-b29f-ea8b1afa68ab None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:38.138358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed878d73-d55b-4835-b29f-ea8b1afa68ab None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:38.138623 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed878d73-d55b-4835-b29f-ea8b1afa68ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:38.150332 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed878d73-d55b-4835-b29f-ea8b1afa68ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 14:02:38.155535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-ed878d73-d55b-4835-b29f-ea8b1afa68ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 14:02:38.155535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:38.155535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:38.155535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:38.155535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:38.155535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:38.155535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:38.155535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:38.155535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:38.155535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:38.155535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:38.155535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:38.155535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 14:02:38.155535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 14:02:38.155535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 14:02:38.155535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 14:02:38.156682 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 14:02:38.156682 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 14:02:38.156682 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 14:02:38.156682 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 14:02:38.156682 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:38.156682 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:38.156682 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:38.156682 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:38.156682 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:38.156682 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:38.156682 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:38.156682 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:38.156682 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:38.156682 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:38.156682 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:38.156682 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:38.158001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:38.158001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:38.158001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:38.158001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:38.158001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 14:02:38.158001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 14:02:38.158001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 14:02:38.158001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 14:02:38.158001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 14:02:38.158001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 14:02:38.158001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 14:02:38.158001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:02:38.158001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 622/1249] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 14:02:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:38.163598 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee029f39-2e6f-4ebc-aa2b-f0b5b4ed9f65 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:38.279188 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee029f39-2e6f-4ebc-aa2b-f0b5b4ed9f65 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:38.316168 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:38.324766 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f4fa5-c4a0-472c-b9ae-8055d899bb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:38.325698 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f4fa5-c4a0-472c-b9ae-8055d899bb7b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:38.326330 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f4fa5-c4a0-472c-b9ae-8055d899bb7b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:38.326710 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f4fa5-c4a0-472c-b9ae-8055d899bb7b None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:38.327767 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f4fa5-c4a0-472c-b9ae-8055d899bb7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:38.328390 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f4fa5-c4a0-472c-b9ae-8055d899bb7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:38.330573 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f4fa5-c4a0-472c-b9ae-8055d899bb7b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:38.342510 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 628/1250] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 14:02:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:38.350288 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed878d73-d55b-4835-b29f-ea8b1afa68ab None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:38.450821 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:38.478808 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed878d73-d55b-4835-b29f-ea8b1afa68ab None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:38.515467 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7ee0e-8c89-4649-a0d0-f7b5aad37b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:38.516083 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7ee0e-8c89-4649-a0d0-f7b5aad37b83 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:38.516356 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7ee0e-8c89-4649-a0d0-f7b5aad37b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:38.516617 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7ee0e-8c89-4649-a0d0-f7b5aad37b83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:38.528092 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7ee0e-8c89-4649-a0d0-f7b5aad37b83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:38.529798 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7ee0e-8c89-4649-a0d0-f7b5aad37b83 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:38.552112 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-21c7ee0e-8c89-4649-a0d0-f7b5aad37b83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:02:38.552112 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:38.552112 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:38.552112 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:38.552112 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:38.552112 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:38.552112 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:38.552112 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:38.552112 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:38.552112 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:38.552112 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:38.552112 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:38.552112 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 14:02:38.552112 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 14:02:38.552112 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 14:02:38.552112 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 14:02:38.553370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:38.553370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:38.553370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:38.553370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:38.553370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:38.553370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:38.553370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:38.553370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:38.553370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:38.553370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:38.553370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:38.553370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:38.553370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:38.553370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:38.553370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:38.553370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:38.553370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 14:02:38.557477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 14:02:38.557477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:02:38.557477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:02:38.557477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 623/1251] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:02:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:38.559313 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f4fa5-c4a0-472c-b9ae-8055d899bb7b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:38.673912 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f4fa5-c4a0-472c-b9ae-8055d899bb7b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:38.710227 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac8e80-c0cb-47a5-bc29-4c39eb846c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:38.710840 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac8e80-c0cb-47a5-bc29-4c39eb846c09 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:38.711112 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac8e80-c0cb-47a5-bc29-4c39eb846c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:38.711377 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac8e80-c0cb-47a5-bc29-4c39eb846c09 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:38.712018 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac8e80-c0cb-47a5-bc29-4c39eb846c09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:38.712312 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac8e80-c0cb-47a5-bc29-4c39eb846c09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:38.713720 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac8e80-c0cb-47a5-bc29-4c39eb846c09 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:38.727655 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 629/1252] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 14:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:38.734958 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7ee0e-8c89-4649-a0d0-f7b5aad37b83 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:38.844552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7ee0e-8c89-4649-a0d0-f7b5aad37b83 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:38.872436 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:38.881545 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfc9d7-2d8d-4358-a9fa-6b900b1cb3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:38.882174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfc9d7-2d8d-4358-a9fa-6b900b1cb3bd None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:38.882447 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfc9d7-2d8d-4358-a9fa-6b900b1cb3bd None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:38.882713 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfc9d7-2d8d-4358-a9fa-6b900b1cb3bd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:38.891208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfc9d7-2d8d-4358-a9fa-6b900b1cb3bd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:38.892679 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfc9d7-2d8d-4358-a9fa-6b900b1cb3bd None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:38.905051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-01dfc9d7-2d8d-4358-a9fa-6b900b1cb3bd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 14:02:38.905051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:38.905051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:38.905051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:38.905051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:38.905051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:38.905051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:38.905051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:38.905051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:38.905051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:38.905051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:38.905051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:38.905051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 14:02:38.905051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 14:02:38.905051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 14:02:38.905051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 14:02:38.906298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:38.906298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:38.906298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 14:02:38.906298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 14:02:38.906298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 14:02:38.906298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 14:02:38.906298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:38.906298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:38.906298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:38.906298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:38.906298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:38.906298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:38.906298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:38.906298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:38.906298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:38.906298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:38.906298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:38.906298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:38.907793 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:38.907793 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:38.907793 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 14:02:38.907793 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 14:02:38.907793 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 14:02:38.907793 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 14:02:38.907793 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 14:02:38.907793 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 14:02:38.907793 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 14:02:38.907793 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:02:38.907793 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 624/1253] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:02:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:38.912709 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac8e80-c0cb-47a5-bc29-4c39eb846c09 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:38.971541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:39.018506 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac8e80-c0cb-47a5-bc29-4c39eb846c09 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:39.053938 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74984efe-c841-4b95-ac0f-a7b09526c994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:39.054871 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74984efe-c841-4b95-ac0f-a7b09526c994 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:39.054871 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74984efe-c841-4b95-ac0f-a7b09526c994 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:39.055057 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74984efe-c841-4b95-ac0f-a7b09526c994 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:39.055770 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74984efe-c841-4b95-ac0f-a7b09526c994 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:39.056068 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74984efe-c841-4b95-ac0f-a7b09526c994 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:39.057536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74984efe-c841-4b95-ac0f-a7b09526c994 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:39.076026 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 630/1254] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Sep 13 14:02:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:39.082356 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfc9d7-2d8d-4358-a9fa-6b900b1cb3bd None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:39.189757 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfc9d7-2d8d-4358-a9fa-6b900b1cb3bd None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:39.224146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e9c1a-611b-42e5-a29f-6d3e1a8d8bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:39.224756 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e9c1a-611b-42e5-a29f-6d3e1a8d8bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:39.225030 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e9c1a-611b-42e5-a29f-6d3e1a8d8bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:39.225324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e9c1a-611b-42e5-a29f-6d3e1a8d8bb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:39.280301 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:39.294049 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e9c1a-611b-42e5-a29f-6d3e1a8d8bb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:39.296023 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e9c1a-611b-42e5-a29f-6d3e1a8d8bb0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:39.409413 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 625/1255] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 14:02:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 14:02:39.415187 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74984efe-c841-4b95-ac0f-a7b09526c994 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:39.511069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74984efe-c841-4b95-ac0f-a7b09526c994 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:39.523728 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:39.545616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18825440-c5c5-4b9c-b47e-3908c62507ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:39.546229 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18825440-c5c5-4b9c-b47e-3908c62507ae None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:39.546502 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18825440-c5c5-4b9c-b47e-3908c62507ae None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:39.546767 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18825440-c5c5-4b9c-b47e-3908c62507ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:39.556343 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18825440-c5c5-4b9c-b47e-3908c62507ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:39.557792 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18825440-c5c5-4b9c-b47e-3908c62507ae None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:39.571798 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-18825440-c5c5-4b9c-b47e-3908c62507ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:02:39.571798 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:39.571798 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:39.571798 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:39.571798 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:39.571798 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:39.571798 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:39.571798 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:39.571798 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:39.571798 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:39.571798 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:39.571798 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:39.571798 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 14:02:39.571798 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 14:02:39.571798 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 14:02:39.571798 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 14:02:39.572905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:39.572905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:39.572905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:39.572905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:39.572905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:39.572905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:39.572905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:39.572905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:39.572905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:39.572905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:39.572905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:39.572905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:39.572905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:39.572905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:39.572905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:39.572905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:39.572905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 14:02:39.574025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 14:02:39.574025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:02:39.574025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:02:39.574025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 631/1256] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:02:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:39.578554 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e9c1a-611b-42e5-a29f-6d3e1a8d8bb0 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:39.663378 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:39.676273 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e9c1a-611b-42e5-a29f-6d3e1a8d8bb0 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:39.708547 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c1c3e-a198-4361-ba8c-868f965ccd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:39.709161 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c1c3e-a198-4361-ba8c-868f965ccd55 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:39.709436 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c1c3e-a198-4361-ba8c-868f965ccd55 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:39.709701 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c1c3e-a198-4361-ba8c-868f965ccd55 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:39.710327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c1c3e-a198-4361-ba8c-868f965ccd55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:39.710621 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c1c3e-a198-4361-ba8c-868f965ccd55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:39.711976 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c1c3e-a198-4361-ba8c-868f965ccd55 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:39.723501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 626/1257] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 14:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:39.729348 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18825440-c5c5-4b9c-b47e-3908c62507ae None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:39.827735 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18825440-c5c5-4b9c-b47e-3908c62507ae None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:39.860144 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbeb90-7493-4308-aa74-1add5dd20f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:39.860751 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbeb90-7493-4308-aa74-1add5dd20f05 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:39.861026 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbeb90-7493-4308-aa74-1add5dd20f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:39.861323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbeb90-7493-4308-aa74-1add5dd20f05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:39.867750 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbeb90-7493-4308-aa74-1add5dd20f05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:39.869209 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbeb90-7493-4308-aa74-1add5dd20f05 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:39.880111 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-ebcbeb90-7493-4308-aa74-1add5dd20f05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 14:02:39.880111 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:39.880111 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:39.880111 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:39.880111 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:39.880111 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:39.880111 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:39.880111 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:39.880111 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:39.880111 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:39.880111 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:39.880111 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:39.880111 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 14:02:39.880111 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 14:02:39.880111 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 14:02:39.881172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 14:02:39.881172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:39.881172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:39.881172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:39.881172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:39.881172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:39.881172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:39.881172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:39.881172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:39.881172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:39.881172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:39.881172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:39.881172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:39.881172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:39.881172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:39.881172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:39.881172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:39.882093 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 14:02:39.882093 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 14:02:39.882093 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 14:02:39.882093 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 14:02:39.882093 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 14:02:39.882093 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 14:02:39.882093 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 14:02:39.882093 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:02:39.882093 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 632/1258] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 14:02:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:39.887007 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c1c3e-a198-4361-ba8c-868f965ccd55 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:39.985110 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c1c3e-a198-4361-ba8c-868f965ccd55 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:40.017617 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1328ee7-5c81-41c1-81b5-7540df8beeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:40.018209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1328ee7-5c81-41c1-81b5-7540df8beeb2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:40.018488 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1328ee7-5c81-41c1-81b5-7540df8beeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:40.018756 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1328ee7-5c81-41c1-81b5-7540df8beeb2 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:40.019432 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1328ee7-5c81-41c1-81b5-7540df8beeb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:40.019732 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1328ee7-5c81-41c1-81b5-7540df8beeb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:40.021163 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1328ee7-5c81-41c1-81b5-7540df8beeb2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:40.033480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 627/1259] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 14:02:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:40.039313 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbeb90-7493-4308-aa74-1add5dd20f05 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:40.064311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:40.136955 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbeb90-7493-4308-aa74-1add5dd20f05 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:40.169435 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16411ca1-0cb4-45db-ac43-3bff9da1262b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:40.170016 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16411ca1-0cb4-45db-ac43-3bff9da1262b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:40.170291 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16411ca1-0cb4-45db-ac43-3bff9da1262b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:40.170555 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16411ca1-0cb4-45db-ac43-3bff9da1262b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:40.171268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16411ca1-0cb4-45db-ac43-3bff9da1262b None admin] RBAC: Adding query filter params (role.id=6dcc8495d2b24b3eab63dd656eb4eb6d, scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086, user.id=311397bfe2c04569852fca0cfcdbad66) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:40.171568 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16411ca1-0cb4-45db-ac43-3bff9da1262b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:40.172971 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16411ca1-0cb4-45db-ac43-3bff9da1262b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:40.178171 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 633/1260] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 14:02:40 2022] GET /identity/v3/role_assignments?user.id=311397bfe2c04569852fca0cfcdbad66&scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086&role.id=6dcc8495d2b24b3eab63dd656eb4eb6d => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:42.283188 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93aa01-3ee3-4099-acc4-43606602ddea None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:42.283735 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93aa01-3ee3-4099-acc4-43606602ddea None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:42.283735 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93aa01-3ee3-4099-acc4-43606602ddea None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:42.285062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 628/1261] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:02:42.290061 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee944a81-0c9b-4b4b-bc90-afb12c7749c4 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:42.290443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee944a81-0c9b-4b4b-bc90-afb12c7749c4 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:42.290603 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee944a81-0c9b-4b4b-bc90-afb12c7749c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:42.309071 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-ee944a81-0c9b-4b4b-bc90-afb12c7749c4 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:02:42.310280 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ee944a81-0c9b-4b4b-bc90-afb12c7749c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:02:42.394763 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 634/1262] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:02:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 14:02:42.666305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93aa01-3ee3-4099-acc4-43606602ddea None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:42.677535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:42.767670 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93aa01-3ee3-4099-acc4-43606602ddea None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:42.801105 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbd240-9fb6-477f-ac12-12a2b6d3f01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:42.801729 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbd240-9fb6-477f-ac12-12a2b6d3f01c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:42.802005 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbd240-9fb6-477f-ac12-12a2b6d3f01c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:42.802273 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbd240-9fb6-477f-ac12-12a2b6d3f01c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:42.812211 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbd240-9fb6-477f-ac12-12a2b6d3f01c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 14:02:42.819842 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-e9fbd240-9fb6-477f-ac12-12a2b6d3f01c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 14:02:42.819842 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:42.819842 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:42.819842 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:42.819842 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:42.819842 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:42.819842 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:42.819842 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:42.819842 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:42.819842 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:42.819842 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:42.819842 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:42.819842 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 14:02:42.819842 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 14:02:42.819842 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 14:02:42.819842 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 14:02:42.820922 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 14:02:42.820922 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 14:02:42.820922 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 14:02:42.820922 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 14:02:42.820922 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:42.820922 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:42.820922 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:42.820922 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:42.820922 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:42.820922 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:42.820922 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:42.820922 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:42.820922 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:42.820922 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:42.820922 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:42.820922 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:42.821841 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:42.821841 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:42.821841 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:42.821841 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:42.821841 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 14:02:42.821841 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 14:02:42.821841 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 14:02:42.821841 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 14:02:42.821841 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 14:02:42.821841 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 14:02:42.821841 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 14:02:42.821841 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:02:42.821841 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 629/1263] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 14:02:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:42.827518 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee944a81-0c9b-4b4b-bc90-afb12c7749c4 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:42.845819 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:42.924341 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee944a81-0c9b-4b4b-bc90-afb12c7749c4 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:42.957445 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9860b60-735c-411b-a4e8-ae2a83f1957b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:42.958033 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9860b60-735c-411b-a4e8-ae2a83f1957b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:42.958305 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9860b60-735c-411b-a4e8-ae2a83f1957b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:42.958569 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9860b60-735c-411b-a4e8-ae2a83f1957b None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:42.959223 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9860b60-735c-411b-a4e8-ae2a83f1957b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:42.959520 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9860b60-735c-411b-a4e8-ae2a83f1957b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:42.960873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9860b60-735c-411b-a4e8-ae2a83f1957b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:42.968620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 635/1264] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 14:02:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:42.974257 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbd240-9fb6-477f-ac12-12a2b6d3f01c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:43.038918 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:43.072134 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbd240-9fb6-477f-ac12-12a2b6d3f01c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:43.104480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9045fe-ec10-4964-8301-45256802ea7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:43.105075 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9045fe-ec10-4964-8301-45256802ea7d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:43.105376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9045fe-ec10-4964-8301-45256802ea7d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:43.105641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9045fe-ec10-4964-8301-45256802ea7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:43.115830 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9045fe-ec10-4964-8301-45256802ea7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:43.117305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9045fe-ec10-4964-8301-45256802ea7d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:43.131347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-1b9045fe-ec10-4964-8301-45256802ea7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:02:43.131347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:43.131347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:43.131347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:43.131347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:43.131347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:43.131347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:43.131347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:43.131347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:43.131347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:43.131347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:43.131347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:43.131347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 14:02:43.131347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 14:02:43.131347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 14:02:43.131347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 14:02:43.132410 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:43.132410 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:43.132410 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:43.132410 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:43.132410 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:43.132410 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:43.132410 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:43.132410 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:43.132410 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:43.132410 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:43.132410 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:43.132410 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:43.132410 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:43.132410 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:43.132410 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:43.132410 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:43.132410 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 14:02:43.133331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 14:02:43.133331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:02:43.133331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:02:43.133331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 630/1265] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:02:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:43.138231 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9860b60-735c-411b-a4e8-ae2a83f1957b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:43.215366 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:43.234944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9860b60-735c-411b-a4e8-ae2a83f1957b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:43.266812 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0c78d-d9a0-42e3-b249-64137a97da69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:43.267395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0c78d-d9a0-42e3-b249-64137a97da69 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:43.267669 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0c78d-d9a0-42e3-b249-64137a97da69 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:43.267932 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0c78d-d9a0-42e3-b249-64137a97da69 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:43.268558 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc0c78d-d9a0-42e3-b249-64137a97da69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:43.268874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc0c78d-d9a0-42e3-b249-64137a97da69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:43.270238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc0c78d-d9a0-42e3-b249-64137a97da69 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:43.281973 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 636/1266] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 14:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:43.287765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9045fe-ec10-4964-8301-45256802ea7d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:43.394800 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9045fe-ec10-4964-8301-45256802ea7d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:43.414616 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:43.429296 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7ad5f-ef1d-4543-b4c9-57d7f06594c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:43.429909 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7ad5f-ef1d-4543-b4c9-57d7f06594c3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:43.430183 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7ad5f-ef1d-4543-b4c9-57d7f06594c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:43.430447 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7ad5f-ef1d-4543-b4c9-57d7f06594c3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:43.437139 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7ad5f-ef1d-4543-b4c9-57d7f06594c3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:43.438574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7ad5f-ef1d-4543-b4c9-57d7f06594c3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:43.449739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-82f7ad5f-ef1d-4543-b4c9-57d7f06594c3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 14:02:43.449739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:43.449739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:43.449739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:43.449739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:43.449739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:43.449739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:43.449739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:43.449739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:43.449739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:43.449739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:43.449739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:43.449739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 14:02:43.449739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 14:02:43.449739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 14:02:43.449739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 14:02:43.450823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:43.450823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:43.450823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 14:02:43.450823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 14:02:43.450823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 14:02:43.450823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 14:02:43.450823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:43.450823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:43.450823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:43.450823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:43.450823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:43.450823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:43.450823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:43.450823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:43.450823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:43.450823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:43.450823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:43.450823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:43.451759 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:43.451759 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:43.451759 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 14:02:43.451759 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 14:02:43.451759 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 14:02:43.451759 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 14:02:43.451759 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 14:02:43.451759 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 14:02:43.451759 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 14:02:43.451759 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:02:43.451759 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 631/1267] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:02:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:43.456598 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0c78d-d9a0-42e3-b249-64137a97da69 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:43.551276 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0c78d-d9a0-42e3-b249-64137a97da69 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:43.583299 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f46cc-4260-4f36-a55b-d1ed67633f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:43.583872 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f46cc-4260-4f36-a55b-d1ed67633f3c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:43.584143 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f46cc-4260-4f36-a55b-d1ed67633f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:43.584405 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f46cc-4260-4f36-a55b-d1ed67633f3c None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:43.585131 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f46cc-4260-4f36-a55b-d1ed67633f3c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:43.585434 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f46cc-4260-4f36-a55b-d1ed67633f3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:43.586834 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f46cc-4260-4f36-a55b-d1ed67633f3c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:43.595543 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:43.603879 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 637/1268] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Sep 13 14:02:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:43.609437 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7ad5f-ef1d-4543-b4c9-57d7f06594c3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:43.705725 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7ad5f-ef1d-4543-b4c9-57d7f06594c3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:43.737875 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f5b9b-630a-4f4f-8ec9-395fd1b5f6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:43.738476 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f5b9b-630a-4f4f-8ec9-395fd1b5f6e8 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:43.738748 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f5b9b-630a-4f4f-8ec9-395fd1b5f6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:43.739015 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f5b9b-630a-4f4f-8ec9-395fd1b5f6e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:43.749024 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f5b9b-630a-4f4f-8ec9-395fd1b5f6e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:43.750479 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f5b9b-630a-4f4f-8ec9-395fd1b5f6e8 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:43.764641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-5c1f5b9b-630a-4f4f-8ec9-395fd1b5f6e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:02:43.764641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:43.764641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:43.764641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:43.764641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:43.764641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:43.764641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:43.764641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:43.764641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:43.764641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:43.764641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:43.764641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:43.764641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 14:02:43.764641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 14:02:43.764641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 14:02:43.764641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 14:02:43.765744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:43.765744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:43.765744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:43.765744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:43.765744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:43.765744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:43.765744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:43.765744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:43.765744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:43.765744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:43.765744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:43.765744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:43.765744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:43.765744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:43.765744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:43.765744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:43.765744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 14:02:43.766624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 14:02:43.766624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:02:43.766624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:02:43.766624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 632/1269] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:43.771418 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f46cc-4260-4f36-a55b-d1ed67633f3c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:43.867128 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f46cc-4260-4f36-a55b-d1ed67633f3c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:43.901233 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82830c3-d8d6-4c5a-ba8d-0d7cd9da133b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:43.901821 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82830c3-d8d6-4c5a-ba8d-0d7cd9da133b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:43.902098 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82830c3-d8d6-4c5a-ba8d-0d7cd9da133b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:43.902362 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82830c3-d8d6-4c5a-ba8d-0d7cd9da133b None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:43.902989 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82830c3-d8d6-4c5a-ba8d-0d7cd9da133b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:43.903282 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82830c3-d8d6-4c5a-ba8d-0d7cd9da133b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:43.904657 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82830c3-d8d6-4c5a-ba8d-0d7cd9da133b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:43.915629 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 638/1270] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 14:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:43.921352 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f5b9b-630a-4f4f-8ec9-395fd1b5f6e8 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:43.952743 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:44.019175 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f5b9b-630a-4f4f-8ec9-395fd1b5f6e8 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:44.051124 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616aaaec-ee54-4120-9964-b8786e014d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:44.051733 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616aaaec-ee54-4120-9964-b8786e014d42 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:44.052009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616aaaec-ee54-4120-9964-b8786e014d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:44.052278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616aaaec-ee54-4120-9964-b8786e014d42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:44.058659 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616aaaec-ee54-4120-9964-b8786e014d42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:44.060106 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616aaaec-ee54-4120-9964-b8786e014d42 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:44.071463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-616aaaec-ee54-4120-9964-b8786e014d42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 14:02:44.071463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:44.071463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:44.071463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:44.071463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:44.071463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:44.071463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:44.071463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:44.071463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:44.071463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:44.071463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:44.071463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:44.071463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 14:02:44.071463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 14:02:44.071463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 14:02:44.072481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 14:02:44.072481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:44.072481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:44.072481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:44.072481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:44.072481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:44.072481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:44.072481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:44.072481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:44.072481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:44.072481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:44.072481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:44.072481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:44.072481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:44.072481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:44.072481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:44.072481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:44.073601 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 14:02:44.073601 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 14:02:44.073601 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 14:02:44.073601 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 14:02:44.073601 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 14:02:44.073601 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 14:02:44.073601 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 14:02:44.073601 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:02:44.073601 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 633/1271] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 14:02:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:44.078936 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82830c3-d8d6-4c5a-ba8d-0d7cd9da133b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:44.134502 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:44.175043 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82830c3-d8d6-4c5a-ba8d-0d7cd9da133b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:44.207729 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a86c6-25a2-47e4-a179-86c217785d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:44.208339 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a86c6-25a2-47e4-a179-86c217785d7b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:44.208615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a86c6-25a2-47e4-a179-86c217785d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:44.208881 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a86c6-25a2-47e4-a179-86c217785d7b None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:44.209589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a86c6-25a2-47e4-a179-86c217785d7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:44.209887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a86c6-25a2-47e4-a179-86c217785d7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:44.211293 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a86c6-25a2-47e4-a179-86c217785d7b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:44.222746 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 639/1272] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 14:02:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:44.228522 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616aaaec-ee54-4120-9964-b8786e014d42 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:44.320645 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:44.331343 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616aaaec-ee54-4120-9964-b8786e014d42 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:44.364446 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21feab6-555a-441b-a4bc-40e81eb87f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:44.365080 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21feab6-555a-441b-a4bc-40e81eb87f0c None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:44.365436 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21feab6-555a-441b-a4bc-40e81eb87f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:44.365705 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21feab6-555a-441b-a4bc-40e81eb87f0c None admin] PATH_INFO: `/v3/projects/17ba27c26bf34daa91cf8f7cc25bf086/users/311397bfe2c04569852fca0cfcdbad66/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:44.367548 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21feab6-555a-441b-a4bc-40e81eb87f0c None admin] RBAC: Authorizing `identity:create_grant(project_id=17ba27c26bf34daa91cf8f7cc25bf086, user_id=311397bfe2c04569852fca0cfcdbad66, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:44.368985 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21feab6-555a-441b-a4bc-40e81eb87f0c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:44.381771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 634/1273] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Sep 13 14:02:44 2022] PUT /identity/v3/projects/17ba27c26bf34daa91cf8f7cc25bf086/users/311397bfe2c04569852fca0cfcdbad66/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:02:46.485226 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49e213-88df-45dc-b7b5-ac7a3b781915 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:46.485787 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49e213-88df-45dc-b7b5-ac7a3b781915 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:46.485787 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49e213-88df-45dc-b7b5-ac7a3b781915 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:46.487100 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 640/1274] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:02:46.492245 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6ebbf-6e6f-4d3a-a338-aa890392f9aa None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:46.492645 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6ebbf-6e6f-4d3a-a338-aa890392f9aa None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:46.492791 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6ebbf-6e6f-4d3a-a338-aa890392f9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:46.510519 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d6a6ebbf-6e6f-4d3a-a338-aa890392f9aa None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:02:46.511680 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d6a6ebbf-6e6f-4d3a-a338-aa890392f9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:02:46.576645 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 635/1275] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:02:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:02:46.839555 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49e213-88df-45dc-b7b5-ac7a3b781915 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:46.941383 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49e213-88df-45dc-b7b5-ac7a3b781915 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:46.957995 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:46.974773 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c231cc1-3a0c-481d-9937-81804028e4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:46.975379 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c231cc1-3a0c-481d-9937-81804028e4f3 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:46.975649 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c231cc1-3a0c-481d-9937-81804028e4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:46.975910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c231cc1-3a0c-481d-9937-81804028e4f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:46.986222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c231cc1-3a0c-481d-9937-81804028e4f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 14:02:46.990940 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-1c231cc1-3a0c-481d-9937-81804028e4f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 14:02:46.990940 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:46.990940 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:46.990940 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:46.990940 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:46.990940 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:46.990940 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:46.990940 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:46.990940 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:46.990940 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:46.990940 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:46.990940 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:46.990940 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 14:02:46.990940 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 14:02:46.990940 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 14:02:46.990940 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 14:02:46.992034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 14:02:46.992034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 14:02:46.992034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 14:02:46.992034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 14:02:46.992034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:46.992034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:46.992034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:46.992034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:46.992034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:46.992034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:46.992034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:46.992034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:46.992034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:46.992034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:46.992034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:46.992034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:46.993022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:46.993022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:46.993022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:46.993022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:46.993022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 14:02:46.993022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 14:02:46.993022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 14:02:46.993022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 14:02:46.993022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 14:02:46.993022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 14:02:46.993022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 14:02:46.993022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:02:46.993022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 641/1276] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Sep 13 14:02:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:46.997954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6ebbf-6e6f-4d3a-a338-aa890392f9aa None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:47.074861 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:47.093568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6ebbf-6e6f-4d3a-a338-aa890392f9aa None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:47.126022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b70572d-4764-4d29-bc27-7f398c837dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:47.126605 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70572d-4764-4d29-bc27-7f398c837dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:47.126880 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70572d-4764-4d29-bc27-7f398c837dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:47.127145 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70572d-4764-4d29-bc27-7f398c837dd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:47.127791 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b70572d-4764-4d29-bc27-7f398c837dd7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:47.128084 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b70572d-4764-4d29-bc27-7f398c837dd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:47.129460 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b70572d-4764-4d29-bc27-7f398c837dd7 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:47.137164 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 636/1277] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Sep 13 14:02:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:47.142843 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c231cc1-3a0c-481d-9937-81804028e4f3 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:47.241064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c231cc1-3a0c-481d-9937-81804028e4f3 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:47.275464 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba212c-de26-4404-a6a8-4fdf95e62989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:47.276073 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba212c-de26-4404-a6a8-4fdf95e62989 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:47.276348 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba212c-de26-4404-a6a8-4fdf95e62989 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:47.276613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba212c-de26-4404-a6a8-4fdf95e62989 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:47.287280 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba212c-de26-4404-a6a8-4fdf95e62989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:47.288716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba212c-de26-4404-a6a8-4fdf95e62989 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:47.303559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-79ba212c-de26-4404-a6a8-4fdf95e62989 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:02:47.303559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:47.303559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:47.303559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:47.303559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:47.303559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:47.303559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:47.303559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:47.303559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:47.303559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:47.303559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:47.303559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:47.303559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 14:02:47.303559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 14:02:47.303559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 14:02:47.303559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 14:02:47.305271 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:47.305271 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:47.305271 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:47.305271 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:47.305271 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:47.305271 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:47.305271 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:47.305271 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:47.305271 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:47.305271 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:47.305271 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:47.305271 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:47.305271 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:47.305271 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:47.305271 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:47.305271 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:47.305271 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 14:02:47.306182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 14:02:47.306182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:02:47.306182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:02:47.306182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 642/1278] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:47.310892 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b70572d-4764-4d29-bc27-7f398c837dd7 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:47.420567 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b70572d-4764-4d29-bc27-7f398c837dd7 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:47.453076 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32dc731-881b-456a-a2e4-0bec5da2c8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:47.453700 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dc731-881b-456a-a2e4-0bec5da2c8fc None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:47.453981 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dc731-881b-456a-a2e4-0bec5da2c8fc None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:47.454252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dc731-881b-456a-a2e4-0bec5da2c8fc None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:47.454885 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32dc731-881b-456a-a2e4-0bec5da2c8fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:47.455188 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32dc731-881b-456a-a2e4-0bec5da2c8fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:47.456550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32dc731-881b-456a-a2e4-0bec5da2c8fc None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:47.468545 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 637/1279] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 14:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:47.474253 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba212c-de26-4404-a6a8-4fdf95e62989 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:47.503871 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:47.570231 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba212c-de26-4404-a6a8-4fdf95e62989 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:47.605467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd202f-6309-40d0-ad91-b32bc4f9b772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:47.606073 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd202f-6309-40d0-ad91-b32bc4f9b772 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:47.606337 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd202f-6309-40d0-ad91-b32bc4f9b772 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:47.606602 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd202f-6309-40d0-ad91-b32bc4f9b772 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:47.614087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd202f-6309-40d0-ad91-b32bc4f9b772 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:47.615512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd202f-6309-40d0-ad91-b32bc4f9b772 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:47.627409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-a6dd202f-6309-40d0-ad91-b32bc4f9b772 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 14:02:47.627409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:47.627409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:47.627409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:47.627409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:47.627409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:47.627409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:47.627409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:47.627409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:47.627409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:47.627409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:47.627409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:47.627409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 14:02:47.627409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 14:02:47.627409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 14:02:47.627409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 14:02:47.628542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:47.628542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:47.628542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 14:02:47.628542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 14:02:47.628542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 14:02:47.628542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 14:02:47.628542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:47.628542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:47.628542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:47.628542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:47.628542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:47.628542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:47.628542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:47.628542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:47.628542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:47.628542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:47.628542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:47.628542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:47.629545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:47.629545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:47.629545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 14:02:47.629545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 14:02:47.629545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 14:02:47.629545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 14:02:47.629545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 14:02:47.629545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 14:02:47.629545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 14:02:47.629545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:02:47.629545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 643/1280] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:02:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:47.634262 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32dc731-881b-456a-a2e4-0bec5da2c8fc None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:47.638037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:47.732514 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32dc731-881b-456a-a2e4-0bec5da2c8fc None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:47.765570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505f8d3-c15f-4f31-b73a-49fc9548100f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:47.766163 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505f8d3-c15f-4f31-b73a-49fc9548100f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:47.766444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505f8d3-c15f-4f31-b73a-49fc9548100f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:47.766716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505f8d3-c15f-4f31-b73a-49fc9548100f None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:47.767427 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505f8d3-c15f-4f31-b73a-49fc9548100f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:47.767730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505f8d3-c15f-4f31-b73a-49fc9548100f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:47.769174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505f8d3-c15f-4f31-b73a-49fc9548100f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:47.786434 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 638/1281] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Sep 13 14:02:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:47.792048 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd202f-6309-40d0-ad91-b32bc4f9b772 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:47.879961 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:47.890153 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd202f-6309-40d0-ad91-b32bc4f9b772 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:47.922456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1204098-2789-4964-9ed9-7e065d26b70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:47.923044 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1204098-2789-4964-9ed9-7e065d26b70a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:47.923323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1204098-2789-4964-9ed9-7e065d26b70a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:47.923596 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1204098-2789-4964-9ed9-7e065d26b70a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:47.988971 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1204098-2789-4964-9ed9-7e065d26b70a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:47.990378 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1204098-2789-4964-9ed9-7e065d26b70a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:48.076610 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:48.086931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 644/1282] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Sep 13 14:02:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 14:02:48.092722 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505f8d3-c15f-4f31-b73a-49fc9548100f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:48.152201 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:48.190004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505f8d3-c15f-4f31-b73a-49fc9548100f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:48.223317 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660fa03-47fb-4380-8b0a-426fb7432b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:48.223923 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660fa03-47fb-4380-8b0a-426fb7432b61 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:48.224199 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660fa03-47fb-4380-8b0a-426fb7432b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:48.224465 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660fa03-47fb-4380-8b0a-426fb7432b61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:48.234068 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660fa03-47fb-4380-8b0a-426fb7432b61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:48.235508 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660fa03-47fb-4380-8b0a-426fb7432b61 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:48.249839 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-0660fa03-47fb-4380-8b0a-426fb7432b61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:02:48.249839 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:48.249839 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:48.249839 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:48.249839 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:48.249839 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:48.249839 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:48.249839 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:48.249839 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:48.249839 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:48.249839 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:48.249839 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:48.249839 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 14:02:48.249839 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 14:02:48.249839 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 14:02:48.249839 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 14:02:48.250954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:48.250954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:48.250954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:48.250954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:48.250954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:48.250954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:48.250954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:48.250954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:48.250954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:48.250954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:48.250954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:48.250954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:48.250954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:48.250954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:48.250954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:48.250954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:48.250954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 14:02:48.252218 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 14:02:48.252218 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 14:02:48.252218 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:02:48.252218 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 639/1283] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:48.256443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1204098-2789-4964-9ed9-7e065d26b70a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:48.354348 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1204098-2789-4964-9ed9-7e065d26b70a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:48.386817 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4e9e2-c641-46ed-8f93-e6a8ed4a7b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:48.387405 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4e9e2-c641-46ed-8f93-e6a8ed4a7b28 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:48.387679 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4e9e2-c641-46ed-8f93-e6a8ed4a7b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:48.387946 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4e9e2-c641-46ed-8f93-e6a8ed4a7b28 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:48.389197 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4e9e2-c641-46ed-8f93-e6a8ed4a7b28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:48.389498 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4e9e2-c641-46ed-8f93-e6a8ed4a7b28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:48.390865 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4e9e2-c641-46ed-8f93-e6a8ed4a7b28 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:48.401597 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 645/1284] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Sep 13 14:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:48.407156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660fa03-47fb-4380-8b0a-426fb7432b61 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:48.505050 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660fa03-47fb-4380-8b0a-426fb7432b61 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:48.518595 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:48.538823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419555a-4825-4866-97b6-51a97aaf60a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:48.539431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419555a-4825-4866-97b6-51a97aaf60a8 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:48.539710 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419555a-4825-4866-97b6-51a97aaf60a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:48.539985 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419555a-4825-4866-97b6-51a97aaf60a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:48.546540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419555a-4825-4866-97b6-51a97aaf60a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:48.547980 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419555a-4825-4866-97b6-51a97aaf60a8 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:48.559017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-d419555a-4825-4866-97b6-51a97aaf60a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 14:02:48.559017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:48.559017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:48.559017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:48.559017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:48.559017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:48.559017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:48.559017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:48.559017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:48.559017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:48.559017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:48.559017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:48.559017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 14:02:48.559017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 14:02:48.559017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 14:02:48.560009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 14:02:48.560009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:48.560009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:48.560009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:48.560009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:48.560009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:48.560009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:48.560009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:48.560009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:48.560009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:48.560009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:48.560009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:48.560009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:48.560009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:48.560009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:48.560009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:48.560009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:48.561477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 14:02:48.561477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 14:02:48.561477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 14:02:48.561477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 14:02:48.561477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 14:02:48.561477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 14:02:48.561477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 14:02:48.561477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 13 14:02:48.561477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 640/1285] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Sep 13 14:02:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:48.566258 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4e9e2-c641-46ed-8f93-e6a8ed4a7b28 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:48.613990 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:48.666183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4e9e2-c641-46ed-8f93-e6a8ed4a7b28 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:48.697976 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc04dd-2e2f-46bf-ba90-7aa57560c7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:48.698561 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc04dd-2e2f-46bf-ba90-7aa57560c7ff None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:48.698832 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc04dd-2e2f-46bf-ba90-7aa57560c7ff None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:48.699095 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc04dd-2e2f-46bf-ba90-7aa57560c7ff None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:48.699771 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc04dd-2e2f-46bf-ba90-7aa57560c7ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:48.700068 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc04dd-2e2f-46bf-ba90-7aa57560c7ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:48.702109 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc04dd-2e2f-46bf-ba90-7aa57560c7ff None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:48.713467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 646/1286] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Sep 13 14:02:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:48.719444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419555a-4825-4866-97b6-51a97aaf60a8 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:48.817749 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419555a-4825-4866-97b6-51a97aaf60a8 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:48.849669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07f05f-b121-42c4-91cc-289fbe79211e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:48.850251 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07f05f-b121-42c4-91cc-289fbe79211e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:48.850530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07f05f-b121-42c4-91cc-289fbe79211e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:48.850799 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07f05f-b121-42c4-91cc-289fbe79211e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:48.851506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07f05f-b121-42c4-91cc-289fbe79211e None admin] RBAC: Adding query filter params (role.id=6dcc8495d2b24b3eab63dd656eb4eb6d, scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086, user.id=311397bfe2c04569852fca0cfcdbad66) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:48.851811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07f05f-b121-42c4-91cc-289fbe79211e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:48.853251 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07f05f-b121-42c4-91cc-289fbe79211e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:48.859293 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 641/1287] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Sep 13 14:02:48 2022] GET /identity/v3/role_assignments?user.id=311397bfe2c04569852fca0cfcdbad66&scope.project.id=17ba27c26bf34daa91cf8f7cc25bf086&role.id=6dcc8495d2b24b3eab63dd656eb4eb6d => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:51.005340 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e64921-57b8-45c9-ac27-5092dfec5708 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:51.005857 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e64921-57b8-45c9-ac27-5092dfec5708 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:51.005943 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e64921-57b8-45c9-ac27-5092dfec5708 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:51.007230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 647/1288] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:02:51.012508 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa38092-3142-4448-985a-1f55ce11dd80 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:51.012880 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa38092-3142-4448-985a-1f55ce11dd80 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:51.013055 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa38092-3142-4448-985a-1f55ce11dd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:51.031735 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-7aa38092-3142-4448-985a-1f55ce11dd80 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:02:51.033209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7aa38092-3142-4448-985a-1f55ce11dd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:02:51.060981 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:51.097637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 642/1289] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:02:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:02:51.381988 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e64921-57b8-45c9-ac27-5092dfec5708 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:51.479282 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e64921-57b8-45c9-ac27-5092dfec5708 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:51.489462 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:51.512408 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042c02c-8758-4685-8301-67fea289f3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:51.513016 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042c02c-8758-4685-8301-67fea289f3bb None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:51.513368 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042c02c-8758-4685-8301-67fea289f3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:51.513639 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042c02c-8758-4685-8301-67fea289f3bb None admin] PATH_INFO: `/v3/services/placement` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:51.514212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042c02c-8758-4685-8301-67fea289f3bb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:51.515567 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042c02c-8758-4685-8301-67fea289f3bb None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:51.524052 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-6042c02c-8758-4685-8301-67fea289f3bb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 14:02:51.524052 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:51.524052 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 14:02:51.524052 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 14:02:51.524052 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 14:02:51.524052 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 14:02:51.524052 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 14:02:51.524052 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:02:51.524052 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 14:02:51.524052 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:02:51.524052 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 14:02:51.524052 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:02:51.524052 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:51.524052 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:51.524052 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:51.524052 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:51.524052 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:51.525222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:51.525222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:51.525222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:51.525222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:51.525222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:51.525222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:51.525222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 14:02:51.525222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 14:02:51.525222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 14:02:51.525222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 14:02:51.525222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:51.525222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:51.525222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:51.525222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:51.525222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:51.525222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:51.526399 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:51.526399 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:51.526399 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:51.526399 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:51.526399 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:51.526399 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:51.526399 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:51.526399 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:51.526399 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:51.526399 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:51.526399 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 14:02:51.526399 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:02:51.526399 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 14:02:51.526399 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:02:51.526399 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 648/1290] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Sep 13 14:02:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:51.531522 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa38092-3142-4448-985a-1f55ce11dd80 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:51.626659 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa38092-3142-4448-985a-1f55ce11dd80 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:51.659892 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ccd9b-7750-407f-ad81-e08bb67bfc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:51.660421 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ccd9b-7750-407f-ad81-e08bb67bfc67 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:51.660695 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ccd9b-7750-407f-ad81-e08bb67bfc67 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:51.660959 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ccd9b-7750-407f-ad81-e08bb67bfc67 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:51.661665 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ccd9b-7750-407f-ad81-e08bb67bfc67 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:51.661963 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ccd9b-7750-407f-ad81-e08bb67bfc67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:51.663314 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ccd9b-7750-407f-ad81-e08bb67bfc67 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:51.668020 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 643/1291] 10.222.0.26 () {56 vars in 1116 bytes} [Tue Sep 13 14:02:51 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:51.674242 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042c02c-8758-4685-8301-67fea289f3bb None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:51.771059 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042c02c-8758-4685-8301-67fea289f3bb None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:51.803769 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1e7e7-0ae7-4901-bea5-00a15c625ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:51.804373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1e7e7-0ae7-4901-bea5-00a15c625ebb None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:51.804650 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1e7e7-0ae7-4901-bea5-00a15c625ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:51.804921 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1e7e7-0ae7-4901-bea5-00a15c625ebb None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:51.805568 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1e7e7-0ae7-4901-bea5-00a15c625ebb None admin] RBAC: Adding query filter params (type=placement) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:51.805868 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1e7e7-0ae7-4901-bea5-00a15c625ebb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:51.807225 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1e7e7-0ae7-4901-bea5-00a15c625ebb None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:51.811537 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 649/1292] 10.222.0.26 () {56 vars in 1116 bytes} [Tue Sep 13 14:02:51 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:53.951833 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519063d-2cfa-4f61-be96-ac39081132a4 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:53.952380 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519063d-2cfa-4f61-be96-ac39081132a4 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:53.952380 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519063d-2cfa-4f61-be96-ac39081132a4 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:53.953750 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 644/1293] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:02:53.959054 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e345941-5316-4b24-b963-10b6798a588b None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:53.959446 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e345941-5316-4b24-b963-10b6798a588b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:53.959594 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e345941-5316-4b24-b963-10b6798a588b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:53.978105 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-0e345941-5316-4b24-b963-10b6798a588b None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:02:53.979271 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0e345941-5316-4b24-b963-10b6798a588b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:02:54.007950 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:54.045498 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 650/1294] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:02:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:02:54.315869 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519063d-2cfa-4f61-be96-ac39081132a4 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:54.351389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:54.424710 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519063d-2cfa-4f61-be96-ac39081132a4 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:54.457663 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840f3dc-c957-4c55-bb6a-8fab8155af5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:54.458251 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840f3dc-c957-4c55-bb6a-8fab8155af5e None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:54.458526 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840f3dc-c957-4c55-bb6a-8fab8155af5e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:54.458791 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840f3dc-c957-4c55-bb6a-8fab8155af5e None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:54.459434 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840f3dc-c957-4c55-bb6a-8fab8155af5e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:54.460787 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840f3dc-c957-4c55-bb6a-8fab8155af5e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:54.474403 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 645/1295] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Sep 13 14:02:54 2022] POST /identity/v3/services => generated 246 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:02:56.605414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dddbe-c4fa-4b23-a26f-9d856a436f0e None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:56.605970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dddbe-c4fa-4b23-a26f-9d856a436f0e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:56.605970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dddbe-c4fa-4b23-a26f-9d856a436f0e None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:56.607790 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 651/1296] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:02:56.612882 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c88ca-ceb4-4eaa-aa71-1f21edf142a7 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:56.613342 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c88ca-ceb4-4eaa-aa71-1f21edf142a7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:56.613436 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c88ca-ceb4-4eaa-aa71-1f21edf142a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:56.631904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a05c88ca-ceb4-4eaa-aa71-1f21edf142a7 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:02:56.633086 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a05c88ca-ceb4-4eaa-aa71-1f21edf142a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:02:56.704655 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 646/1297] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:02:56 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:02:56.968266 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dddbe-c4fa-4b23-a26f-9d856a436f0e None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:57.066188 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dddbe-c4fa-4b23-a26f-9d856a436f0e None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:57.099448 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb1b15-3756-40d9-9a25-3bf6f4de3728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:57.100047 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb1b15-3756-40d9-9a25-3bf6f4de3728 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:57.100313 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb1b15-3756-40d9-9a25-3bf6f4de3728 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:57.100572 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb1b15-3756-40d9-9a25-3bf6f4de3728 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:57.101164 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb1b15-3756-40d9-9a25-3bf6f4de3728 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:57.102513 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb1b15-3756-40d9-9a25-3bf6f4de3728 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:57.111512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-65bb1b15-3756-40d9-9a25-3bf6f4de3728 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 14:02:57.111512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:57.111512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 14:02:57.111512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 14:02:57.111512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 14:02:57.111512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 14:02:57.111512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 14:02:57.111512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:02:57.111512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 14:02:57.111512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:02:57.111512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 14:02:57.111512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:02:57.111512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:02:57.111512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:02:57.111512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:02:57.111512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:02:57.111512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:02:57.112686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:02:57.112686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:02:57.112686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:02:57.112686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:02:57.112686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:02:57.112686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:02:57.112686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 14:02:57.112686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 14:02:57.112686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 14:02:57.112686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 14:02:57.112686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:02:57.112686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:02:57.112686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:02:57.112686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:02:57.112686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:02:57.112686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:02:57.113746 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:02:57.113746 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:02:57.113746 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:02:57.113746 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:02:57.113746 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:02:57.113746 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:02:57.113746 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:02:57.113746 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:02:57.113746 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:02:57.113746 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:02:57.113746 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 14:02:57.113746 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:02:57.113746 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 14:02:57.113746 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:02:57.113746 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 652/1298] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Sep 13 14:02:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:02:57.118551 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c88ca-ceb4-4eaa-aa71-1f21edf142a7 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:57.136751 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:57.215707 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c88ca-ceb4-4eaa-aa71-1f21edf142a7 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:57.249200 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f85b8-82fa-4d11-abbc-231d3e101098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:57.249729 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f85b8-82fa-4d11-abbc-231d3e101098 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:57.250005 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f85b8-82fa-4d11-abbc-231d3e101098 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:57.250274 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f85b8-82fa-4d11-abbc-231d3e101098 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:57.250888 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f85b8-82fa-4d11-abbc-231d3e101098 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:57.251185 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f85b8-82fa-4d11-abbc-231d3e101098 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:57.252543 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f85b8-82fa-4d11-abbc-231d3e101098 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:57.257569 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 647/1299] 10.222.0.26 () {56 vars in 1116 bytes} [Tue Sep 13 14:02:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:57.263363 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb1b15-3756-40d9-9a25-3bf6f4de3728 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:57.293821 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:57.362979 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb1b15-3756-40d9-9a25-3bf6f4de3728 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:57.394931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910c143-0d05-4f7b-88c3-0aea5bcfa1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:57.395511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910c143-0d05-4f7b-88c3-0aea5bcfa1b4 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:57.395781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910c143-0d05-4f7b-88c3-0aea5bcfa1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:57.396045 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910c143-0d05-4f7b-88c3-0aea5bcfa1b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:57.396726 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910c143-0d05-4f7b-88c3-0aea5bcfa1b4 None admin] RBAC: Adding query filter params (interface=public, service_id=673cf24a638b43489f713d8f18bd5cb3, region_id=RegionOne) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:02:57.397021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910c143-0d05-4f7b-88c3-0aea5bcfa1b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:57.398419 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910c143-0d05-4f7b-88c3-0aea5bcfa1b4 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:57.403218 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 653/1300] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Sep 13 14:02:57 2022] GET /identity/v3/endpoints?service_id=673cf24a638b43489f713d8f18bd5cb3&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:02:57.409639 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f85b8-82fa-4d11-abbc-231d3e101098 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:02:57.496910 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:02:57.521551 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f85b8-82fa-4d11-abbc-231d3e101098 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:02:57.558636 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b499035-03af-47e8-a9d7-36105547a81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:02:57.559231 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b499035-03af-47e8-a9d7-36105547a81c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:57.559509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b499035-03af-47e8-a9d7-36105547a81c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:57.559779 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b499035-03af-47e8-a9d7-36105547a81c None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:57.560404 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b499035-03af-47e8-a9d7-36105547a81c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:02:57.561818 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b499035-03af-47e8-a9d7-36105547a81c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:02:57.568433 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 648/1301] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Sep 13 14:02:57 2022] GET /identity/v3/services => generated 2191 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:02:59.699703 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fe7a5-f26a-40a6-9adf-88dd74ba37f8 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:59.700171 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fe7a5-f26a-40a6-9adf-88dd74ba37f8 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:59.700286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fe7a5-f26a-40a6-9adf-88dd74ba37f8 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:59.701681 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 654/1302] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:02:59.706890 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8a00d-625a-4996-abf0-829e7c0802ef None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:02:59.707330 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8a00d-625a-4996-abf0-829e7c0802ef None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:02:59.707425 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8a00d-625a-4996-abf0-829e7c0802ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:02:59.725728 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-70d8a00d-625a-4996-abf0-829e7c0802ef None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:02:59.726905 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-70d8a00d-625a-4996-abf0-829e7c0802ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:02:59.791446 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 649/1303] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:02:59 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 14:03:00.056586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104fe7a5-f26a-40a6-9adf-88dd74ba37f8 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:03:00.149154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:03:00.156151 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104fe7a5-f26a-40a6-9adf-88dd74ba37f8 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:03:00.189438 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee96329-f86d-4bc3-b600-e97a6212cfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:03:00.190054 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee96329-f86d-4bc3-b600-e97a6212cfe5 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:03:00.190329 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee96329-f86d-4bc3-b600-e97a6212cfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:03:00.190597 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee96329-f86d-4bc3-b600-e97a6212cfe5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:03:00.191172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee96329-f86d-4bc3-b600-e97a6212cfe5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:03:00.192540 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee96329-f86d-4bc3-b600-e97a6212cfe5 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:03:00.201549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-bee96329-f86d-4bc3-b600-e97a6212cfe5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 14:03:00.201549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:03:00.201549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 14:03:00.201549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 14:03:00.201549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 14:03:00.201549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 14:03:00.201549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 14:03:00.201549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:03:00.201549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 14:03:00.201549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:03:00.201549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 14:03:00.201549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:03:00.201549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 14:03:00.201549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 14:03:00.201549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 14:03:00.201549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 14:03:00.201549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 14:03:00.202711 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 14:03:00.202711 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 14:03:00.202711 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 14:03:00.202711 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 14:03:00.202711 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 14:03:00.202711 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 14:03:00.202711 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 14:03:00.202711 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 14:03:00.202711 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 14:03:00.202711 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 14:03:00.202711 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 14:03:00.202711 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 14:03:00.202711 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 14:03:00.202711 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 14:03:00.202711 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 14:03:00.202711 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 14:03:00.203596 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 14:03:00.203596 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 13 14:03:00.203596 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 14:03:00.203596 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 13 14:03:00.203596 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 14:03:00.203596 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 14:03:00.203596 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 14:03:00.203596 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 13 14:03:00.203596 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 14:03:00.203596 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 13 14:03:00.203596 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 14:03:00.203596 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 14:03:00.203596 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 14:03:00.203596 dv-cinder-857434-1-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 13 14:03:00.203596 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 655/1304] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Sep 13 14:03:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 14:03:00.208752 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8a00d-625a-4996-abf0-829e7c0802ef None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:03:00.282005 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:03:00.305218 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8a00d-625a-4996-abf0-829e7c0802ef None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:03:00.338520 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1be40-23c8-43ba-97f8-e3a0798ecbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:03:00.339057 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1be40-23c8-43ba-97f8-e3a0798ecbdf None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:03:00.339333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1be40-23c8-43ba-97f8-e3a0798ecbdf None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:03:00.339601 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1be40-23c8-43ba-97f8-e3a0798ecbdf None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:03:00.340216 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1be40-23c8-43ba-97f8-e3a0798ecbdf None admin] RBAC: Adding query filter params (name=placement) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:03:00.340513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1be40-23c8-43ba-97f8-e3a0798ecbdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:03:00.341896 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1be40-23c8-43ba-97f8-e3a0798ecbdf None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:03:00.346857 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 650/1305] 10.222.0.26 () {56 vars in 1116 bytes} [Tue Sep 13 14:03:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:03:00.352608 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee96329-f86d-4bc3-b600-e97a6212cfe5 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:03:00.449755 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee96329-f86d-4bc3-b600-e97a6212cfe5 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:03:00.483467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bd635-f1fb-40db-88b7-778cb93201ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:03:00.484050 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bd635-f1fb-40db-88b7-778cb93201ee None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:03:00.484326 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bd635-f1fb-40db-88b7-778cb93201ee None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:03:00.484592 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bd635-f1fb-40db-88b7-778cb93201ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:03:00.485284 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451bd635-f1fb-40db-88b7-778cb93201ee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:03:00.486637 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451bd635-f1fb-40db-88b7-778cb93201ee None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:03:00.505372 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 656/1306] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:03:00 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:03:10.344003 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=30 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:03:10.501257 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:03.803194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea39e2-cbd4-4437-ad51-1f6dcd7b88fb None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:03.803613 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea39e2-cbd4-4437-ad51-1f6dcd7b88fb None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:03.803802 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea39e2-cbd4-4437-ad51-1f6dcd7b88fb None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:03.810451 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088ad41-5814-422e-84bb-e93e0ffea0f0 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:03.810853 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088ad41-5814-422e-84bb-e93e0ffea0f0 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:03.811031 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088ad41-5814-422e-84bb-e93e0ffea0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:03.813949 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 651/1307] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:04:03 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:04:03.937416 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-1088ad41-5814-422e-84bb-e93e0ffea0f0 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:04:03.939086 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1088ad41-5814-422e-84bb-e93e0ffea0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:04.093481 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 657/1308] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:04:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:04:04.395679 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b08868-bbbe-4bb7-aecd-b57362bf1286 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:04.396046 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b08868-bbbe-4bb7-aecd-b57362bf1286 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:04.396580 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b08868-bbbe-4bb7-aecd-b57362bf1286 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:04.398844 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 652/1309] 10.222.0.26 () {54 vars in 965 bytes} [Tue Sep 13 14:04:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:04:04.405163 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a16a1-a72b-4b40-b17c-291164524d6d None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:04.405727 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a16a1-a72b-4b40-b17c-291164524d6d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:04.406208 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a16a1-a72b-4b40-b17c-291164524d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:04.492166 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-749a16a1-a72b-4b40-b17c-291164524d6d None None] MFA Rules not processed for user `cb992cf1a7a445119262b567ce345181`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:04:04.493864 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-749a16a1-a72b-4b40-b17c-291164524d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:04.518597 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:04.583951 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 658/1310] 10.222.0.26 () {58 vars in 1062 bytes} [Tue Sep 13 14:04:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:04:04.593235 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b08868-bbbe-4bb7-aecd-b57362bf1286 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:04:04.595326 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d7b08868-bbbe-4bb7-aecd-b57362bf1286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:04.741333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b08868-bbbe-4bb7-aecd-b57362bf1286 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:04:04.827141 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9ba43-ab0c-45e0-b9c5-1dab09599031 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:04:04.827814 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9ba43-ab0c-45e0-b9c5-1dab09599031 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:04.828051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9ba43-ab0c-45e0-b9c5-1dab09599031 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:04.828291 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9ba43-ab0c-45e0-b9c5-1dab09599031 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:04.829984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8ca9ba43-ab0c-45e0-b9c5-1dab09599031 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:04.892762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:04.952005 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9ba43-ab0c-45e0-b9c5-1dab09599031 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:04:04.953491 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9ba43-ab0c-45e0-b9c5-1dab09599031 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:04:04.978453 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 653/1311] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:04:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:04:07.493147 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2ec98-204e-486b-8597-216cb0ed28b2 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:07.493757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2ec98-204e-486b-8597-216cb0ed28b2 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:07.493757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2ec98-204e-486b-8597-216cb0ed28b2 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:07.495097 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 659/1312] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:04:07.501537 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cb371-18b9-4459-830a-60c73a619c9b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:07.502059 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cb371-18b9-4459-830a-60c73a619c9b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:07.502059 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cb371-18b9-4459-830a-60c73a619c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:07.572942 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5b5cb371-18b9-4459-830a-60c73a619c9b None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:04:07.574179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5b5cb371-18b9-4459-830a-60c73a619c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:07.684245 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 654/1313] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:04:07.965976 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2ec98-204e-486b-8597-216cb0ed28b2 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:04:07.967518 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c1e2ec98-204e-486b-8597-216cb0ed28b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:08.070141 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2ec98-204e-486b-8597-216cb0ed28b2 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:04:08.141176 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:08.143417 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513eec4-9dc9-4de2-b5e5-431d00ea264d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:04:08.144213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513eec4-9dc9-4de2-b5e5-431d00ea264d service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:08.144645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513eec4-9dc9-4de2-b5e5-431d00ea264d service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:08.144951 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513eec4-9dc9-4de2-b5e5-431d00ea264d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:08.146748 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b513eec4-9dc9-4de2-b5e5-431d00ea264d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:08.253464 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513eec4-9dc9-4de2-b5e5-431d00ea264d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:04:08.254812 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513eec4-9dc9-4de2-b5e5-431d00ea264d service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:04:08.272839 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 660/1314] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:04:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:04:10.722754 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721c3ad-9310-4669-9a00-a4d9e5c6e628 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:10.723298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721c3ad-9310-4669-9a00-a4d9e5c6e628 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:10.723298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721c3ad-9310-4669-9a00-a4d9e5c6e628 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:10.724637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 655/1315] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:04:10.729953 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b4835-78e4-40de-a054-e1b9f8d7ccf5 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:10.730352 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b4835-78e4-40de-a054-e1b9f8d7ccf5 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:10.730495 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b4835-78e4-40de-a054-e1b9f8d7ccf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:10.795762 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-be7b4835-78e4-40de-a054-e1b9f8d7ccf5 None None] MFA Rules not processed for user `c34f788e4ffe4f7aad092b4dfbe64357`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:04:10.796957 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-be7b4835-78e4-40de-a054-e1b9f8d7ccf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:10.848054 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:10.892572 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 661/1316] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:04:10 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:04:11.173561 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721c3ad-9310-4669-9a00-a4d9e5c6e628 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:04:11.175110 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f721c3ad-9310-4669-9a00-a4d9e5c6e628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:11.185704 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:11.278341 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721c3ad-9310-4669-9a00-a4d9e5c6e628 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:04:11.357699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6a2e3-39be-43fa-a828-1152998c0f1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:04:11.358293 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6a2e3-39be-43fa-a828-1152998c0f1d service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:11.358565 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6a2e3-39be-43fa-a828-1152998c0f1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:11.358828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6a2e3-39be-43fa-a828-1152998c0f1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:11.360409 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-aff6a2e3-39be-43fa-a828-1152998c0f1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:11.420951 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:11.467465 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6a2e3-39be-43fa-a828-1152998c0f1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:04:11.468887 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6a2e3-39be-43fa-a828-1152998c0f1d service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:04:11.486277 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 656/1317] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:04:11 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:04:14.163963 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452c1d2-c9cc-4d4d-a90b-099546ca39f4 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:14.164528 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452c1d2-c9cc-4d4d-a90b-099546ca39f4 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:14.164528 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452c1d2-c9cc-4d4d-a90b-099546ca39f4 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:14.165914 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 662/1318] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:04:14.171239 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb0e55-811b-4e41-94d3-80808e0d89ba None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:14.171619 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb0e55-811b-4e41-94d3-80808e0d89ba None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:14.171791 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb0e55-811b-4e41-94d3-80808e0d89ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:14.236620 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-69cb0e55-811b-4e41-94d3-80808e0d89ba None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:04:14.237851 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-69cb0e55-811b-4e41-94d3-80808e0d89ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:14.335701 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 657/1319] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:04:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:04:14.626730 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452c1d2-c9cc-4d4d-a90b-099546ca39f4 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:04:14.628261 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4452c1d2-c9cc-4d4d-a90b-099546ca39f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:14.730736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452c1d2-c9cc-4d4d-a90b-099546ca39f4 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:04:14.803030 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64b885-aecf-4d90-931c-b25c557d845e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:04:14.803613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64b885-aecf-4d90-931c-b25c557d845e service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:14.803884 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64b885-aecf-4d90-931c-b25c557d845e service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:14.804148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64b885-aecf-4d90-931c-b25c557d845e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:14.805732 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-9e64b885-aecf-4d90-931c-b25c557d845e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:14.812641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:14.913523 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64b885-aecf-4d90-931c-b25c557d845e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:04:14.914880 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64b885-aecf-4d90-931c-b25c557d845e service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:04:14.933743 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 663/1320] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:04:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:04:17.819719 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6c272-d6a0-49c4-a7cb-e2b98b4fc279 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:17.820252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6c272-d6a0-49c4-a7cb-e2b98b4fc279 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:17.820252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6c272-d6a0-49c4-a7cb-e2b98b4fc279 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:17.821668 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 658/1321] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:04:17.827490 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c5d02-6dbc-44a0-b50a-3f172f4f457c None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:17.827992 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c5d02-6dbc-44a0-b50a-3f172f4f457c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:17.828073 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c5d02-6dbc-44a0-b50a-3f172f4f457c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:17.900269 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-387c5d02-6dbc-44a0-b50a-3f172f4f457c None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:04:17.901430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-387c5d02-6dbc-44a0-b50a-3f172f4f457c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:17.962523 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:18.002371 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 664/1322] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:04:18.298290 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f307eb-4857-4ff6-a2f9-b6063a9a9513 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:18.298682 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f307eb-4857-4ff6-a2f9-b6063a9a9513 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:18.299027 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f307eb-4857-4ff6-a2f9-b6063a9a9513 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:18.300453 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 659/1323] 10.222.0.26 () {54 vars in 965 bytes} [Tue Sep 13 14:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:04:18.306797 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae541c8-f8a3-4537-b016-78741c25f4f3 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:18.307086 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae541c8-f8a3-4537-b016-78741c25f4f3 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:18.307391 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae541c8-f8a3-4537-b016-78741c25f4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:18.385124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-2ae541c8-f8a3-4537-b016-78741c25f4f3 None None] MFA Rules not processed for user `cb992cf1a7a445119262b567ce345181`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:04:18.386362 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2ae541c8-f8a3-4537-b016-78741c25f4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:18.460292 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 665/1324] 10.222.0.26 () {58 vars in 1062 bytes} [Tue Sep 13 14:04:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:04:18.469754 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f307eb-4857-4ff6-a2f9-b6063a9a9513 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:04:18.471263 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c4f307eb-4857-4ff6-a2f9-b6063a9a9513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:18.491748 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:18.575085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f307eb-4857-4ff6-a2f9-b6063a9a9513 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:04:18.651446 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a47ffb-608c-4600-9215-8ce7fdd605e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:04:18.652563 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a47ffb-608c-4600-9215-8ce7fdd605e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:18.652833 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a47ffb-608c-4600-9215-8ce7fdd605e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:18.653119 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a47ffb-608c-4600-9215-8ce7fdd605e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:18.654688 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f7a47ffb-608c-4600-9215-8ce7fdd605e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:18.723753 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:18.763680 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a47ffb-608c-4600-9215-8ce7fdd605e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:04:18.765284 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a47ffb-608c-4600-9215-8ce7fdd605e6 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:04:18.784744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 660/1325] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:04:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:04:21.210531 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d329d99-da1c-45a9-8b35-257ddaa87777 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:21.211069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d329d99-da1c-45a9-8b35-257ddaa87777 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:21.211069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d329d99-da1c-45a9-8b35-257ddaa87777 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:21.212455 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 666/1326] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:04:21.218313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d679d-e294-426a-8f18-f30482f7500b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:21.218735 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d679d-e294-426a-8f18-f30482f7500b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:21.218845 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d679d-e294-426a-8f18-f30482f7500b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:21.284311 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-144d679d-e294-426a-8f18-f30482f7500b None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:04:21.285531 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-144d679d-e294-426a-8f18-f30482f7500b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:21.385932 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 661/1327] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:04:21.662213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d329d99-da1c-45a9-8b35-257ddaa87777 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:04:21.663758 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7d329d99-da1c-45a9-8b35-257ddaa87777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:21.728692 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:21.774333 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d329d99-da1c-45a9-8b35-257ddaa87777 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:04:21.849412 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529897f-9773-43c8-8fba-ff6eb0272f14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:04:21.850145 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529897f-9773-43c8-8fba-ff6eb0272f14 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:21.850371 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529897f-9773-43c8-8fba-ff6eb0272f14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:21.850640 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529897f-9773-43c8-8fba-ff6eb0272f14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:21.852258 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8529897f-9773-43c8-8fba-ff6eb0272f14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:21.959268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:21.962192 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529897f-9773-43c8-8fba-ff6eb0272f14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:04:21.964526 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529897f-9773-43c8-8fba-ff6eb0272f14 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:04:21.984881 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 667/1328] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:04:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 14:04:24.215201 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615802f-4cac-4521-96e7-9c1aff5db347 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:24.215739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615802f-4cac-4521-96e7-9c1aff5db347 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:24.215739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615802f-4cac-4521-96e7-9c1aff5db347 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:24.217105 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 662/1329] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:04:24.222602 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f213781-3bb3-4aa1-b6fe-80e1a1bf0836 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:24.223081 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f213781-3bb3-4aa1-b6fe-80e1a1bf0836 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:24.223189 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f213781-3bb3-4aa1-b6fe-80e1a1bf0836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:24.291612 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-7f213781-3bb3-4aa1-b6fe-80e1a1bf0836 None None] MFA Rules not processed for user `c34f788e4ffe4f7aad092b4dfbe64357`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:04:24.293373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7f213781-3bb3-4aa1-b6fe-80e1a1bf0836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:24.390509 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 668/1330] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:04:24 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:04:24.670207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615802f-4cac-4521-96e7-9c1aff5db347 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:04:24.671725 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9615802f-4cac-4521-96e7-9c1aff5db347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:24.703717 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:24.787964 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615802f-4cac-4521-96e7-9c1aff5db347 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:04:24.865961 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f31a5a-0e78-4817-881a-7294ecaddcfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:04:24.866556 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f31a5a-0e78-4817-881a-7294ecaddcfe service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:24.866834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f31a5a-0e78-4817-881a-7294ecaddcfe service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:24.867102 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f31a5a-0e78-4817-881a-7294ecaddcfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:24.868738 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f9f31a5a-0e78-4817-881a-7294ecaddcfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:24.954830 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:24.991854 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f31a5a-0e78-4817-881a-7294ecaddcfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:04:24.993272 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f31a5a-0e78-4817-881a-7294ecaddcfe service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:04:25.012880 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 663/1331] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:04:24 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:04:27.357069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7425f5-4f7b-4e4c-a787-f975169cf473 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:27.357631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7425f5-4f7b-4e4c-a787-f975169cf473 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:27.357631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7425f5-4f7b-4e4c-a787-f975169cf473 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:27.359004 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 669/1332] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:04:27.364154 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6077f-43b2-4460-9d6d-cebca718606e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:27.364579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6077f-43b2-4460-9d6d-cebca718606e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:27.364700 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6077f-43b2-4460-9d6d-cebca718606e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:27.429854 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-2df6077f-43b2-4460-9d6d-cebca718606e None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:04:27.431042 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2df6077f-43b2-4460-9d6d-cebca718606e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:27.526950 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 664/1333] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:04:27.816443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7425f5-4f7b-4e4c-a787-f975169cf473 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:04:27.818006 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5a7425f5-4f7b-4e4c-a787-f975169cf473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:27.888136 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:27.922007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7425f5-4f7b-4e4c-a787-f975169cf473 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:04:27.994318 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97743f-6ee0-4e57-ba27-3c409cc7ce74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:04:27.994908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97743f-6ee0-4e57-ba27-3c409cc7ce74 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:27.995220 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97743f-6ee0-4e57-ba27-3c409cc7ce74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:27.995489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97743f-6ee0-4e57-ba27-3c409cc7ce74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:27.997075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-fc97743f-6ee0-4e57-ba27-3c409cc7ce74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:28.103553 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97743f-6ee0-4e57-ba27-3c409cc7ce74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:04:28.105073 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97743f-6ee0-4e57-ba27-3c409cc7ce74 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:04:28.114918 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:28.124188 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 670/1334] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:04:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 14:04:30.319990 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1ecfe-a7cc-481a-93fd-f4a7f092750e None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:30.320524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1ecfe-a7cc-481a-93fd-f4a7f092750e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:30.320524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1ecfe-a7cc-481a-93fd-f4a7f092750e None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:30.321910 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 665/1335] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:04:30.327306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8863cc2-1dc4-48ec-82b6-a0cc533989a9 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:30.327721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8863cc2-1dc4-48ec-82b6-a0cc533989a9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:30.327852 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8863cc2-1dc4-48ec-82b6-a0cc533989a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:30.397030 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-a8863cc2-1dc4-48ec-82b6-a0cc533989a9 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:04:30.398266 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a8863cc2-1dc4-48ec-82b6-a0cc533989a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:30.493020 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 671/1336] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:04:30.777568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1ecfe-a7cc-481a-93fd-f4a7f092750e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:04:30.779078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-58c1ecfe-a7cc-481a-93fd-f4a7f092750e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:30.818614 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:30.880782 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1ecfe-a7cc-481a-93fd-f4a7f092750e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:04:30.952934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f15d3-8175-4983-bca5-fa2d5378b8b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:04:30.953550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f15d3-8175-4983-bca5-fa2d5378b8b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:30.953824 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f15d3-8175-4983-bca5-fa2d5378b8b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:30.954091 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f15d3-8175-4983-bca5-fa2d5378b8b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:30.955643 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e69f15d3-8175-4983-bca5-fa2d5378b8b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:31.037528 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:31.063908 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f15d3-8175-4983-bca5-fa2d5378b8b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:04:31.065369 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f15d3-8175-4983-bca5-fa2d5378b8b7 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:04:31.082796 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 666/1337] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:04:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:04:33.527566 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aba6d2-2ac4-4f2a-b204-2cae786e7cb8 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:33.528124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aba6d2-2ac4-4f2a-b204-2cae786e7cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:33.528124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aba6d2-2ac4-4f2a-b204-2cae786e7cb8 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:33.529529 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 672/1338] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:04:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:04:33.535004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a77bc7-16d8-4c04-83e0-7ed0d3c07221 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:33.535402 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a77bc7-16d8-4c04-83e0-7ed0d3c07221 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:33.535587 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a77bc7-16d8-4c04-83e0-7ed0d3c07221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:33.604070 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-78a77bc7-16d8-4c04-83e0-7ed0d3c07221 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:04:33.606806 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-78a77bc7-16d8-4c04-83e0-7ed0d3c07221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:33.706075 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 667/1339] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:04:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:04:33.983984 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aba6d2-2ac4-4f2a-b204-2cae786e7cb8 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:04:33.985560 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-66aba6d2-2ac4-4f2a-b204-2cae786e7cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:34.061738 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:34.089672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aba6d2-2ac4-4f2a-b204-2cae786e7cb8 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:04:34.161942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f88c4-82bd-4b65-94db-17ea19687b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:04:34.162530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f88c4-82bd-4b65-94db-17ea19687b10 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:34.162802 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f88c4-82bd-4b65-94db-17ea19687b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:34.163064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f88c4-82bd-4b65-94db-17ea19687b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:34.164634 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1c8f88c4-82bd-4b65-94db-17ea19687b10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:34.274490 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f88c4-82bd-4b65-94db-17ea19687b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:04:34.275909 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f88c4-82bd-4b65-94db-17ea19687b10 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:04:34.294291 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 673/1340] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:04:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:04:38.438484 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fe4cd-5a5f-4f24-b29e-fd563bf73b1b None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:38.439036 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fe4cd-5a5f-4f24-b29e-fd563bf73b1b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:38.439036 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fe4cd-5a5f-4f24-b29e-fd563bf73b1b None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:38.440810 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 668/1341] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:04:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:04:38.446406 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89e297-91e7-42a2-a8a2-6016851d7955 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:38.446859 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89e297-91e7-42a2-a8a2-6016851d7955 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:38.449749 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89e297-91e7-42a2-a8a2-6016851d7955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:38.456898 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:38.517824 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-7a89e297-91e7-42a2-a8a2-6016851d7955 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:04:38.518934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7a89e297-91e7-42a2-a8a2-6016851d7955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:38.616195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 674/1342] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:04:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:04:38.896436 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fe4cd-5a5f-4f24-b29e-fd563bf73b1b None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:04:38.898076 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-317fe4cd-5a5f-4f24-b29e-fd563bf73b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:38.947912 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:39.002814 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fe4cd-5a5f-4f24-b29e-fd563bf73b1b None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:04:39.076312 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaca8e2-3afb-4b39-94db-d6e4ae3bfd18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:04:39.076916 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaca8e2-3afb-4b39-94db-d6e4ae3bfd18 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:39.077224 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaca8e2-3afb-4b39-94db-d6e4ae3bfd18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:39.077497 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaca8e2-3afb-4b39-94db-d6e4ae3bfd18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:39.079072 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8eaca8e2-3afb-4b39-94db-d6e4ae3bfd18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:39.174339 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:39.191608 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaca8e2-3afb-4b39-94db-d6e4ae3bfd18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:04:39.193046 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaca8e2-3afb-4b39-94db-d6e4ae3bfd18 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:04:39.211198 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 669/1343] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:04:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:04:42.036093 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206ac76-383c-45df-8467-664d70a995ef None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:42.036665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206ac76-383c-45df-8467-664d70a995ef None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:42.036665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206ac76-383c-45df-8467-664d70a995ef None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:42.038066 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 675/1344] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:04:42.043908 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60244ab7-4b5b-4f36-809c-b58591ccc322 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:42.044323 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60244ab7-4b5b-4f36-809c-b58591ccc322 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:42.044457 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60244ab7-4b5b-4f36-809c-b58591ccc322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:42.115431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-60244ab7-4b5b-4f36-809c-b58591ccc322 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:04:42.116643 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-60244ab7-4b5b-4f36-809c-b58591ccc322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:42.211840 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 670/1345] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:04:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:04:42.495522 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206ac76-383c-45df-8467-664d70a995ef None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:04:42.497068 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0206ac76-383c-45df-8467-664d70a995ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:42.589487 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:42.608929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206ac76-383c-45df-8467-664d70a995ef None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:04:42.684991 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0e3d8-473b-4ecf-986f-c6639c2ca30b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:04:42.685615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0e3d8-473b-4ecf-986f-c6639c2ca30b service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:42.685889 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0e3d8-473b-4ecf-986f-c6639c2ca30b service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:42.686154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0e3d8-473b-4ecf-986f-c6639c2ca30b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:42.687740 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-27f0e3d8-473b-4ecf-986f-c6639c2ca30b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:42.797072 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0e3d8-473b-4ecf-986f-c6639c2ca30b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:04:42.798446 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0e3d8-473b-4ecf-986f-c6639c2ca30b service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:04:42.818118 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 676/1346] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:04:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:04:46.919576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9174cad-54ea-48e6-9eab-8046a5d7995a None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:46.920012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9174cad-54ea-48e6-9eab-8046a5d7995a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:46.920125 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9174cad-54ea-48e6-9eab-8046a5d7995a None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:46.921498 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 671/1347] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:04:46.926769 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad7a8b-dd0a-44a8-a6d9-e3c9ac6bca98 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:46.927179 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad7a8b-dd0a-44a8-a6d9-e3c9ac6bca98 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:46.927465 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad7a8b-dd0a-44a8-a6d9-e3c9ac6bca98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:46.943193 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:46.995650 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-a0ad7a8b-dd0a-44a8-a6d9-e3c9ac6bca98 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:04:46.996836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a0ad7a8b-dd0a-44a8-a6d9-e3c9ac6bca98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:47.098966 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 677/1348] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:04:47.380474 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9174cad-54ea-48e6-9eab-8046a5d7995a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:04:47.382040 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c9174cad-54ea-48e6-9eab-8046a5d7995a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:47.439867 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:47.485278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9174cad-54ea-48e6-9eab-8046a5d7995a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:04:47.558828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9177af8-3e8f-4bf9-b40a-3215a95c541b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:04:47.559421 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9177af8-3e8f-4bf9-b40a-3215a95c541b service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:47.559696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9177af8-3e8f-4bf9-b40a-3215a95c541b service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:47.559964 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9177af8-3e8f-4bf9-b40a-3215a95c541b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:47.561575 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a9177af8-3e8f-4bf9-b40a-3215a95c541b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:47.676911 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:47.681348 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9177af8-3e8f-4bf9-b40a-3215a95c541b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:04:47.683350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9177af8-3e8f-4bf9-b40a-3215a95c541b service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:04:47.701782 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 672/1349] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:04:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:04:52.563148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6227e-ce7a-4923-a95a-1aec1e520e33 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:52.563684 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6227e-ce7a-4923-a95a-1aec1e520e33 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:52.563684 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6227e-ce7a-4923-a95a-1aec1e520e33 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:52.565081 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 678/1350] 10.222.0.26 () {54 vars in 921 bytes} [Tue Sep 13 14:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:04:52.570151 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb4528-91c6-443a-9b3a-23a67e8f5bc0 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:52.570572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb4528-91c6-443a-9b3a-23a67e8f5bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:52.570871 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb4528-91c6-443a-9b3a-23a67e8f5bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:52.677051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-02cb4528-91c6-443a-9b3a-23a67e8f5bc0 None None] MFA Rules not processed for user `311397bfe2c04569852fca0cfcdbad66`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:04:52.678464 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-02cb4528-91c6-443a-9b3a-23a67e8f5bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:52.822663 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 673/1351] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Sep 13 14:04:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:04:56.963996 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc10c9-3331-4343-99ff-40caf9fd8358 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:56.964525 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc10c9-3331-4343-99ff-40caf9fd8358 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:56.964525 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc10c9-3331-4343-99ff-40caf9fd8358 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:56.965893 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 679/1352] 10.222.0.26 () {54 vars in 921 bytes} [Tue Sep 13 14:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:04:56.971253 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f79eb-0bdd-4b25-b0de-db6a6718fa15 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:56.971675 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f79eb-0bdd-4b25-b0de-db6a6718fa15 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:56.971810 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f79eb-0bdd-4b25-b0de-db6a6718fa15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:57.028420 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:57.056182 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-1c5f79eb-0bdd-4b25-b0de-db6a6718fa15 None None] MFA Rules not processed for user `311397bfe2c04569852fca0cfcdbad66`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:04:57.058040 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1c5f79eb-0bdd-4b25-b0de-db6a6718fa15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:57.097269 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=59 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:57.176133 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 674/1353] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Sep 13 14:04:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:04:58.634922 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267bb7c-b34b-4a2c-b920-99cc7b158927 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:58.635408 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267bb7c-b34b-4a2c-b920-99cc7b158927 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:58.635533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267bb7c-b34b-4a2c-b920-99cc7b158927 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:58.636797 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 680/1354] 10.222.0.26 () {54 vars in 921 bytes} [Tue Sep 13 14:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:04:58.641697 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f314b-5a64-48ff-bd28-5e99d2c379db None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:04:58.642099 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f314b-5a64-48ff-bd28-5e99d2c379db None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:04:58.642406 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f314b-5a64-48ff-bd28-5e99d2c379db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:04:58.720036 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d98f314b-5a64-48ff-bd28-5e99d2c379db None None] MFA Rules not processed for user `311397bfe2c04569852fca0cfcdbad66`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:04:58.721270 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d98f314b-5a64-48ff-bd28-5e99d2c379db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:04:58.762093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:04:58.827950 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 675/1355] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Sep 13 14:04:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:05:02.437376 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c7f0a-55e2-48ff-a51c-b78071fc923d None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:02.437920 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c7f0a-55e2-48ff-a51c-b78071fc923d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:02.437920 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c7f0a-55e2-48ff-a51c-b78071fc923d None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:02.439253 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 681/1356] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:05:02.444542 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ed0a5-378b-4a31-a5b6-589e0cc718e7 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:02.444976 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ed0a5-378b-4a31-a5b6-589e0cc718e7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:02.445187 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ed0a5-378b-4a31-a5b6-589e0cc718e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:02.518437 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e99ed0a5-378b-4a31-a5b6-589e0cc718e7 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:05:02.519642 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e99ed0a5-378b-4a31-a5b6-589e0cc718e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:02.627499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 676/1357] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:05:02.927048 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a8cb8-13e0-4eb5-98a2-41dcadf34080 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:02.927805 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a8cb8-13e0-4eb5-98a2-41dcadf34080 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:02.928441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a8cb8-13e0-4eb5-98a2-41dcadf34080 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:02.930408 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 682/1358] 10.222.0.26 () {54 vars in 962 bytes} [Tue Sep 13 14:05:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:05:02.938381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9fc46-bd37-42c3-b68b-0cc4a17ce18f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:02.938669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9fc46-bd37-42c3-b68b-0cc4a17ce18f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:02.938975 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9fc46-bd37-42c3-b68b-0cc4a17ce18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:02.959150 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:03.040472 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5cf9fc46-bd37-42c3-b68b-0cc4a17ce18f None None] MFA Rules not processed for user `1b3533d0a24e4e7bbf5c7137d3511b13`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:05:03.042401 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5cf9fc46-bd37-42c3-b68b-0cc4a17ce18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:03.169160 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 677/1359] 10.222.0.26 () {58 vars in 1059 bytes} [Tue Sep 13 14:05:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:05:03.178047 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a8cb8-13e0-4eb5-98a2-41dcadf34080 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:05:03.180244 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f96a8cb8-13e0-4eb5-98a2-41dcadf34080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:03.337370 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a8cb8-13e0-4eb5-98a2-41dcadf34080 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:05:03.413852 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:03.456596 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f25009-4608-4221-b0d0-3904e897a584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:05:03.457360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f25009-4608-4221-b0d0-3904e897a584 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:03.457721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f25009-4608-4221-b0d0-3904e897a584 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:03.458084 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f25009-4608-4221-b0d0-3904e897a584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:03.459762 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e0f25009-4608-4221-b0d0-3904e897a584 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:03.558662 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f25009-4608-4221-b0d0-3904e897a584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:05:03.560411 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f25009-4608-4221-b0d0-3904e897a584 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:05:03.579555 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 683/1360] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:05:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:05:05.965124 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f8790-37f0-4561-90ba-fe4c621c188b None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:05.966339 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f8790-37f0-4561-90ba-fe4c621c188b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:05.966779 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f8790-37f0-4561-90ba-fe4c621c188b None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:05.972046 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 678/1361] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:05:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:05:05.973881 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3306d61-a504-4be7-893a-1aec3c8b3218 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:05.974315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3306d61-a504-4be7-893a-1aec3c8b3218 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:05.974484 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3306d61-a504-4be7-893a-1aec3c8b3218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:06.069306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e3306d61-a504-4be7-893a-1aec3c8b3218 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:05:06.070518 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e3306d61-a504-4be7-893a-1aec3c8b3218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:06.114259 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:06.183814 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 684/1362] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:05:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:05:06.472690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f8790-37f0-4561-90ba-fe4c621c188b None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:05:06.474223 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-628f8790-37f0-4561-90ba-fe4c621c188b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:06.548659 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:06.659634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f8790-37f0-4561-90ba-fe4c621c188b None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:05:06.788258 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7da82-0e19-4d3f-b1d3-3cc89b8721ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:05:06.788873 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7da82-0e19-4d3f-b1d3-3cc89b8721ce service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:06.789182 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7da82-0e19-4d3f-b1d3-3cc89b8721ce service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:06.789453 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7da82-0e19-4d3f-b1d3-3cc89b8721ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:06.791237 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1ee7da82-0e19-4d3f-b1d3-3cc89b8721ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:06.816861 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:06.887454 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7da82-0e19-4d3f-b1d3-3cc89b8721ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:05:06.889358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7da82-0e19-4d3f-b1d3-3cc89b8721ce service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:05:06.907174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 679/1363] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:05:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:05:09.432494 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7315ffe-867f-4397-b978-9584f82b7a73 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:09.433394 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7315ffe-867f-4397-b978-9584f82b7a73 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:09.433676 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7315ffe-867f-4397-b978-9584f82b7a73 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:09.435195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 685/1364] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:05:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:05:09.440209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb28a8-550d-41c3-a2be-e64f47f16289 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:09.440665 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb28a8-550d-41c3-a2be-e64f47f16289 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:09.440767 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb28a8-550d-41c3-a2be-e64f47f16289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:09.509221 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-77cb28a8-550d-41c3-a2be-e64f47f16289 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:05:09.511004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-77cb28a8-550d-41c3-a2be-e64f47f16289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:09.618391 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:09.620623 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 680/1365] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:05:09.908390 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a3fb7-2b2e-4cc6-8bc6-a4514ed66830 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:09.908790 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a3fb7-2b2e-4cc6-8bc6-a4514ed66830 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:09.909245 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a3fb7-2b2e-4cc6-8bc6-a4514ed66830 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:09.910980 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 686/1366] 10.222.0.26 () {54 vars in 962 bytes} [Tue Sep 13 14:05:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:05:09.917318 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d86355-cb36-4182-be95-7562abd19b01 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:09.917610 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d86355-cb36-4182-be95-7562abd19b01 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:09.917892 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d86355-cb36-4182-be95-7562abd19b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:09.997297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-29d86355-cb36-4182-be95-7562abd19b01 None None] MFA Rules not processed for user `1b3533d0a24e4e7bbf5c7137d3511b13`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:05:09.998520 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-29d86355-cb36-4182-be95-7562abd19b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:10.122712 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 681/1367] 10.222.0.26 () {58 vars in 1059 bytes} [Tue Sep 13 14:05:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:05:10.130964 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a3fb7-2b2e-4cc6-8bc6-a4514ed66830 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:05:10.132582 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-026a3fb7-2b2e-4cc6-8bc6-a4514ed66830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:10.288568 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a3fb7-2b2e-4cc6-8bc6-a4514ed66830 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:05:10.310187 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:10.413771 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627675f-1af5-4069-94b5-64780aa9cb9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:05:10.414372 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627675f-1af5-4069-94b5-64780aa9cb9c service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:10.414648 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627675f-1af5-4069-94b5-64780aa9cb9c service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:10.414917 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627675f-1af5-4069-94b5-64780aa9cb9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:10.417039 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-6627675f-1af5-4069-94b5-64780aa9cb9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:10.513003 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627675f-1af5-4069-94b5-64780aa9cb9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:05:10.514677 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627675f-1af5-4069-94b5-64780aa9cb9c service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:05:10.536938 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 687/1368] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:05:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:05:10.642191 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d4378-be65-4d31-90c9-d7fc52c9cc6e None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:10.643456 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d4378-be65-4d31-90c9-d7fc52c9cc6e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:10.644012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d4378-be65-4d31-90c9-d7fc52c9cc6e None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:10.649138 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 682/1369] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:05:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:05:10.651678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44337e12-abbb-4f76-b3aa-6f66844aa8b0 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:10.652082 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44337e12-abbb-4f76-b3aa-6f66844aa8b0 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:10.652433 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44337e12-abbb-4f76-b3aa-6f66844aa8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:10.691731 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:10.737661 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-44337e12-abbb-4f76-b3aa-6f66844aa8b0 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:05:10.738910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-44337e12-abbb-4f76-b3aa-6f66844aa8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:10.858248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 688/1370] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:05:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:05:11.199908 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fde572-8bc8-4162-a0e0-e73e9d0e6ea4 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:11.199908 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fde572-8bc8-4162-a0e0-e73e9d0e6ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:11.200863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fde572-8bc8-4162-a0e0-e73e9d0e6ea4 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:11.202947 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 683/1371] 10.222.0.26 () {54 vars in 964 bytes} [Tue Sep 13 14:05:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:05:11.213186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e2aea-55f4-4b4c-b359-b2453c5ec5bd None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:11.213186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e2aea-55f4-4b4c-b359-b2453c5ec5bd None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:11.213186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e2aea-55f4-4b4c-b359-b2453c5ec5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:11.296016 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-119e2aea-55f4-4b4c-b359-b2453c5ec5bd None None] MFA Rules not processed for user `052d3a21bd3c48c89dcc38ec1444d39a`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:05:11.297290 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-119e2aea-55f4-4b4c-b359-b2453c5ec5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:11.354274 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:11.388109 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 689/1372] 10.222.0.26 () {58 vars in 1061 bytes} [Tue Sep 13 14:05:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:05:11.395915 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fde572-8bc8-4162-a0e0-e73e9d0e6ea4 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:05:11.397620 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-32fde572-8bc8-4162-a0e0-e73e9d0e6ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:11.450794 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:11.508867 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fde572-8bc8-4162-a0e0-e73e9d0e6ea4 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:05:11.599925 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e1424-3b61-4266-8e18-012c6494bfaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:05:11.600403 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e1424-3b61-4266-8e18-012c6494bfaf service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:11.600680 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e1424-3b61-4266-8e18-012c6494bfaf service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:11.600944 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e1424-3b61-4266-8e18-012c6494bfaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:11.602601 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-695e1424-3b61-4266-8e18-012c6494bfaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:11.730380 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:11.747418 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e1424-3b61-4266-8e18-012c6494bfaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:05:11.748676 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e1424-3b61-4266-8e18-012c6494bfaf service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:05:11.769425 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 684/1373] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:05:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:05:12.815430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153f0fd-ba70-4e28-963e-ac33bb0e8f6e None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:12.815942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153f0fd-ba70-4e28-963e-ac33bb0e8f6e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:12.815942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153f0fd-ba70-4e28-963e-ac33bb0e8f6e None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:12.817282 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 690/1374] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:05:12.822653 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9cb5d-d2f9-4653-8b8e-1218a5d91bf2 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:12.823077 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9cb5d-d2f9-4653-8b8e-1218a5d91bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:12.823271 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9cb5d-d2f9-4653-8b8e-1218a5d91bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:12.894104 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5ab9cb5d-d2f9-4653-8b8e-1218a5d91bf2 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:05:12.895336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5ab9cb5d-d2f9-4653-8b8e-1218a5d91bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:12.993243 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 685/1375] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:05:13.292061 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153f0fd-ba70-4e28-963e-ac33bb0e8f6e None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:05:13.293749 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7153f0fd-ba70-4e28-963e-ac33bb0e8f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:13.456675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153f0fd-ba70-4e28-963e-ac33bb0e8f6e None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:05:13.510458 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:13.574567 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8520b1-9a51-4397-b735-d52876e11093 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:05:13.575167 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8520b1-9a51-4397-b735-d52876e11093 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:13.575444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8520b1-9a51-4397-b735-d52876e11093 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:13.575711 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8520b1-9a51-4397-b735-d52876e11093 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:13.577329 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-9b8520b1-9a51-4397-b735-d52876e11093 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:13.671876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8520b1-9a51-4397-b735-d52876e11093 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:05:13.673599 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8520b1-9a51-4397-b735-d52876e11093 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:05:13.691975 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 691/1376] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:05:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:05:15.895388 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc92f95-03aa-4208-8622-b18f9bf240d0 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:15.895886 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc92f95-03aa-4208-8622-b18f9bf240d0 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:15.895886 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc92f95-03aa-4208-8622-b18f9bf240d0 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:15.897388 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 686/1377] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:05:15.902974 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abbfaf-cdf7-44ad-992b-c8e0e8c37d8a None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:15.903414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abbfaf-cdf7-44ad-992b-c8e0e8c37d8a None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:15.903578 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abbfaf-cdf7-44ad-992b-c8e0e8c37d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:15.972230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-69abbfaf-cdf7-44ad-992b-c8e0e8c37d8a None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:05:15.973758 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-69abbfaf-cdf7-44ad-992b-c8e0e8c37d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:15.983617 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:16.084264 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 692/1378] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:05:16.385004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc92f95-03aa-4208-8622-b18f9bf240d0 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:05:16.386760 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0fc92f95-03aa-4208-8622-b18f9bf240d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:16.452735 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:16.546095 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc92f95-03aa-4208-8622-b18f9bf240d0 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:05:16.675481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f417774-7573-4807-aaf9-0148a6a3b38d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:05:16.676180 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f417774-7573-4807-aaf9-0148a6a3b38d service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:16.676558 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f417774-7573-4807-aaf9-0148a6a3b38d service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:16.676927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f417774-7573-4807-aaf9-0148a6a3b38d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:16.678910 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2f417774-7573-4807-aaf9-0148a6a3b38d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:16.699546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:16.780174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f417774-7573-4807-aaf9-0148a6a3b38d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:05:16.782082 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f417774-7573-4807-aaf9-0148a6a3b38d service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:05:16.802641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 687/1379] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:05:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:05:19.113867 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb509a8-6d4e-4e2f-8e61-eec35f65db72 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:19.114327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb509a8-6d4e-4e2f-8e61-eec35f65db72 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:19.114420 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb509a8-6d4e-4e2f-8e61-eec35f65db72 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:19.115960 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 693/1380] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:05:19.121343 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68679af9-8c39-474c-a8ab-90315f49540b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:19.121753 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68679af9-8c39-474c-a8ab-90315f49540b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:19.121924 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68679af9-8c39-474c-a8ab-90315f49540b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:19.195650 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-68679af9-8c39-474c-a8ab-90315f49540b None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:05:19.197471 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-68679af9-8c39-474c-a8ab-90315f49540b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:19.339377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:19.345996 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 688/1381] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:05:19.639943 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb509a8-6d4e-4e2f-8e61-eec35f65db72 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:05:19.641484 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ccb509a8-6d4e-4e2f-8e61-eec35f65db72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:19.777385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:19.788919 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb509a8-6d4e-4e2f-8e61-eec35f65db72 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:05:19.916304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f607c-a660-4ddc-aec4-8ba182b0a484 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:05:19.917090 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f607c-a660-4ddc-aec4-8ba182b0a484 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:19.917481 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f607c-a660-4ddc-aec4-8ba182b0a484 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:19.917833 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f607c-a660-4ddc-aec4-8ba182b0a484 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:19.919887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2e4f607c-a660-4ddc-aec4-8ba182b0a484 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:20.016378 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f607c-a660-4ddc-aec4-8ba182b0a484 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:05:20.018024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f607c-a660-4ddc-aec4-8ba182b0a484 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:05:20.028577 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:20.038404 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 694/1382] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:05:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:05:22.798412 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ba6cb-a6ee-44ed-95f6-ee67e47e71f9 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:22.798935 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ba6cb-a6ee-44ed-95f6-ee67e47e71f9 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:22.798935 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ba6cb-a6ee-44ed-95f6-ee67e47e71f9 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:22.800264 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 689/1383] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:05:22.805858 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20ae37-9a01-4dc0-a4d2-276bc11df0f3 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:22.806812 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20ae37-9a01-4dc0-a4d2-276bc11df0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:22.806940 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20ae37-9a01-4dc0-a4d2-276bc11df0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:22.878975 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-2f20ae37-9a01-4dc0-a4d2-276bc11df0f3 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:05:22.880177 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2f20ae37-9a01-4dc0-a4d2-276bc11df0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:22.990868 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 695/1384] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:05:23.279448 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ba6cb-a6ee-44ed-95f6-ee67e47e71f9 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:05:23.280930 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e53ba6cb-a6ee-44ed-95f6-ee67e47e71f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:23.459987 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ba6cb-a6ee-44ed-95f6-ee67e47e71f9 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:05:23.545991 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:23.594522 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aeda55-3422-4a34-a60a-01e604ac356f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:05:23.595123 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeda55-3422-4a34-a60a-01e604ac356f service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:23.595398 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeda55-3422-4a34-a60a-01e604ac356f service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:23.595666 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeda55-3422-4a34-a60a-01e604ac356f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:23.597297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a5aeda55-3422-4a34-a60a-01e604ac356f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:23.705958 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aeda55-3422-4a34-a60a-01e604ac356f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:05:23.708049 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aeda55-3422-4a34-a60a-01e604ac356f service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:05:23.727469 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 690/1385] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:05:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 14:05:25.952863 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125625fa-2818-4758-b526-15787086587d None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:25.953405 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125625fa-2818-4758-b526-15787086587d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:25.953486 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125625fa-2818-4758-b526-15787086587d None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:25.954954 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 696/1386] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:05:25.960098 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494de285-13ae-410f-a89f-98975c60db50 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:25.960549 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494de285-13ae-410f-a89f-98975c60db50 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:25.960644 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494de285-13ae-410f-a89f-98975c60db50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:26.037522 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-494de285-13ae-410f-a89f-98975c60db50 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:05:26.038739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-494de285-13ae-410f-a89f-98975c60db50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:26.076096 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:26.142926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 691/1387] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:05:26.434559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125625fa-2818-4758-b526-15787086587d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:05:26.436207 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-125625fa-2818-4758-b526-15787086587d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:26.514502 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:26.587898 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125625fa-2818-4758-b526-15787086587d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:05:26.707154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50cacb-6bae-4155-aa49-210c1a79fa4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:05:26.707760 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50cacb-6bae-4155-aa49-210c1a79fa4c service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:26.708035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50cacb-6bae-4155-aa49-210c1a79fa4c service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:26.708301 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50cacb-6bae-4155-aa49-210c1a79fa4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:26.709908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8e50cacb-6bae-4155-aa49-210c1a79fa4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:26.749371 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:26.801394 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50cacb-6bae-4155-aa49-210c1a79fa4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:05:26.803013 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50cacb-6bae-4155-aa49-210c1a79fa4c service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:05:26.821493 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 697/1388] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:05:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:05:27.076717 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe24108-09ae-4e0f-bb8b-7bd39dd8c988 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:27.077246 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe24108-09ae-4e0f-bb8b-7bd39dd8c988 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:27.077246 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe24108-09ae-4e0f-bb8b-7bd39dd8c988 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:27.078575 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 692/1389] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:05:27.084215 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567569a-af3a-4c8e-aaf8-fc36ce7fa958 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:27.084641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567569a-af3a-4c8e-aaf8-fc36ce7fa958 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:27.084881 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567569a-af3a-4c8e-aaf8-fc36ce7fa958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:27.152366 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-1567569a-af3a-4c8e-aaf8-fc36ce7fa958 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:05:27.153713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1567569a-af3a-4c8e-aaf8-fc36ce7fa958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:27.252313 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 698/1390] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:05:27.552447 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfab0f2-aa04-4768-b309-bfe2d830e612 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:27.552735 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfab0f2-aa04-4768-b309-bfe2d830e612 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:27.553007 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfab0f2-aa04-4768-b309-bfe2d830e612 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:27.554383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 693/1391] 10.222.0.26 () {54 vars in 966 bytes} [Tue Sep 13 14:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:05:27.560251 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d5acd-8378-491a-a1b4-1966e73bb5fd None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:27.560629 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d5acd-8378-491a-a1b4-1966e73bb5fd None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:27.560967 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d5acd-8378-491a-a1b4-1966e73bb5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:27.577521 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:27.647120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-a68d5acd-8378-491a-a1b4-1966e73bb5fd None None] MFA Rules not processed for user `22959df6ef034036b5f6b3cda7918e24`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:05:27.648469 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a68d5acd-8378-491a-a1b4-1966e73bb5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:27.725164 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 699/1392] 10.222.0.26 () {58 vars in 1063 bytes} [Tue Sep 13 14:05:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:05:27.734716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfab0f2-aa04-4768-b309-bfe2d830e612 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:05:27.736209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9cfab0f2-aa04-4768-b309-bfe2d830e612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:27.843748 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfab0f2-aa04-4768-b309-bfe2d830e612 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:05:27.902772 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:27.918222 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d4b6e-2a0f-48c2-8186-047a5089da33 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22959df6ef034036b5f6b3cda7918e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:05:27.918823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d4b6e-2a0f-48c2-8186-047a5089da33 service glance] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:27.919099 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d4b6e-2a0f-48c2-8186-047a5089da33 service glance] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:27.919368 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d4b6e-2a0f-48c2-8186-047a5089da33 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:27.920950 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-032d4b6e-2a0f-48c2-8186-047a5089da33 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:28.029986 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d4b6e-2a0f-48c2-8186-047a5089da33 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:05:28.031421 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d4b6e-2a0f-48c2-8186-047a5089da33 service glance] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:05:28.050616 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 694/1393] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:05:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:05:28.784816 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d34312-fc12-4283-afb6-a80d23c8882b None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:28.785322 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d34312-fc12-4283-afb6-a80d23c8882b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:28.785432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d34312-fc12-4283-afb6-a80d23c8882b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:28.852548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-37d34312-fc12-4283-afb6-a80d23c8882b None None] MFA Rules not processed for user `0c41b4ecb17a43fdb05e586cce43b5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:05:28.854502 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-37d34312-fc12-4283-afb6-a80d23c8882b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:28.909544 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:28.944830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 700/1394] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 13 14:05:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:05:28.987352 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f22fd-8b46-46ac-a8dd-921a2b324d7f None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:28.987836 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f22fd-8b46-46ac-a8dd-921a2b324d7f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:28.987951 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f22fd-8b46-46ac-a8dd-921a2b324d7f None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:28.989310 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 695/1395] 10.222.0.26 () {54 vars in 943 bytes} [Tue Sep 13 14:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:05:28.995418 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e87da5-4cfe-478b-802f-f91d485a57a1 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:28.995699 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e87da5-4cfe-478b-802f-f91d485a57a1 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:28.995969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e87da5-4cfe-478b-802f-f91d485a57a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:29.044341 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9cb68-fc68-46bc-8909-1ee0dcf54afa None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:29.044628 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9cb68-fc68-46bc-8909-1ee0dcf54afa None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:29.044904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9cb68-fc68-46bc-8909-1ee0dcf54afa None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:29.046302 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 696/1396] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:05:29.051343 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887d624-5012-4eeb-a3c9-06d72c2da1f1 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:29.051627 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887d624-5012-4eeb-a3c9-06d72c2da1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:29.051973 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887d624-5012-4eeb-a3c9-06d72c2da1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:29.076719 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-14e87da5-4cfe-478b-802f-f91d485a57a1 None None] MFA Rules not processed for user `97c27e930f604bd38634ca08e56cf8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:05:29.077988 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-14e87da5-4cfe-478b-802f-f91d485a57a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:29.119919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-8887d624-5012-4eeb-a3c9-06d72c2da1f1 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:05:29.121029 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8887d624-5012-4eeb-a3c9-06d72c2da1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:29.163602 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:29.186524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 701/1397] 10.222.0.26 () {58 vars in 1040 bytes} [Tue Sep 13 14:05:28 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:05:29.195951 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e87da5-4cfe-478b-802f-f91d485a57a1 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:05:29.205983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e87da5-4cfe-478b-802f-f91d485a57a1 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:05:29.219609 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 697/1398] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:05:29.232150 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:29.311304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41149275-5d38-4e8f-a8ac-97a8748182e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c27e930f604bd38634ca08e56cf8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:05:29.311882 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41149275-5d38-4e8f-a8ac-97a8748182e5 service swift] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:29.312138 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41149275-5d38-4e8f-a8ac-97a8748182e5 service swift] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:29.312395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41149275-5d38-4e8f-a8ac-97a8748182e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:29.314174 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-41149275-5d38-4e8f-a8ac-97a8748182e5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:29.398115 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41149275-5d38-4e8f-a8ac-97a8748182e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:05:29.399634 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41149275-5d38-4e8f-a8ac-97a8748182e5 service swift] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:05:29.408633 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 702/1399] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 13 14:05:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 14:05:29.527928 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887d624-5012-4eeb-a3c9-06d72c2da1f1 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:05:29.529187 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8887d624-5012-4eeb-a3c9-06d72c2da1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:29.660647 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887d624-5012-4eeb-a3c9-06d72c2da1f1 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:05:29.723923 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:29.789656 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc9aca-007d-4805-93e8-f51db64739d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:05:29.790784 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc9aca-007d-4805-93e8-f51db64739d8 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:29.791062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc9aca-007d-4805-93e8-f51db64739d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:29.791326 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc9aca-007d-4805-93e8-f51db64739d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:29.792906 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7ecc9aca-007d-4805-93e8-f51db64739d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:29.899050 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc9aca-007d-4805-93e8-f51db64739d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:05:29.902162 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc9aca-007d-4805-93e8-f51db64739d8 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:05:29.922636 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 698/1400] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:05:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:05:32.168083 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c565e5-3f2d-4b81-a1e0-27842b154959 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:32.168695 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c565e5-3f2d-4b81-a1e0-27842b154959 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:32.168695 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c565e5-3f2d-4b81-a1e0-27842b154959 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:32.170158 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 703/1401] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:05:32.175343 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c26b2-1f27-47c3-b9e1-a9c6e7db34e8 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:32.175805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c26b2-1f27-47c3-b9e1-a9c6e7db34e8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:32.175898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c26b2-1f27-47c3-b9e1-a9c6e7db34e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:32.246997 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-908c26b2-1f27-47c3-b9e1-a9c6e7db34e8 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:05:32.247377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-908c26b2-1f27-47c3-b9e1-a9c6e7db34e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:32.262944 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:32.358834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 699/1402] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:05:32.652171 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c565e5-3f2d-4b81-a1e0-27842b154959 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:05:32.660144 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b8c565e5-3f2d-4b81-a1e0-27842b154959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:32.738604 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:32.840890 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c565e5-3f2d-4b81-a1e0-27842b154959 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:05:32.968344 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530de2ab-f241-473c-a4ba-e64647df4f7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:05:32.968941 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530de2ab-f241-473c-a4ba-e64647df4f7b service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:32.969254 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530de2ab-f241-473c-a4ba-e64647df4f7b service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:32.969525 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530de2ab-f241-473c-a4ba-e64647df4f7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:32.971149 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-530de2ab-f241-473c-a4ba-e64647df4f7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:32.994642 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:33.077647 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530de2ab-f241-473c-a4ba-e64647df4f7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:05:33.079257 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530de2ab-f241-473c-a4ba-e64647df4f7b service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:05:33.100767 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 704/1403] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:05:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:05:35.343582 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d3cf0-810f-4c4d-addb-016e77d7c99a None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:35.343582 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d3cf0-810f-4c4d-addb-016e77d7c99a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:35.344227 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d3cf0-810f-4c4d-addb-016e77d7c99a None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:35.345069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 700/1404] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:05:35.350741 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dbde5-10a5-45bf-9a6a-ff3b1e1e6c05 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:35.353531 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dbde5-10a5-45bf-9a6a-ff3b1e1e6c05 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:35.354040 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dbde5-10a5-45bf-9a6a-ff3b1e1e6c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:35.428934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e90dbde5-10a5-45bf-9a6a-ff3b1e1e6c05 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:05:35.430202 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e90dbde5-10a5-45bf-9a6a-ff3b1e1e6c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:35.530798 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:35.537514 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 705/1405] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:05:35.843400 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d3cf0-810f-4c4d-addb-016e77d7c99a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:05:35.845053 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-bd8d3cf0-810f-4c4d-addb-016e77d7c99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:36.027563 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:36.031127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d3cf0-810f-4c4d-addb-016e77d7c99a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:05:36.163327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4ab4d-eb73-4e3e-ae50-f75efc48122a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:05:36.164041 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4ab4d-eb73-4e3e-ae50-f75efc48122a service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:36.164328 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4ab4d-eb73-4e3e-ae50-f75efc48122a service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:36.164595 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4ab4d-eb73-4e3e-ae50-f75efc48122a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:36.166395 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7db4ab4d-eb73-4e3e-ae50-f75efc48122a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:36.270650 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4ab4d-eb73-4e3e-ae50-f75efc48122a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:05:36.272181 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4ab4d-eb73-4e3e-ae50-f75efc48122a service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:05:36.292074 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 701/1406] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:05:38.528243 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6dac6-a078-4f17-ab48-4b60d6a99f26 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:38.528842 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6dac6-a078-4f17-ab48-4b60d6a99f26 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:38.528842 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6dac6-a078-4f17-ab48-4b60d6a99f26 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:38.531875 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 706/1407] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:05:38.536345 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18726473-1f90-45bf-9e56-8677f8d80f91 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:38.536838 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18726473-1f90-45bf-9e56-8677f8d80f91 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:38.536931 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18726473-1f90-45bf-9e56-8677f8d80f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:38.542076 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:38.610839 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-18726473-1f90-45bf-9e56-8677f8d80f91 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:05:38.612080 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-18726473-1f90-45bf-9e56-8677f8d80f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:38.727299 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 702/1408] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:05:39.017042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6dac6-a078-4f17-ab48-4b60d6a99f26 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:05:39.018575 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-74f6dac6-a078-4f17-ab48-4b60d6a99f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:39.181427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6dac6-a078-4f17-ab48-4b60d6a99f26 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:05:39.250370 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:39.297863 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c754408-18b4-49b9-9b66-dd647c453ea7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:05:39.298373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c754408-18b4-49b9-9b66-dd647c453ea7 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:39.298655 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c754408-18b4-49b9-9b66-dd647c453ea7 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:39.298914 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c754408-18b4-49b9-9b66-dd647c453ea7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:39.300508 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-9c754408-18b4-49b9-9b66-dd647c453ea7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:39.395898 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c754408-18b4-49b9-9b66-dd647c453ea7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:05:39.397539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c754408-18b4-49b9-9b66-dd647c453ea7 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:05:39.417151 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 707/1409] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:05:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:05:48.725067 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=64 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:49.413827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=64 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:52.380562 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3f6dc-f663-430b-a73c-29a686881bce None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:52.381133 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3f6dc-f663-430b-a73c-29a686881bce None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:52.381133 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3f6dc-f663-430b-a73c-29a686881bce None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:52.382488 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 703/1410] 10.222.0.26 () {54 vars in 918 bytes} [Tue Sep 13 14:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:05:52.388144 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27393c0e-3599-4e71-a3b6-4228e915a118 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:52.388570 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27393c0e-3599-4e71-a3b6-4228e915a118 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:52.388712 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27393c0e-3599-4e71-a3b6-4228e915a118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:52.463373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-27393c0e-3599-4e71-a3b6-4228e915a118 None None] MFA Rules not processed for user `311397bfe2c04569852fca0cfcdbad66`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:05:52.464601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-27393c0e-3599-4e71-a3b6-4228e915a118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:52.568762 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 708/1411] 10.222.0.26 () {58 vars in 1015 bytes} [Tue Sep 13 14:05:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:05:52.583495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a451c5-26a3-4e26-a36e-61bde925fc6b None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:52.583758 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a451c5-26a3-4e26-a36e-61bde925fc6b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:52.584027 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a451c5-26a3-4e26-a36e-61bde925fc6b None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:52.585407 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 704/1412] 10.222.0.26 () {54 vars in 918 bytes} [Tue Sep 13 14:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:05:52.590327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b1d32-1a3c-48c4-86e1-30863e8dbf4c None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:52.590607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b1d32-1a3c-48c4-86e1-30863e8dbf4c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:52.590876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b1d32-1a3c-48c4-86e1-30863e8dbf4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:52.666662 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:52.669909 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-792b1d32-1a3c-48c4-86e1-30863e8dbf4c None None] MFA Rules not processed for user `1b3533d0a24e4e7bbf5c7137d3511b13`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:05:52.671749 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-792b1d32-1a3c-48c4-86e1-30863e8dbf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:52.786955 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 709/1413] 10.222.0.26 () {58 vars in 1015 bytes} [Tue Sep 13 14:05:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:05:55.350547 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8701b-b0a2-441a-8b77-86f79c3d0ff9 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:55.351105 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8701b-b0a2-441a-8b77-86f79c3d0ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:55.351105 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8701b-b0a2-441a-8b77-86f79c3d0ff9 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:55.352404 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 14:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:05:55.357734 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851adc13-b490-408b-94dc-ed4f8f01d4f7 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:55.358169 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851adc13-b490-408b-94dc-ed4f8f01d4f7 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:55.358273 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851adc13-b490-408b-94dc-ed4f8f01d4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:55.424189 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-851adc13-b490-408b-94dc-ed4f8f01d4f7 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:05:55.425440 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-851adc13-b490-408b-94dc-ed4f8f01d4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:55.479599 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:55.526736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 14:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:05:55.817119 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8701b-b0a2-441a-8b77-86f79c3d0ff9 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:05:55.818711 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c6d8701b-b0a2-441a-8b77-86f79c3d0ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:55.965751 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8701b-b0a2-441a-8b77-86f79c3d0ff9 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:05:56.037111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:56.076727 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea3f0f-ea88-434e-aa02-a0bb89d7b21e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:05:56.077431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea3f0f-ea88-434e-aa02-a0bb89d7b21e service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:56.077711 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea3f0f-ea88-434e-aa02-a0bb89d7b21e service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:56.077974 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea3f0f-ea88-434e-aa02-a0bb89d7b21e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:56.079616 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-99ea3f0f-ea88-434e-aa02-a0bb89d7b21e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:56.170403 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea3f0f-ea88-434e-aa02-a0bb89d7b21e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:05:56.171999 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea3f0f-ea88-434e-aa02-a0bb89d7b21e service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:05:56.189668 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 706/1416] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:05:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:05:57.333814 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f4f66-5011-4c41-baf5-94b86e3fbbe3 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:57.334388 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f4f66-5011-4c41-baf5-94b86e3fbbe3 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:57.334388 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f4f66-5011-4c41-baf5-94b86e3fbbe3 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:57.335721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 14:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:05:57.342255 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033dfcb-bece-4c5b-b887-38a38881bcdd None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:57.342662 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033dfcb-bece-4c5b-b887-38a38881bcdd None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:57.342789 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033dfcb-bece-4c5b-b887-38a38881bcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:57.417157 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-4033dfcb-bece-4c5b-b887-38a38881bcdd None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:05:57.418354 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4033dfcb-bece-4c5b-b887-38a38881bcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:57.444161 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:57.513208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 14:05:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:05:57.665309 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f4f66-5011-4c41-baf5-94b86e3fbbe3 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:05:57.666814 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-185f4f66-5011-4c41-baf5-94b86e3fbbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:57.810887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f4f66-5011-4c41-baf5-94b86e3fbbe3 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:05:57.850853 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:57.932497 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac09cb-ce07-4548-a5a5-bff84e7fcd3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:05:57.933014 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac09cb-ce07-4548-a5a5-bff84e7fcd3a service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:57.933320 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac09cb-ce07-4548-a5a5-bff84e7fcd3a service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:57.933592 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac09cb-ce07-4548-a5a5-bff84e7fcd3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:57.935186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f9ac09cb-ce07-4548-a5a5-bff84e7fcd3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:58.024752 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac09cb-ce07-4548-a5a5-bff84e7fcd3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:05:58.026378 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac09cb-ce07-4548-a5a5-bff84e7fcd3a service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:05:58.044976 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 712/1419] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:05:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:05:59.164856 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d274bb-1143-474d-b927-cb90f129f951 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:59.165471 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d274bb-1143-474d-b927-cb90f129f951 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:59.165471 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d274bb-1143-474d-b927-cb90f129f951 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:59.166757 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 14:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:05:59.172804 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556f60e-daa1-4cbe-9c74-a8f98bea5764 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:59.173269 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556f60e-daa1-4cbe-9c74-a8f98bea5764 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:59.173394 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556f60e-daa1-4cbe-9c74-a8f98bea5764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:59.227348 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:59.253561 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-f556f60e-daa1-4cbe-9c74-a8f98bea5764 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:05:59.254810 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f556f60e-daa1-4cbe-9c74-a8f98bea5764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:59.348649 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 14:05:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:05:59.496927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d274bb-1143-474d-b927-cb90f129f951 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:05:59.498447 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-94d274bb-1143-474d-b927-cb90f129f951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:59.644488 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d274bb-1143-474d-b927-cb90f129f951 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:05:59.656933 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:59.758940 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981a021-f4f8-47fb-bda4-9eb66190f4b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:05:59.759541 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981a021-f4f8-47fb-bda4-9eb66190f4b7 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:05:59.759820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981a021-f4f8-47fb-bda4-9eb66190f4b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:05:59.760094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981a021-f4f8-47fb-bda4-9eb66190f4b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:05:59.761708 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e981a021-f4f8-47fb-bda4-9eb66190f4b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:05:59.849813 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981a021-f4f8-47fb-bda4-9eb66190f4b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:05:59.851904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981a021-f4f8-47fb-bda4-9eb66190f4b7 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:05:59.870021 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 709/1422] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:05:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:06:00.984802 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a6094-f650-4b42-9ce9-13f518403ff4 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:00.985374 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a6094-f650-4b42-9ce9-13f518403ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:00.985374 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a6094-f650-4b42-9ce9-13f518403ff4 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:00.986737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 14:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:06:00.993269 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff663d-c279-4021-aa42-3867e1e4632d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:00.993690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff663d-c279-4021-aa42-3867e1e4632d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:00.993847 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff663d-c279-4021-aa42-3867e1e4632d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:01.014117 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:01.072108 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-56ff663d-c279-4021-aa42-3867e1e4632d None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:06:01.073361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-56ff663d-c279-4021-aa42-3867e1e4632d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:01.167654 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 14:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:06:01.317125 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a6094-f650-4b42-9ce9-13f518403ff4 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:06:01.318561 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d56a6094-f650-4b42-9ce9-13f518403ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:01.426355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:01.461668 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a6094-f650-4b42-9ce9-13f518403ff4 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:06:01.577824 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89a2ba-fa0a-42ed-a257-9fcbf7237f3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:06:01.578340 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89a2ba-fa0a-42ed-a257-9fcbf7237f3e service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:01.578619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89a2ba-fa0a-42ed-a257-9fcbf7237f3e service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:01.578903 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89a2ba-fa0a-42ed-a257-9fcbf7237f3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:01.580471 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8f89a2ba-fa0a-42ed-a257-9fcbf7237f3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:01.657153 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:01.671876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89a2ba-fa0a-42ed-a257-9fcbf7237f3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:06:01.673554 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89a2ba-fa0a-42ed-a257-9fcbf7237f3e service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:06:01.691442 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 715/1425] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:06:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:06:02.809936 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338215b8-7005-4e37-9838-d96658b1be92 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:02.810512 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338215b8-7005-4e37-9838-d96658b1be92 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:02.810512 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338215b8-7005-4e37-9838-d96658b1be92 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:02.811847 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 14:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:06:02.818160 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40281f4-e3f5-40ab-8ab3-e3339bb38015 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:02.818615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40281f4-e3f5-40ab-8ab3-e3339bb38015 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:02.818739 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40281f4-e3f5-40ab-8ab3-e3339bb38015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:02.893516 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-f40281f4-e3f5-40ab-8ab3-e3339bb38015 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:06:02.894717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f40281f4-e3f5-40ab-8ab3-e3339bb38015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:02.990507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 14:06:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:06:03.139072 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338215b8-7005-4e37-9838-d96658b1be92 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:06:03.140606 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-338215b8-7005-4e37-9838-d96658b1be92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:03.223690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:03.284756 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338215b8-7005-4e37-9838-d96658b1be92 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:06:03.395043 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aeefad-2f49-4008-a3fc-555b95672a48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:06:03.395642 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeefad-2f49-4008-a3fc-555b95672a48 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:03.395914 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeefad-2f49-4008-a3fc-555b95672a48 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:03.396178 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeefad-2f49-4008-a3fc-555b95672a48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:03.397793 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-58aeefad-2f49-4008-a3fc-555b95672a48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:03.561013 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:03.602109 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aeefad-2f49-4008-a3fc-555b95672a48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:06:03.603700 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aeefad-2f49-4008-a3fc-555b95672a48 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:06:03.622215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 712/1428] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:06:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:06:04.682064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4906c70-09cf-4154-b880-25c5d3bb9378 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:04.682590 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4906c70-09cf-4154-b880-25c5d3bb9378 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:04.682590 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4906c70-09cf-4154-b880-25c5d3bb9378 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:04.683964 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 14:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:06:04.690171 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74030ff-82be-40a7-9d67-718f6e1968c1 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:04.690584 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74030ff-82be-40a7-9d67-718f6e1968c1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:04.690729 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74030ff-82be-40a7-9d67-718f6e1968c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:04.766136 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f74030ff-82be-40a7-9d67-718f6e1968c1 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:06:04.767350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f74030ff-82be-40a7-9d67-718f6e1968c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:04.861643 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 14:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:06:05.011756 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4906c70-09cf-4154-b880-25c5d3bb9378 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:06:05.013292 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e4906c70-09cf-4154-b880-25c5d3bb9378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:05.061877 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:05.160533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4906c70-09cf-4154-b880-25c5d3bb9378 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:06:05.269657 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0bd48-0742-47ef-b85b-fb5bcf3efddf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:06:05.270249 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0bd48-0742-47ef-b85b-fb5bcf3efddf service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:05.270516 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0bd48-0742-47ef-b85b-fb5bcf3efddf service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:05.270780 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0bd48-0742-47ef-b85b-fb5bcf3efddf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:05.272335 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-43a0bd48-0742-47ef-b85b-fb5bcf3efddf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:05.279624 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:05.360209 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0bd48-0742-47ef-b85b-fb5bcf3efddf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:06:05.361827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0bd48-0742-47ef-b85b-fb5bcf3efddf service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:06:05.379787 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 718/1431] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:06:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:06:06.435023 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486af1c-46f4-47d8-818a-23e724e30321 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:06.435579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486af1c-46f4-47d8-818a-23e724e30321 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:06.435579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486af1c-46f4-47d8-818a-23e724e30321 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:06.436843 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 14:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:06:06.442977 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60e678-1e92-4a74-94db-a1e60b6f8b3d None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:06.443404 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60e678-1e92-4a74-94db-a1e60b6f8b3d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:06.443632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60e678-1e92-4a74-94db-a1e60b6f8b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:06.519443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-5a60e678-1e92-4a74-94db-a1e60b6f8b3d None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:06:06.520633 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5a60e678-1e92-4a74-94db-a1e60b6f8b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:06.587707 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:06.619403 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 14:06:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:06:06.769279 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486af1c-46f4-47d8-818a-23e724e30321 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:06:06.770771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9486af1c-46f4-47d8-818a-23e724e30321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:06.789438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:06.916650 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486af1c-46f4-47d8-818a-23e724e30321 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:06:07.003460 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:07.029628 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d0a45-bf25-403a-b49d-9374e5dbc536 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:06:07.030165 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d0a45-bf25-403a-b49d-9374e5dbc536 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:07.030437 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d0a45-bf25-403a-b49d-9374e5dbc536 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:07.030698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d0a45-bf25-403a-b49d-9374e5dbc536 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:07.032272 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6a1d0a45-bf25-403a-b49d-9374e5dbc536 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:07.120327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d0a45-bf25-403a-b49d-9374e5dbc536 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:06:07.121944 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d0a45-bf25-403a-b49d-9374e5dbc536 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:06:07.139466 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 715/1434] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:06:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:06:08.188248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7293ac-b555-4909-b3b3-66b9564ac664 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:08.188790 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7293ac-b555-4909-b3b3-66b9564ac664 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:08.188790 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7293ac-b555-4909-b3b3-66b9564ac664 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:08.190193 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 14:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:06:08.197041 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cc722-4994-4354-bccb-ad64ee272619 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:08.197527 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cc722-4994-4354-bccb-ad64ee272619 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:08.197632 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cc722-4994-4354-bccb-ad64ee272619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:08.272856 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-362cc722-4994-4354-bccb-ad64ee272619 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:06:08.274665 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-362cc722-4994-4354-bccb-ad64ee272619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:08.322132 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:08.375884 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 14:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:06:08.524840 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7293ac-b555-4909-b3b3-66b9564ac664 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:06:08.526490 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ce7293ac-b555-4909-b3b3-66b9564ac664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:08.673750 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7293ac-b555-4909-b3b3-66b9564ac664 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:06:08.727329 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:08.785608 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa38d7c-2d12-4a93-8b6f-3ddb5d35349f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:06:08.786128 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa38d7c-2d12-4a93-8b6f-3ddb5d35349f service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:08.786399 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa38d7c-2d12-4a93-8b6f-3ddb5d35349f service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:08.786661 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa38d7c-2d12-4a93-8b6f-3ddb5d35349f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:08.788233 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-9fa38d7c-2d12-4a93-8b6f-3ddb5d35349f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:08.877436 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa38d7c-2d12-4a93-8b6f-3ddb5d35349f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:06:08.879027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa38d7c-2d12-4a93-8b6f-3ddb5d35349f service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:06:08.896413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 721/1437] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:06:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:06:09.948046 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17858245-3768-4739-bfc1-f371c51a14ca None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:09.948623 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17858245-3768-4739-bfc1-f371c51a14ca None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:09.948623 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17858245-3768-4739-bfc1-f371c51a14ca None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:09.950019 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 14:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:06:09.956351 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d39ec-c36e-433c-b0d0-928e326788c4 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:09.956784 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d39ec-c36e-433c-b0d0-928e326788c4 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:09.956893 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d39ec-c36e-433c-b0d0-928e326788c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:10.032210 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-916d39ec-c36e-433c-b0d0-928e326788c4 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:06:10.033724 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-916d39ec-c36e-433c-b0d0-928e326788c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:10.035780 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:10.129273 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 14:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:06:10.278484 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17858245-3768-4739-bfc1-f371c51a14ca None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:06:10.279984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-17858245-3768-4739-bfc1-f371c51a14ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:10.425046 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17858245-3768-4739-bfc1-f371c51a14ca None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:06:10.451973 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:10.537573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe0e44-873e-4fdf-8563-31ad7c31a59c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:06:10.538098 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe0e44-873e-4fdf-8563-31ad7c31a59c service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:10.538403 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe0e44-873e-4fdf-8563-31ad7c31a59c service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:10.538668 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe0e44-873e-4fdf-8563-31ad7c31a59c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:10.540245 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-38fe0e44-873e-4fdf-8563-31ad7c31a59c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:10.633117 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe0e44-873e-4fdf-8563-31ad7c31a59c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:06:10.634717 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe0e44-873e-4fdf-8563-31ad7c31a59c service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:06:10.652568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 718/1440] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:06:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:06:12.719929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811a7ef-358d-4f60-8b28-7dc18bc232f9 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:12.720440 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811a7ef-358d-4f60-8b28-7dc18bc232f9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:12.720549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811a7ef-358d-4f60-8b28-7dc18bc232f9 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:12.721914 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 14:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:06:12.727322 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e06bc-093c-4943-8d54-221e9414c83b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:12.727757 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e06bc-093c-4943-8d54-221e9414c83b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:12.727873 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e06bc-093c-4943-8d54-221e9414c83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:12.768483 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:12.794699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-532e06bc-093c-4943-8d54-221e9414c83b None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:06:12.795905 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-532e06bc-093c-4943-8d54-221e9414c83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:12.891845 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 14:06:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:06:13.193735 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811a7ef-358d-4f60-8b28-7dc18bc232f9 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:06:13.195325 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c811a7ef-358d-4f60-8b28-7dc18bc232f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:13.298524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811a7ef-358d-4f60-8b28-7dc18bc232f9 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:06:13.330627 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:13.371709 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4e94e-8922-4f42-adcd-6ee5729dc905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:06:13.372297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4e94e-8922-4f42-adcd-6ee5729dc905 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:13.372567 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4e94e-8922-4f42-adcd-6ee5729dc905 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:13.372830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4e94e-8922-4f42-adcd-6ee5729dc905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:13.374424 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e2b4e94e-8922-4f42-adcd-6ee5729dc905 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:13.480065 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4e94e-8922-4f42-adcd-6ee5729dc905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:06:13.481573 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4e94e-8922-4f42-adcd-6ee5729dc905 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:06:13.498912 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 724/1443] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:06:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:06:15.766535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c221b1-8c19-4bed-ae76-a448bee44a65 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:15.767056 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c221b1-8c19-4bed-ae76-a448bee44a65 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:15.767056 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c221b1-8c19-4bed-ae76-a448bee44a65 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:15.768388 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 14:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:06:15.774119 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78390dfc-ae1d-442a-8023-db8472da39a9 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:15.774535 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78390dfc-ae1d-442a-8023-db8472da39a9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:15.774681 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78390dfc-ae1d-442a-8023-db8472da39a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:15.840266 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-78390dfc-ae1d-442a-8023-db8472da39a9 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:06:15.841520 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-78390dfc-ae1d-442a-8023-db8472da39a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:15.854724 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:15.938162 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 14:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:06:16.221300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c221b1-8c19-4bed-ae76-a448bee44a65 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:06:16.222838 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-13c221b1-8c19-4bed-ae76-a448bee44a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:16.325701 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c221b1-8c19-4bed-ae76-a448bee44a65 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:06:16.339072 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:16.403686 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cd991-bd91-4710-a285-d2ca914bf339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:06:16.404277 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cd991-bd91-4710-a285-d2ca914bf339 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:16.404552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cd991-bd91-4710-a285-d2ca914bf339 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:16.404817 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cd991-bd91-4710-a285-d2ca914bf339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:16.406421 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b29cd991-bd91-4710-a285-d2ca914bf339 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:16.512545 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29cd991-bd91-4710-a285-d2ca914bf339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:06:16.513929 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29cd991-bd91-4710-a285-d2ca914bf339 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:06:16.532963 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 721/1446] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:06:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:06:18.993992 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6163d-6170-4eb0-90b1-5d5765590b2d None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:18.994565 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6163d-6170-4eb0-90b1-5d5765590b2d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:18.994565 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6163d-6170-4eb0-90b1-5d5765590b2d None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:18.995891 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 14:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:06:19.001240 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f7076-7079-4040-8012-d864f2fd59ea None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:19.001665 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f7076-7079-4040-8012-d864f2fd59ea None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:19.001810 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f7076-7079-4040-8012-d864f2fd59ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:19.050617 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:19.068494 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-316f7076-7079-4040-8012-d864f2fd59ea None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:06:19.069761 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-316f7076-7079-4040-8012-d864f2fd59ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:19.165926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 14:06:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:06:19.451527 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6163d-6170-4eb0-90b1-5d5765590b2d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:06:19.453058 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-80e6163d-6170-4eb0-90b1-5d5765590b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:19.555830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6163d-6170-4eb0-90b1-5d5765590b2d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:06:19.601820 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:19.638272 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9c35e-0ad6-41d4-9767-958e54c95356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:06:19.638865 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9c35e-0ad6-41d4-9767-958e54c95356 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:19.639137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9c35e-0ad6-41d4-9767-958e54c95356 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:19.639401 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9c35e-0ad6-41d4-9767-958e54c95356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:19.640973 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-40f9c35e-0ad6-41d4-9767-958e54c95356 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:19.748968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9c35e-0ad6-41d4-9767-958e54c95356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:06:19.750423 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9c35e-0ad6-41d4-9767-958e54c95356 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:06:19.768465 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 727/1449] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:06:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:06:22.094987 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032eca3b-eab5-4bc7-8d1c-00e0b7977667 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:22.095530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032eca3b-eab5-4bc7-8d1c-00e0b7977667 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:22.095530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032eca3b-eab5-4bc7-8d1c-00e0b7977667 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:22.096854 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 14:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 14:06:22.102221 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f678d8-3839-4db1-a333-78f2d948515d None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:22.102635 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f678d8-3839-4db1-a333-78f2d948515d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:22.102743 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f678d8-3839-4db1-a333-78f2d948515d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:22.168108 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e4f678d8-3839-4db1-a333-78f2d948515d None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:06:22.169318 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e4f678d8-3839-4db1-a333-78f2d948515d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:22.189731 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:22.266449 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 14:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:06:22.548269 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032eca3b-eab5-4bc7-8d1c-00e0b7977667 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:06:22.549848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-032eca3b-eab5-4bc7-8d1c-00e0b7977667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:22.654169 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032eca3b-eab5-4bc7-8d1c-00e0b7977667 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:06:22.674864 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:22.728804 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e475a-cafd-4061-85b7-76a8e0c44995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:06:22.729444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e475a-cafd-4061-85b7-76a8e0c44995 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:22.729720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e475a-cafd-4061-85b7-76a8e0c44995 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:22.729984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e475a-cafd-4061-85b7-76a8e0c44995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:22.731552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-858e475a-cafd-4061-85b7-76a8e0c44995 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:22.842159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e475a-cafd-4061-85b7-76a8e0c44995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:06:22.843526 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e475a-cafd-4061-85b7-76a8e0c44995 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:06:22.861155 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 724/1452] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:06:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:06:25.163481 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54757a-b797-45e7-a4c7-7f796b821bd9 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:25.164133 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54757a-b797-45e7-a4c7-7f796b821bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:25.164133 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54757a-b797-45e7-a4c7-7f796b821bd9 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:25.165499 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 14:06:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:06:25.170666 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e28052-0063-4429-b11d-801456d394c0 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:25.171049 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e28052-0063-4429-b11d-801456d394c0 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:25.171211 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e28052-0063-4429-b11d-801456d394c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:25.233874 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:25.236714 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-00e28052-0063-4429-b11d-801456d394c0 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:06:25.238597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-00e28052-0063-4429-b11d-801456d394c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:25.334833 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 14:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:06:25.616170 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54757a-b797-45e7-a4c7-7f796b821bd9 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:06:25.618173 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4b54757a-b797-45e7-a4c7-7f796b821bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:25.720062 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54757a-b797-45e7-a4c7-7f796b821bd9 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:06:25.769173 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:25.793560 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788efd94-0c69-40d5-a075-8f1fee91787f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:06:25.794158 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788efd94-0c69-40d5-a075-8f1fee91787f service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:25.794432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788efd94-0c69-40d5-a075-8f1fee91787f service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:25.794699 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788efd94-0c69-40d5-a075-8f1fee91787f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:25.796275 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-788efd94-0c69-40d5-a075-8f1fee91787f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:25.905319 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788efd94-0c69-40d5-a075-8f1fee91787f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:06:25.906680 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788efd94-0c69-40d5-a075-8f1fee91787f service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:06:26.048817 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 730/1455] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:06:28.236247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb51a5-3751-489b-a452-a2d740086d1e None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:28.236835 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb51a5-3751-489b-a452-a2d740086d1e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:28.236835 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb51a5-3751-489b-a452-a2d740086d1e None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:28.238195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 14:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:06:28.243961 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259d707-97d7-4624-afee-ee7f75a256eb None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:28.244398 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259d707-97d7-4624-afee-ee7f75a256eb None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:28.244503 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259d707-97d7-4624-afee-ee7f75a256eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:28.314204 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-5259d707-97d7-4624-afee-ee7f75a256eb None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:06:28.315559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5259d707-97d7-4624-afee-ee7f75a256eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:28.346289 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:28.414924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 14:06:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:06:28.700208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb51a5-3751-489b-a452-a2d740086d1e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:06:28.701761 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-badb51a5-3751-489b-a452-a2d740086d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:28.805119 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb51a5-3751-489b-a452-a2d740086d1e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:06:28.835861 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:28.880945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e92a28-badd-4428-acd6-5b21745438c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:06:28.881504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e92a28-badd-4428-acd6-5b21745438c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:28.881781 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e92a28-badd-4428-acd6-5b21745438c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:28.882049 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e92a28-badd-4428-acd6-5b21745438c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:28.883640 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d9e92a28-badd-4428-acd6-5b21745438c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:28.993458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e92a28-badd-4428-acd6-5b21745438c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:06:28.994893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e92a28-badd-4428-acd6-5b21745438c9 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:06:29.013045 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 727/1458] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:06:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:06:31.202877 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b9f19-e3a0-4a4b-bffb-8ff78a12ea3f None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:31.203437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b9f19-e3a0-4a4b-bffb-8ff78a12ea3f None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:31.203437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b9f19-e3a0-4a4b-bffb-8ff78a12ea3f None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:31.204795 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 14:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 14:06:31.210607 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c92a11-ab32-4502-8ea6-b8a5b1d6e32e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:31.211009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c92a11-ab32-4502-8ea6-b8a5b1d6e32e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:31.211142 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c92a11-ab32-4502-8ea6-b8a5b1d6e32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:31.275334 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-91c92a11-ab32-4502-8ea6-b8a5b1d6e32e None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:06:31.276523 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-91c92a11-ab32-4502-8ea6-b8a5b1d6e32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:31.284830 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:31.373570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 14:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:06:31.655948 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b9f19-e3a0-4a4b-bffb-8ff78a12ea3f None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:06:31.657774 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-322b9f19-e3a0-4a4b-bffb-8ff78a12ea3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:31.760939 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b9f19-e3a0-4a4b-bffb-8ff78a12ea3f None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:06:31.816152 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:31.834636 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a2c4c-f445-4bfa-970f-7ec0d4a3d70d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:06:31.835229 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a2c4c-f445-4bfa-970f-7ec0d4a3d70d service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:31.835507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a2c4c-f445-4bfa-970f-7ec0d4a3d70d service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:31.835777 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a2c4c-f445-4bfa-970f-7ec0d4a3d70d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:31.837381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b33a2c4c-f445-4bfa-970f-7ec0d4a3d70d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:31.950123 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a2c4c-f445-4bfa-970f-7ec0d4a3d70d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:06:31.951587 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a2c4c-f445-4bfa-970f-7ec0d4a3d70d service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:06:31.969062 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 733/1461] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:06:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:06:34.169165 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db6e1e-ed78-447f-9edc-c173c131e265 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:34.169741 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db6e1e-ed78-447f-9edc-c173c131e265 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:34.169741 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db6e1e-ed78-447f-9edc-c173c131e265 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:34.171051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 14:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:06:34.176650 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc884313-67d2-4cf5-8e28-46a5e407876e None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:34.177251 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc884313-67d2-4cf5-8e28-46a5e407876e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:34.177251 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc884313-67d2-4cf5-8e28-46a5e407876e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:34.251313 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-bc884313-67d2-4cf5-8e28-46a5e407876e None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:06:34.252439 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-bc884313-67d2-4cf5-8e28-46a5e407876e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:34.291581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:34.351346 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 14:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:06:34.645149 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db6e1e-ed78-447f-9edc-c173c131e265 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:06:34.646715 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-28db6e1e-ed78-447f-9edc-c173c131e265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:34.750224 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db6e1e-ed78-447f-9edc-c173c131e265 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:06:34.787962 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:34.823966 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3684d75-02c3-406a-a646-536a3bcc06ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:06:34.824562 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3684d75-02c3-406a-a646-536a3bcc06ee service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:34.824836 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3684d75-02c3-406a-a646-536a3bcc06ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:34.825132 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3684d75-02c3-406a-a646-536a3bcc06ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:34.826719 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f3684d75-02c3-406a-a646-536a3bcc06ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:34.946179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3684d75-02c3-406a-a646-536a3bcc06ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:06:34.947543 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3684d75-02c3-406a-a646-536a3bcc06ee service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:06:34.965235 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 730/1464] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:06:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:06:37.152475 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9f8fc-c139-458c-9148-51df0bf48404 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:37.153056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9f8fc-c139-458c-9148-51df0bf48404 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:37.153056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9f8fc-c139-458c-9148-51df0bf48404 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:37.154426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 14:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:06:37.159944 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034df0f-1f55-42f7-9e84-8ae3d07fe08a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:37.160386 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034df0f-1f55-42f7-9e84-8ae3d07fe08a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:37.160517 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034df0f-1f55-42f7-9e84-8ae3d07fe08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:37.226247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-6034df0f-1f55-42f7-9e84-8ae3d07fe08a None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:06:37.227446 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6034df0f-1f55-42f7-9e84-8ae3d07fe08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:37.245799 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:37.324231 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 14:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:06:37.603502 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9f8fc-c139-458c-9148-51df0bf48404 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:06:37.605019 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-afb9f8fc-c139-458c-9148-51df0bf48404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:37.707600 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9f8fc-c139-458c-9148-51df0bf48404 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:06:37.774418 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:37.781497 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db938b3-9841-4974-b35d-03f2e5adeca1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:06:37.782365 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db938b3-9841-4974-b35d-03f2e5adeca1 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:37.782639 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db938b3-9841-4974-b35d-03f2e5adeca1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:37.782908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db938b3-9841-4974-b35d-03f2e5adeca1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:37.784498 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7db938b3-9841-4974-b35d-03f2e5adeca1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:37.892388 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db938b3-9841-4974-b35d-03f2e5adeca1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:06:37.893779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db938b3-9841-4974-b35d-03f2e5adeca1 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:06:37.913057 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 736/1467] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:06:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:06:40.063304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d8c2e-cdd2-4585-b3e1-f6bb056cc7f1 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:40.063901 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d8c2e-cdd2-4585-b3e1-f6bb056cc7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:40.063901 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d8c2e-cdd2-4585-b3e1-f6bb056cc7f1 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:40.065198 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 14:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:06:40.070565 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4ebc3-97d4-4f12-9ba7-048f85982f38 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:40.070982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4ebc3-97d4-4f12-9ba7-048f85982f38 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:40.071103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4ebc3-97d4-4f12-9ba7-048f85982f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:40.136205 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-c0b4ebc3-97d4-4f12-9ba7-048f85982f38 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:06:40.137417 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c0b4ebc3-97d4-4f12-9ba7-048f85982f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:40.184220 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:40.232834 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 14:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:06:40.513265 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d8c2e-cdd2-4585-b3e1-f6bb056cc7f1 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:06:40.514783 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c35d8c2e-cdd2-4585-b3e1-f6bb056cc7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:40.617552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d8c2e-cdd2-4585-b3e1-f6bb056cc7f1 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:06:40.665675 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:40.691895 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316394f5-05c0-41a9-9d50-7bac64d3d7d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:06:40.692500 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316394f5-05c0-41a9-9d50-7bac64d3d7d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:06:40.692777 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316394f5-05c0-41a9-9d50-7bac64d3d7d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:06:40.693634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316394f5-05c0-41a9-9d50-7bac64d3d7d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:06:40.695227 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-316394f5-05c0-41a9-9d50-7bac64d3d7d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:06:40.804686 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316394f5-05c0-41a9-9d50-7bac64d3d7d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:06:40.806087 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316394f5-05c0-41a9-9d50-7bac64d3d7d3 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:06:40.824068 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 733/1470] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:06:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:06:50.231333 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=22 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:50.821844 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=66 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:07:00.690093 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9dc10-d1e0-4f59-8a03-01e8415e2d16 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:07:00.690659 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9dc10-d1e0-4f59-8a03-01e8415e2d16 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:07:00.690659 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9dc10-d1e0-4f59-8a03-01e8415e2d16 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:07:00.691966 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 738/1471] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:07:00.697769 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cd683-8abb-47a3-9bd7-e98d73a91c9f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:07:00.698207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cd683-8abb-47a3-9bd7-e98d73a91c9f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:07:00.698313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cd683-8abb-47a3-9bd7-e98d73a91c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:07:00.763371 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-629cd683-8abb-47a3-9bd7-e98d73a91c9f None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:07:00.764485 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-629cd683-8abb-47a3-9bd7-e98d73a91c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:07:00.861693 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 734/1472] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:07:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:07:01.156115 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b7ab6-966d-41da-a822-72918e906aff None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:07:01.156398 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b7ab6-966d-41da-a822-72918e906aff None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:07:01.156936 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b7ab6-966d-41da-a822-72918e906aff None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:07:01.158685 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 739/1473] 10.222.0.26 () {54 vars in 966 bytes} [Tue Sep 13 14:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:07:01.164433 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea5b08-378b-4328-8121-f2577f8f2cf0 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:07:01.164715 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea5b08-378b-4328-8121-f2577f8f2cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:07:01.164984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea5b08-378b-4328-8121-f2577f8f2cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:07:01.240988 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-29ea5b08-378b-4328-8121-f2577f8f2cf0 None None] MFA Rules not processed for user `22959df6ef034036b5f6b3cda7918e24`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:07:01.242229 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-29ea5b08-378b-4328-8121-f2577f8f2cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:07:01.262497 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:07:01.317382 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 735/1474] 10.222.0.26 () {58 vars in 1063 bytes} [Tue Sep 13 14:07:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:07:01.325849 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b7ab6-966d-41da-a822-72918e906aff None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:07:01.327351 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1b3b7ab6-966d-41da-a822-72918e906aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:07:01.430838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b7ab6-966d-41da-a822-72918e906aff None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:07:01.503081 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242cb67-4e5d-4c80-b09e-334169dd2685 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22959df6ef034036b5f6b3cda7918e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:07:01.503665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242cb67-4e5d-4c80-b09e-334169dd2685 service glance] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:07:01.503933 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242cb67-4e5d-4c80-b09e-334169dd2685 service glance] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:07:01.504195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242cb67-4e5d-4c80-b09e-334169dd2685 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:07:01.505790 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4242cb67-4e5d-4c80-b09e-334169dd2685 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:07:01.558653 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:07:01.612801 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242cb67-4e5d-4c80-b09e-334169dd2685 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:07:01.614290 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242cb67-4e5d-4c80-b09e-334169dd2685 service glance] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:07:01.632689 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 740/1475] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:07:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 14:07:03.860593 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53df36-d36d-4dd0-9c79-3e35e39400cb None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:07:03.861205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53df36-d36d-4dd0-9c79-3e35e39400cb None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:07:03.861205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53df36-d36d-4dd0-9c79-3e35e39400cb None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:07:03.862508 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 736/1476] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 14:07:03.870055 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a80d9-d5e0-4f60-9a36-7026d2ed2285 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:07:03.870510 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a80d9-d5e0-4f60-9a36-7026d2ed2285 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:07:03.870616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a80d9-d5e0-4f60-9a36-7026d2ed2285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:07:03.935215 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-8f2a80d9-d5e0-4f60-9a36-7026d2ed2285 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:07:03.936409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8f2a80d9-d5e0-4f60-9a36-7026d2ed2285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:07:04.034522 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 741/1477] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:07:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:07:04.312716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53df36-d36d-4dd0-9c79-3e35e39400cb None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:07:04.314271 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1d53df36-d36d-4dd0-9c79-3e35e39400cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:07:04.444753 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53df36-d36d-4dd0-9c79-3e35e39400cb None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:07:04.494126 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:07:04.538698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4f58f-f5d7-4064-b88e-24b303fdb5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:07:04.539382 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4f58f-f5d7-4064-b88e-24b303fdb5ed admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:07:04.539662 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4f58f-f5d7-4064-b88e-24b303fdb5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:07:04.539928 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4f58f-f5d7-4064-b88e-24b303fdb5ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:07:04.540584 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4f58f-f5d7-4064-b88e-24b303fdb5ed admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:07:04.542343 dv-cinder-857434-1-smb devstack@keystone.service[81626]: WARNING py.warnings [None req-47f4f58f-f5d7-4064-b88e-24b303fdb5ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 14:07:04.542343 dv-cinder-857434-1-smb devstack@keystone.service[81626]: warnings.warn(msg) Sep 13 14:07:04.542343 dv-cinder-857434-1-smb devstack@keystone.service[81626]: Sep 13 14:07:04.543481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4f58f-f5d7-4064-b88e-24b303fdb5ed admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:07:04.562572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 737/1478] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Sep 13 14:07:04 2022] GET /identity/v3/projects => generated 2553 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:07:06.715778 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b67d2d-fd3d-46af-8c00-cb623b24fe75 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:07:06.716348 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b67d2d-fd3d-46af-8c00-cb623b24fe75 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:07:06.716348 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b67d2d-fd3d-46af-8c00-cb623b24fe75 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:07:06.717696 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 742/1479] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:07:06.722904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7bf08-8a7c-4e0a-8527-08b2954961e4 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:07:06.723828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7bf08-8a7c-4e0a-8527-08b2954961e4 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:07:06.724006 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7bf08-8a7c-4e0a-8527-08b2954961e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:07:06.789666 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5aa7bf08-8a7c-4e0a-8527-08b2954961e4 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:07:06.790858 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5aa7bf08-8a7c-4e0a-8527-08b2954961e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:07:06.884556 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 738/1480] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:07:07.187541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b67d2d-fd3d-46af-8c00-cb623b24fe75 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:07:07.189034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-91b67d2d-fd3d-46af-8c00-cb623b24fe75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:07:07.199195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:07:07.333254 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b67d2d-fd3d-46af-8c00-cb623b24fe75 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:07:07.411264 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:07:07.443415 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d250d-794f-4f4e-9cf1-a5fb8fc334d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:07:07.443941 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d250d-794f-4f4e-9cf1-a5fb8fc334d0 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:07:07.444214 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d250d-794f-4f4e-9cf1-a5fb8fc334d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:07:07.444481 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d250d-794f-4f4e-9cf1-a5fb8fc334d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:07:07.446086 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ad8d250d-794f-4f4e-9cf1-a5fb8fc334d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:07:07.533119 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d250d-794f-4f4e-9cf1-a5fb8fc334d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:07:07.534690 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d250d-794f-4f4e-9cf1-a5fb8fc334d0 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:07:07.552497 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 743/1481] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:07:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:07:09.901910 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd935a-0d4b-44ae-b09b-d0205dc3c331 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:07:09.902429 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd935a-0d4b-44ae-b09b-d0205dc3c331 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:07:09.902429 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd935a-0d4b-44ae-b09b-d0205dc3c331 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:07:09.903737 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 739/1482] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:07:09.909330 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef44b3-e738-4839-a3a0-54590fac9049 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:07:09.909736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef44b3-e738-4839-a3a0-54590fac9049 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:07:09.909876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef44b3-e738-4839-a3a0-54590fac9049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:07:09.975008 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-aeef44b3-e738-4839-a3a0-54590fac9049 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:07:09.976212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-aeef44b3-e738-4839-a3a0-54590fac9049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:07:10.021662 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:07:10.072097 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 744/1483] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:07:10.362644 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd935a-0d4b-44ae-b09b-d0205dc3c331 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:07:10.364199 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-aedd935a-0d4b-44ae-b09b-d0205dc3c331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:07:10.388199 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:07:10.467884 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd935a-0d4b-44ae-b09b-d0205dc3c331 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:07:10.539587 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ec04d-4a51-4ad3-893c-527c26d37252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:07:10.540180 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ec04d-4a51-4ad3-893c-527c26d37252 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:07:10.540453 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ec04d-4a51-4ad3-893c-527c26d37252 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:07:10.540718 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ec04d-4a51-4ad3-893c-527c26d37252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:07:10.542306 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ac8ec04d-4a51-4ad3-893c-527c26d37252 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:07:10.618894 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:07:10.652144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ec04d-4a51-4ad3-893c-527c26d37252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:07:10.653627 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ec04d-4a51-4ad3-893c-527c26d37252 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:07:10.671602 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 740/1484] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:07:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:07:12.867102 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c11c1-79ee-4d3e-a64e-ce56d6ac4ad2 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:07:12.867653 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c11c1-79ee-4d3e-a64e-ce56d6ac4ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:07:12.867653 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c11c1-79ee-4d3e-a64e-ce56d6ac4ad2 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:07:12.869043 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 745/1485] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:07:12.874204 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de5616-4ae4-4a0e-8b7e-bb76f3a4547b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:07:12.874648 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de5616-4ae4-4a0e-8b7e-bb76f3a4547b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:07:12.874758 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de5616-4ae4-4a0e-8b7e-bb76f3a4547b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:07:12.940491 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-05de5616-4ae4-4a0e-8b7e-bb76f3a4547b None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:07:12.942315 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-05de5616-4ae4-4a0e-8b7e-bb76f3a4547b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:07:13.039720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 741/1486] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:07:13.324753 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c11c1-79ee-4d3e-a64e-ce56d6ac4ad2 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:07:13.326344 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e89c11c1-79ee-4d3e-a64e-ce56d6ac4ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:07:13.429050 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c11c1-79ee-4d3e-a64e-ce56d6ac4ad2 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:07:13.500661 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:07:13.502149 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778ba6d-1775-4459-bf22-31d8d91ace28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:07:13.502763 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778ba6d-1775-4459-bf22-31d8d91ace28 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:07:13.503226 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778ba6d-1775-4459-bf22-31d8d91ace28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:07:13.503708 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778ba6d-1775-4459-bf22-31d8d91ace28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:07:13.506103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c778ba6d-1775-4459-bf22-31d8d91ace28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:07:13.612786 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778ba6d-1775-4459-bf22-31d8d91ace28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:07:13.614693 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778ba6d-1775-4459-bf22-31d8d91ace28 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:07:13.633844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 746/1487] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:07:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:07:16.117450 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee13aa-b2c5-4028-8c1e-da35c29e3374 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:07:16.118036 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee13aa-b2c5-4028-8c1e-da35c29e3374 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:07:16.118036 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee13aa-b2c5-4028-8c1e-da35c29e3374 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:07:16.119327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 742/1488] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:07:16.124724 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b58bd-3776-40fb-b196-089be9529121 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:07:16.125203 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b58bd-3776-40fb-b196-089be9529121 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:07:16.125323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b58bd-3776-40fb-b196-089be9529121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:07:16.189966 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-7b2b58bd-3776-40fb-b196-089be9529121 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:07:16.191160 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7b2b58bd-3776-40fb-b196-089be9529121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:07:16.245853 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:07:16.291688 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 747/1489] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:07:16.588229 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee13aa-b2c5-4028-8c1e-da35c29e3374 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:07:16.589772 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d9ee13aa-b2c5-4028-8c1e-da35c29e3374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:07:16.625422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:07:16.692529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee13aa-b2c5-4028-8c1e-da35c29e3374 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:07:16.766806 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaaa0f8-7c4c-4e64-a4df-4f6fd1e3dea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:07:16.767409 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaa0f8-7c4c-4e64-a4df-4f6fd1e3dea1 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:07:16.767684 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaa0f8-7c4c-4e64-a4df-4f6fd1e3dea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:07:16.767957 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaa0f8-7c4c-4e64-a4df-4f6fd1e3dea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:07:16.769573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-acaaa0f8-7c4c-4e64-a4df-4f6fd1e3dea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:07:16.848776 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:07:16.877624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaaa0f8-7c4c-4e64-a4df-4f6fd1e3dea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:07:16.879635 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaaa0f8-7c4c-4e64-a4df-4f6fd1e3dea1 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:07:16.897067 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 743/1490] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:07:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:07:19.216310 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c32b5e-2f9c-4a77-a5b8-01c1ec73f305 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:07:19.216849 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c32b5e-2f9c-4a77-a5b8-01c1ec73f305 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:07:19.216849 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c32b5e-2f9c-4a77-a5b8-01c1ec73f305 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:07:19.218260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 748/1491] 10.222.0.26 () {54 vars in 927 bytes} [Tue Sep 13 14:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:07:19.223377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ee631-aeda-4f77-8183-05086bb21c2f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:07:19.223811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ee631-aeda-4f77-8183-05086bb21c2f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:07:19.223907 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ee631-aeda-4f77-8183-05086bb21c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:07:19.289957 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-509ee631-aeda-4f77-8183-05086bb21c2f None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:07:19.291162 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-509ee631-aeda-4f77-8183-05086bb21c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:07:19.388297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 744/1492] 10.222.0.26 () {58 vars in 1024 bytes} [Tue Sep 13 14:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:07:19.679679 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c32b5e-2f9c-4a77-a5b8-01c1ec73f305 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:07:19.681338 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-61c32b5e-2f9c-4a77-a5b8-01c1ec73f305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:07:19.785473 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c32b5e-2f9c-4a77-a5b8-01c1ec73f305 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:07:19.857771 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292f06f-773f-48f8-aa1d-1f25cba8f47f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:07:19.858365 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292f06f-773f-48f8-aa1d-1f25cba8f47f service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:07:19.858666 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292f06f-773f-48f8-aa1d-1f25cba8f47f service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:07:19.858931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292f06f-773f-48f8-aa1d-1f25cba8f47f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:07:19.860502 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4292f06f-773f-48f8-aa1d-1f25cba8f47f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:07:19.869462 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:07:19.969063 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292f06f-773f-48f8-aa1d-1f25cba8f47f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:07:19.970512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292f06f-773f-48f8-aa1d-1f25cba8f47f service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:07:19.989574 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 749/1493] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:07:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:07:29.386687 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=82 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:07:29.986791 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=50 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:08:38.953999 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef2a4b-6d72-41ef-9298-037b69d33549 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:08:38.954571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef2a4b-6d72-41ef-9298-037b69d33549 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:08:38.954571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef2a4b-6d72-41ef-9298-037b69d33549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:08:39.031219 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-54ef2a4b-6d72-41ef-9298-037b69d33549 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:08:39.032987 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-54ef2a4b-6d72-41ef-9298-037b69d33549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:08:39.127560 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 745/1494] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:08:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:08:39.135461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f807e-b842-440f-9231-2b3a3b753041 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:08:39.135976 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f807e-b842-440f-9231-2b3a3b753041 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:08:39.135976 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f807e-b842-440f-9231-2b3a3b753041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:08:39.210238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-a45f807e-b842-440f-9231-2b3a3b753041 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:08:39.211356 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a45f807e-b842-440f-9231-2b3a3b753041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:08:39.305944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 750/1495] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:08:39.310517 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef2a4b-6d72-41ef-9298-037b69d33549 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:08:39.311701 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-54ef2a4b-6d72-41ef-9298-037b69d33549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:08:39.323002 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef2a4b-6d72-41ef-9298-037b69d33549 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:08:39.385768 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:08:39.421107 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217e561-f71c-4f57-8c6b-121de06dcb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:08:39.421725 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217e561-f71c-4f57-8c6b-121de06dcb05 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:08:39.422002 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217e561-f71c-4f57-8c6b-121de06dcb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:08:39.422302 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217e561-f71c-4f57-8c6b-121de06dcb05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:08:39.422936 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217e561-f71c-4f57-8c6b-121de06dcb05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:08:39.423235 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217e561-f71c-4f57-8c6b-121de06dcb05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:08:39.424249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: WARNING py.warnings [None req-0217e561-f71c-4f57-8c6b-121de06dcb05 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 14:08:39.424249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: warnings.warn(msg) Sep 13 14:08:39.424249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: Sep 13 14:08:39.425163 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217e561-f71c-4f57-8c6b-121de06dcb05 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:08:39.436880 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 746/1496] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:08:39.445765 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f807e-b842-440f-9231-2b3a3b753041 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:08:39.455350 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f807e-b842-440f-9231-2b3a3b753041 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:08:39.515491 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:08:39.549073 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2ba19-5172-4f41-b252-c333dc9c34b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:08:39.549690 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2ba19-5172-4f41-b252-c333dc9c34b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:08:39.549959 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2ba19-5172-4f41-b252-c333dc9c34b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:08:39.550219 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2ba19-5172-4f41-b252-c333dc9c34b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:08:39.550842 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2ba19-5172-4f41-b252-c333dc9c34b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:08:39.552539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: WARNING py.warnings [None req-0ca2ba19-5172-4f41-b252-c333dc9c34b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 14:08:39.552539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: warnings.warn(msg) Sep 13 14:08:39.552539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: Sep 13 14:08:39.553770 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2ba19-5172-4f41-b252-c333dc9c34b1 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:08:39.613415 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 751/1497] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:08:39 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:08:39.617732 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217e561-f71c-4f57-8c6b-121de06dcb05 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:08:39.619278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0217e561-f71c-4f57-8c6b-121de06dcb05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:08:39.653509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217e561-f71c-4f57-8c6b-121de06dcb05 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:08:39.746189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe9dc3-4efb-4712-b8bb-d4d04382571b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:08:39.746784 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe9dc3-4efb-4712-b8bb-d4d04382571b admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:08:39.747056 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe9dc3-4efb-4712-b8bb-d4d04382571b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:08:39.747326 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe9dc3-4efb-4712-b8bb-d4d04382571b admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:08:39.747939 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe9dc3-4efb-4712-b8bb-d4d04382571b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:08:39.748972 dv-cinder-857434-1-smb devstack@keystone.service[81626]: WARNING py.warnings [None req-9fbe9dc3-4efb-4712-b8bb-d4d04382571b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 14:08:39.748972 dv-cinder-857434-1-smb devstack@keystone.service[81626]: warnings.warn(msg) Sep 13 14:08:39.748972 dv-cinder-857434-1-smb devstack@keystone.service[81626]: Sep 13 14:08:39.750200 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe9dc3-4efb-4712-b8bb-d4d04382571b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:08:39.794181 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 747/1498] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:08:39 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:08:39.799070 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2ba19-5172-4f41-b252-c333dc9c34b1 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:08:39.800686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0ca2ba19-5172-4f41-b252-c333dc9c34b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:08:39.861693 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2ba19-5172-4f41-b252-c333dc9c34b1 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:08:39.943720 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:08:39.955542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7ff8a-bef0-4571-a6e3-64700ba41c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:08:39.956133 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7ff8a-bef0-4571-a6e3-64700ba41c05 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:08:39.956424 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7ff8a-bef0-4571-a6e3-64700ba41c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:08:39.956685 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7ff8a-bef0-4571-a6e3-64700ba41c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:08:39.957342 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7ff8a-bef0-4571-a6e3-64700ba41c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:08:39.958333 dv-cinder-857434-1-smb devstack@keystone.service[81625]: WARNING py.warnings [None req-f0c7ff8a-bef0-4571-a6e3-64700ba41c05 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 14:08:39.958333 dv-cinder-857434-1-smb devstack@keystone.service[81625]: warnings.warn(msg) Sep 13 14:08:39.958333 dv-cinder-857434-1-smb devstack@keystone.service[81625]: Sep 13 14:08:39.959205 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7ff8a-bef0-4571-a6e3-64700ba41c05 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:08:39.971340 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 752/1499] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:08:39.975453 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe9dc3-4efb-4712-b8bb-d4d04382571b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:08:39.976956 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9fbe9dc3-4efb-4712-b8bb-d4d04382571b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:08:39.988725 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe9dc3-4efb-4712-b8bb-d4d04382571b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:08:40.013795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:08:40.083837 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b9e6b-4e2c-4f83-a73a-635072dd15ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:08:40.084362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b9e6b-4e2c-4f83-a73a-635072dd15ef admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:08:40.084635 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b9e6b-4e2c-4f83-a73a-635072dd15ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:08:40.084900 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b9e6b-4e2c-4f83-a73a-635072dd15ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:08:40.085565 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b9e6b-4e2c-4f83-a73a-635072dd15ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:08:40.086575 dv-cinder-857434-1-smb devstack@keystone.service[81626]: WARNING py.warnings [None req-295b9e6b-4e2c-4f83-a73a-635072dd15ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 14:08:40.086575 dv-cinder-857434-1-smb devstack@keystone.service[81626]: warnings.warn(msg) Sep 13 14:08:40.086575 dv-cinder-857434-1-smb devstack@keystone.service[81626]: Sep 13 14:08:40.087459 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b9e6b-4e2c-4f83-a73a-635072dd15ef admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:08:40.099614 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 748/1500] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:08:40.103860 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7ff8a-bef0-4571-a6e3-64700ba41c05 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:08:40.105408 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f0c7ff8a-bef0-4571-a6e3-64700ba41c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:08:40.139647 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7ff8a-bef0-4571-a6e3-64700ba41c05 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:08:40.237004 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9304b-c26a-4dbb-a862-4f61593ee26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:08:40.237706 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9304b-c26a-4dbb-a862-4f61593ee26a admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:08:40.237963 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9304b-c26a-4dbb-a862-4f61593ee26a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:08:40.238231 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9304b-c26a-4dbb-a862-4f61593ee26a admin admin] PATH_INFO: `/v3/projects/08a9b5eb28d34d0788169a4bfa927c41/users/5cf04c7eda8a45b889ed1be97fef1778/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:08:40.260387 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9304b-c26a-4dbb-a862-4f61593ee26a admin admin] RBAC: Authorizing `identity:create_grant(project_id=08a9b5eb28d34d0788169a4bfa927c41, user_id=5cf04c7eda8a45b889ed1be97fef1778, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:08:40.261428 dv-cinder-857434-1-smb devstack@keystone.service[81625]: WARNING py.warnings [None req-75f9304b-c26a-4dbb-a862-4f61593ee26a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 14:08:40.261428 dv-cinder-857434-1-smb devstack@keystone.service[81625]: warnings.warn(msg) Sep 13 14:08:40.261428 dv-cinder-857434-1-smb devstack@keystone.service[81625]: Sep 13 14:08:40.263406 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9304b-c26a-4dbb-a862-4f61593ee26a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:08:40.288799 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 753/1501] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:08:40 2022] PUT /identity/v3/projects/08a9b5eb28d34d0788169a4bfa927c41/users/5cf04c7eda8a45b889ed1be97fef1778/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:08:40.301529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a38f85-111d-42fc-bcb6-18e0ab667439 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:08:40.301812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a38f85-111d-42fc-bcb6-18e0ab667439 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:08:40.302078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a38f85-111d-42fc-bcb6-18e0ab667439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:08:40.359306 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-59a38f85-111d-42fc-bcb6-18e0ab667439 None None] MFA Rules not processed for user `5cf04c7eda8a45b889ed1be97fef1778`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:08:40.360973 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-59a38f85-111d-42fc-bcb6-18e0ab667439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:08:40.437818 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 749/1502] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:08:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:08:40.450995 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f15122-0b93-41e7-aa88-0aa6dd58e44c None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:08:40.451274 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f15122-0b93-41e7-aa88-0aa6dd58e44c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:08:40.451542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f15122-0b93-41e7-aa88-0aa6dd58e44c None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:08:40.452883 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 754/1503] 10.222.0.26 () {54 vars in 964 bytes} [Tue Sep 13 14:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:08:40.457565 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e51a2-1bad-49fb-8205-a9fca56af6af None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:08:40.457849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e51a2-1bad-49fb-8205-a9fca56af6af None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:08:40.458117 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e51a2-1bad-49fb-8205-a9fca56af6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:08:40.489776 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:08:40.534926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ed5e51a2-1bad-49fb-8205-a9fca56af6af None None] MFA Rules not processed for user `052d3a21bd3c48c89dcc38ec1444d39a`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:08:40.536126 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ed5e51a2-1bad-49fb-8205-a9fca56af6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:08:40.610347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 750/1504] 10.222.0.26 () {58 vars in 1061 bytes} [Tue Sep 13 14:08:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:08:40.618020 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f15122-0b93-41e7-aa88-0aa6dd58e44c None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:08:40.619584 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c6f15122-0b93-41e7-aa88-0aa6dd58e44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:08:40.669396 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:08:40.723301 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f15122-0b93-41e7-aa88-0aa6dd58e44c None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:08:40.795792 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341a387-7d54-4772-ad9f-194b0f1c4398 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:08:40.796387 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341a387-7d54-4772-ad9f-194b0f1c4398 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:08:40.796663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341a387-7d54-4772-ad9f-194b0f1c4398 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:08:40.796930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341a387-7d54-4772-ad9f-194b0f1c4398 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:08:40.798531 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0341a387-7d54-4772-ad9f-194b0f1c4398 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:08:40.897120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341a387-7d54-4772-ad9f-194b0f1c4398 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:08:40.898500 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341a387-7d54-4772-ad9f-194b0f1c4398 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:08:40.902259 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:08:40.917977 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 755/1505] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:08:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:08:40.963016 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae859029-b582-4da8-91db-4c400689d8ff None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:08:40.963293 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae859029-b582-4da8-91db-4c400689d8ff None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:08:40.963581 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae859029-b582-4da8-91db-4c400689d8ff None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:08:40.964845 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 751/1506] 10.222.0.26 () {52 vars in 830 bytes} [Tue Sep 13 14:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:08:40.968424 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341a387-7d54-4772-ad9f-194b0f1c4398 service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:08:40.969663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0341a387-7d54-4772-ad9f-194b0f1c4398 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:08:41.067545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341a387-7d54-4772-ad9f-194b0f1c4398 service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:08:41.158986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3e892-79f7-418a-a149-48427ca4029e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:08:41.159595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3e892-79f7-418a-a149-48427ca4029e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:08:41.159790 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3e892-79f7-418a-a149-48427ca4029e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:08:41.160057 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3e892-79f7-418a-a149-48427ca4029e admin admin] PATH_INFO: `/v3/users/5cf04c7eda8a45b889ed1be97fef1778` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:08:41.172565 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3e892-79f7-418a-a149-48427ca4029e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cf04c7eda8a45b889ed1be97fef1778)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:08:41.173605 dv-cinder-857434-1-smb devstack@keystone.service[81625]: WARNING py.warnings [None req-0bc3e892-79f7-418a-a149-48427ca4029e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 14:08:41.173605 dv-cinder-857434-1-smb devstack@keystone.service[81625]: warnings.warn(msg) Sep 13 14:08:41.173605 dv-cinder-857434-1-smb devstack@keystone.service[81625]: Sep 13 14:08:41.174816 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3e892-79f7-418a-a149-48427ca4029e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:08:41.184224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:08:41.240655 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-0bc3e892-79f7-418a-a149-48427ca4029e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cf04c7eda8a45b889ed1be97fef1778'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:08:41.251833 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-0bc3e892-79f7-418a-a149-48427ca4029e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cf04c7eda8a45b889ed1be97fef1778'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:08:41.278231 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-0bc3e892-79f7-418a-a149-48427ca4029e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cf04c7eda8a45b889ed1be97fef1778'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:08:41.278692 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-0bc3e892-79f7-418a-a149-48427ca4029e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cf04c7eda8a45b889ed1be97fef1778'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:08:41.293259 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-0bc3e892-79f7-418a-a149-48427ca4029e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cf04c7eda8a45b889ed1be97fef1778'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:08:41.299308 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 756/1507] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:08:40 2022] DELETE /identity/v3/users/5cf04c7eda8a45b889ed1be97fef1778 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:08:41.303769 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb2d19-3736-4505-914c-fef4912ea5f8 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:08:41.304262 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb2d19-3736-4505-914c-fef4912ea5f8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:08:41.304370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb2d19-3736-4505-914c-fef4912ea5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:08:41.361830 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-13eb2d19-3736-4505-914c-fef4912ea5f8 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:08:41.363036 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-13eb2d19-3736-4505-914c-fef4912ea5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:08:41.438672 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:08:41.451492 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 752/1508] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:08:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:08:41.461021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3e892-79f7-418a-a149-48427ca4029e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:08:41.462259 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0bc3e892-79f7-418a-a149-48427ca4029e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:08:41.563953 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3e892-79f7-418a-a149-48427ca4029e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:08:41.621945 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:08:41.646686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051b601-a411-4ddd-8f12-f50239b4a50f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:08:41.647293 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051b601-a411-4ddd-8f12-f50239b4a50f service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:08:41.647564 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051b601-a411-4ddd-8f12-f50239b4a50f service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:08:41.647824 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051b601-a411-4ddd-8f12-f50239b4a50f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:08:41.649425 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e051b601-a411-4ddd-8f12-f50239b4a50f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:08:41.756898 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051b601-a411-4ddd-8f12-f50239b4a50f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:08:41.758386 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051b601-a411-4ddd-8f12-f50239b4a50f service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:08:41.776541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 757/1509] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:08:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:08:42.133500 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb2d19-3736-4505-914c-fef4912ea5f8 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:08:42.134720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-13eb2d19-3736-4505-914c-fef4912ea5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:08:42.146731 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb2d19-3736-4505-914c-fef4912ea5f8 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:08:42.250102 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64936753-6060-4d2b-8f73-efc488b3486d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:08:42.250720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64936753-6060-4d2b-8f73-efc488b3486d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:08:42.250997 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64936753-6060-4d2b-8f73-efc488b3486d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:08:42.251263 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64936753-6060-4d2b-8f73-efc488b3486d admin admin] PATH_INFO: `/v3/projects/08a9b5eb28d34d0788169a4bfa927c41` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:08:42.260993 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64936753-6060-4d2b-8f73-efc488b3486d admin admin] RBAC: Authorizing `identity:delete_project(project_id=08a9b5eb28d34d0788169a4bfa927c41)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:08:42.261993 dv-cinder-857434-1-smb devstack@keystone.service[81626]: WARNING py.warnings [None req-64936753-6060-4d2b-8f73-efc488b3486d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 14:08:42.261993 dv-cinder-857434-1-smb devstack@keystone.service[81626]: warnings.warn(msg) Sep 13 14:08:42.261993 dv-cinder-857434-1-smb devstack@keystone.service[81626]: Sep 13 14:08:42.263184 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64936753-6060-4d2b-8f73-efc488b3486d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:08:42.320927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-64936753-6060-4d2b-8f73-efc488b3486d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08a9b5eb28d34d0788169a4bfa927c41', 'request_id': 'req-64936753-6060-4d2b-8f73-efc488b3486d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:08:42.334732 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-64936753-6060-4d2b-8f73-efc488b3486d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08a9b5eb28d34d0788169a4bfa927c41', 'request_id': 'req-64936753-6060-4d2b-8f73-efc488b3486d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:08:42.343534 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-64936753-6060-4d2b-8f73-efc488b3486d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08a9b5eb28d34d0788169a4bfa927c41', 'request_id': 'req-64936753-6060-4d2b-8f73-efc488b3486d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:08:42.366521 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-64936753-6060-4d2b-8f73-efc488b3486d admin admin] The token cache is being invalidate because project 08a9b5eb28d34d0788169a4bfa927c41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:08:42.366811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-64936753-6060-4d2b-8f73-efc488b3486d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:08:42.367234 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-64936753-6060-4d2b-8f73-efc488b3486d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:08:42.368664 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 753/1510] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:08:42 2022] DELETE /identity/v3/projects/08a9b5eb28d34d0788169a4bfa927c41 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:08:51.774278 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=62 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:08:52.364447 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:10:16.875377 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0115688-7a25-46f6-aafe-d30f05bac609 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:10:16.875970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0115688-7a25-46f6-aafe-d30f05bac609 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:10:16.875970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0115688-7a25-46f6-aafe-d30f05bac609 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:10:16.877208 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 14:10:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:10:16.882112 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515412e0-d28c-4400-97c4-03265c31a072 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:10:16.882511 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515412e0-d28c-4400-97c4-03265c31a072 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:10:16.882653 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515412e0-d28c-4400-97c4-03265c31a072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:10:16.962983 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-515412e0-d28c-4400-97c4-03265c31a072 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:10:16.964190 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-515412e0-d28c-4400-97c4-03265c31a072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:10:17.069662 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 14:10:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:10:17.226147 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0115688-7a25-46f6-aafe-d30f05bac609 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:10:17.228295 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c0115688-7a25-46f6-aafe-d30f05bac609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:10:17.353731 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0115688-7a25-46f6-aafe-d30f05bac609 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:10:17.359918 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bad02d-5569-43e0-9f4b-1d1171d6919a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:10:17.360521 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bad02d-5569-43e0-9f4b-1d1171d6919a service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:10:17.360801 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bad02d-5569-43e0-9f4b-1d1171d6919a service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:10:17.361073 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bad02d-5569-43e0-9f4b-1d1171d6919a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:10:17.369234 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bad02d-5569-43e0-9f4b-1d1171d6919a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:10:17.370834 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bad02d-5569-43e0-9f4b-1d1171d6919a service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:10:17.380908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 759/1513] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:10:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:10:18.468540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e600d7-03a2-4036-8f60-885b81861c1c None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:10:18.469139 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e600d7-03a2-4036-8f60-885b81861c1c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:10:18.469139 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e600d7-03a2-4036-8f60-885b81861c1c None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:10:18.470528 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 14:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:10:18.476719 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ca519-8978-40f6-b884-4993540b1718 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:10:18.477205 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ca519-8978-40f6-b884-4993540b1718 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:10:18.477356 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ca519-8978-40f6-b884-4993540b1718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:10:18.496600 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-319ca519-8978-40f6-b884-4993540b1718 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:10:18.497818 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-319ca519-8978-40f6-b884-4993540b1718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:10:18.506291 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 14:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:10:18.658832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e600d7-03a2-4036-8f60-885b81861c1c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:10:18.672808 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e600d7-03a2-4036-8f60-885b81861c1c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:10:18.678151 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307cf107-da07-4860-a359-ea10ad6fac1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:10:18.678733 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cf107-da07-4860-a359-ea10ad6fac1a service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:10:18.679009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cf107-da07-4860-a359-ea10ad6fac1a service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:10:18.679276 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cf107-da07-4860-a359-ea10ad6fac1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:10:18.687590 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307cf107-da07-4860-a359-ea10ad6fac1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:10:18.689186 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307cf107-da07-4860-a359-ea10ad6fac1a service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:10:18.698222 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 756/1516] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:10:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:10:18.955533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47245e5-cded-4822-b79d-c6f037c819e9 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:10:18.955812 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47245e5-cded-4822-b79d-c6f037c819e9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:10:18.956081 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47245e5-cded-4822-b79d-c6f037c819e9 None None] PATH_INFO: `/v3` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:10:18.957471 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 761/1517] 10.222.0.27 () {54 vars in 925 bytes} [Tue Sep 13 14:10:18 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:10:18.995425 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5a0a3-f896-4ffc-bdd0-dd580696c675 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:10:18.995638 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5a0a3-f896-4ffc-bdd0-dd580696c675 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:10:18.995960 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5a0a3-f896-4ffc-bdd0-dd580696c675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:10:19.056339 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-76f5a0a3-f896-4ffc-bdd0-dd580696c675 None None] MFA Rules not processed for user `311397bfe2c04569852fca0cfcdbad66`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:10:19.057603 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-76f5a0a3-f896-4ffc-bdd0-dd580696c675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:10:19.075223 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:10:19.130847 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 757/1518] 10.222.0.27 () {58 vars in 1015 bytes} [Tue Sep 13 14:10:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:10:28.052309 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf130b-2dd7-49b1-9af1-ec0ea3e1443f None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:10:28.052790 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf130b-2dd7-49b1-9af1-ec0ea3e1443f None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:10:28.052888 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf130b-2dd7-49b1-9af1-ec0ea3e1443f None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:10:28.054255 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 762/1519] 10.222.0.26 () {54 vars in 961 bytes} [Tue Sep 13 14:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:10:28.059300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc20d32-fc0e-4538-89db-32261969e846 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:10:28.059725 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc20d32-fc0e-4538-89db-32261969e846 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:10:28.059856 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc20d32-fc0e-4538-89db-32261969e846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:10:28.081219 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ddc20d32-fc0e-4538-89db-32261969e846 None None] MFA Rules not processed for user `311397bfe2c04569852fca0cfcdbad66`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:10:28.082428 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ddc20d32-fc0e-4538-89db-32261969e846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:10:28.090969 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 758/1520] 10.222.0.26 () {58 vars in 1058 bytes} [Tue Sep 13 14:10:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:10:28.098952 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf130b-2dd7-49b1-9af1-ec0ea3e1443f None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:10:28.112787 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf130b-2dd7-49b1-9af1-ec0ea3e1443f None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:10:28.117728 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae1902-0045-4d19-896c-834d856c0a96 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311397bfe2c04569852fca0cfcdbad66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:10:28.118309 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae1902-0045-4d19-896c-834d856c0a96 service placement] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:10:28.118584 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae1902-0045-4d19-896c-834d856c0a96 service placement] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:10:28.118849 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae1902-0045-4d19-896c-834d856c0a96 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:10:28.126883 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae1902-0045-4d19-896c-834d856c0a96 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:10:28.128450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae1902-0045-4d19-896c-834d856c0a96 service placement] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:10:28.137911 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 763/1521] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:10:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:10:30.160732 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37724331-3ca6-4b20-a706-d88a202395c6 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:10:30.161318 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37724331-3ca6-4b20-a706-d88a202395c6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:10:30.161318 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37724331-3ca6-4b20-a706-d88a202395c6 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:10:30.162729 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 14:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:10:30.168791 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ff6af-c184-4a5f-a248-308b3f2ef470 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:10:30.169256 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ff6af-c184-4a5f-a248-308b3f2ef470 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:10:30.169364 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ff6af-c184-4a5f-a248-308b3f2ef470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:10:30.188835 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-f04ff6af-c184-4a5f-a248-308b3f2ef470 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:10:30.190080 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f04ff6af-c184-4a5f-a248-308b3f2ef470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:10:30.197914 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 14:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:10:30.351510 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37724331-3ca6-4b20-a706-d88a202395c6 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:10:30.366327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37724331-3ca6-4b20-a706-d88a202395c6 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:10:30.371673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53459b9b-146d-4a69-a7a4-72ff288d8c37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:10:30.372248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53459b9b-146d-4a69-a7a4-72ff288d8c37 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:10:30.372520 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53459b9b-146d-4a69-a7a4-72ff288d8c37 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:10:30.372786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53459b9b-146d-4a69-a7a4-72ff288d8c37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:10:30.380596 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53459b9b-146d-4a69-a7a4-72ff288d8c37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:10:30.382200 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53459b9b-146d-4a69-a7a4-72ff288d8c37 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:10:30.391266 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 760/1524] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:10:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:10:31.457664 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3eba0-8198-4377-879f-aef90d24dfce None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:10:31.458219 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3eba0-8198-4377-879f-aef90d24dfce None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:10:31.458219 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3eba0-8198-4377-879f-aef90d24dfce None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:10:31.459567 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 14:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:10:31.465828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50e16c-6a2d-4d41-a60a-1e08d136ac56 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:10:31.466263 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50e16c-6a2d-4d41-a60a-1e08d136ac56 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:10:31.466371 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50e16c-6a2d-4d41-a60a-1e08d136ac56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:10:31.486062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ec50e16c-6a2d-4d41-a60a-1e08d136ac56 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:10:31.487239 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ec50e16c-6a2d-4d41-a60a-1e08d136ac56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:10:31.494995 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 14:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:10:31.644773 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3eba0-8198-4377-879f-aef90d24dfce None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:10:31.659865 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3eba0-8198-4377-879f-aef90d24dfce None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:10:31.665275 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404c43b-ffc7-47c6-82cd-b08de5937f6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:10:31.665855 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404c43b-ffc7-47c6-82cd-b08de5937f6b service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:10:31.666130 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404c43b-ffc7-47c6-82cd-b08de5937f6b service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:10:31.666395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404c43b-ffc7-47c6-82cd-b08de5937f6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:10:31.674292 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404c43b-ffc7-47c6-82cd-b08de5937f6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:10:31.675847 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404c43b-ffc7-47c6-82cd-b08de5937f6b service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:10:31.685068 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 766/1527] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:10:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:10:35.773332 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d569f-e33b-4bdd-a7b2-9af9e2ecbe71 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:10:35.773887 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d569f-e33b-4bdd-a7b2-9af9e2ecbe71 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:10:35.773887 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d569f-e33b-4bdd-a7b2-9af9e2ecbe71 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:10:35.775221 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 14:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:10:35.780976 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee377111-ffe8-4748-9385-4767ad45f4bc None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:10:35.781437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee377111-ffe8-4748-9385-4767ad45f4bc None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:10:35.781615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee377111-ffe8-4748-9385-4767ad45f4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:10:35.800775 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-ee377111-ffe8-4748-9385-4767ad45f4bc None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:10:35.802000 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ee377111-ffe8-4748-9385-4767ad45f4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:10:35.809865 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 14:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:10:36.113689 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d569f-e33b-4bdd-a7b2-9af9e2ecbe71 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:10:36.115647 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d82d569f-e33b-4bdd-a7b2-9af9e2ecbe71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:10:36.194047 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d569f-e33b-4bdd-a7b2-9af9e2ecbe71 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:10:36.197685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cbef0d-88a7-4aa0-aa32-53bb7df5c3ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:10:36.198287 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbef0d-88a7-4aa0-aa32-53bb7df5c3ac service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:10:36.198565 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbef0d-88a7-4aa0-aa32-53bb7df5c3ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:10:36.198834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbef0d-88a7-4aa0-aa32-53bb7df5c3ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:10:36.208093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cbef0d-88a7-4aa0-aa32-53bb7df5c3ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:10:36.209569 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cbef0d-88a7-4aa0-aa32-53bb7df5c3ac service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:10:36.218820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 763/1530] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:10:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:10:38.336810 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba605a7-eaae-499d-81ca-36f4de84586d None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:10:38.337505 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba605a7-eaae-499d-81ca-36f4de84586d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:10:38.337505 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba605a7-eaae-499d-81ca-36f4de84586d None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:10:38.338861 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 14:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:10:38.344503 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be4d8a-3b60-4e0b-93c9-468564fe1848 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:10:38.344947 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be4d8a-3b60-4e0b-93c9-468564fe1848 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:10:38.345052 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be4d8a-3b60-4e0b-93c9-468564fe1848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:10:38.364951 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-23be4d8a-3b60-4e0b-93c9-468564fe1848 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:10:38.366189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-23be4d8a-3b60-4e0b-93c9-468564fe1848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:10:38.374176 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 14:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:10:38.657419 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba605a7-eaae-499d-81ca-36f4de84586d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:10:38.668227 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba605a7-eaae-499d-81ca-36f4de84586d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:10:38.671721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54005b57-afd4-489a-99b0-db85f0051446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:10:38.672362 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54005b57-afd4-489a-99b0-db85f0051446 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:10:38.672642 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54005b57-afd4-489a-99b0-db85f0051446 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:10:38.672915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54005b57-afd4-489a-99b0-db85f0051446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:10:38.681661 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54005b57-afd4-489a-99b0-db85f0051446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:10:38.683053 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54005b57-afd4-489a-99b0-db85f0051446 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:10:38.692758 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 769/1533] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:10:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:10:42.258844 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878e5b6-48bb-4a7d-94f5-c6cd07cfea09 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:10:42.259440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878e5b6-48bb-4a7d-94f5-c6cd07cfea09 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:10:42.259440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878e5b6-48bb-4a7d-94f5-c6cd07cfea09 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:10:42.260758 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 14:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:10:42.265933 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9ed62-3272-490e-8c10-69b6d65a2c63 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:10:42.266360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9ed62-3272-490e-8c10-69b6d65a2c63 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:10:42.266463 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9ed62-3272-490e-8c10-69b6d65a2c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:10:42.274024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=81 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:10:42.288100 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-c5c9ed62-3272-490e-8c10-69b6d65a2c63 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:10:42.289331 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c5c9ed62-3272-490e-8c10-69b6d65a2c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:10:42.297641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 14:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:10:42.601146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878e5b6-48bb-4a7d-94f5-c6cd07cfea09 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:10:42.602814 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6878e5b6-48bb-4a7d-94f5-c6cd07cfea09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:10:42.669523 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:10:42.683760 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878e5b6-48bb-4a7d-94f5-c6cd07cfea09 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:10:42.687277 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f9862-719b-4ad7-a8e7-1b3d0cda039c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:10:42.687872 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f9862-719b-4ad7-a8e7-1b3d0cda039c service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:10:42.688144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f9862-719b-4ad7-a8e7-1b3d0cda039c service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:10:42.688406 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f9862-719b-4ad7-a8e7-1b3d0cda039c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:10:42.697145 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f9862-719b-4ad7-a8e7-1b3d0cda039c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:10:42.698561 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f9862-719b-4ad7-a8e7-1b3d0cda039c service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:10:42.708489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 766/1536] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:10:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:10:44.850505 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd04fa4-f354-494d-9c95-93f6d9f75232 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:10:44.851057 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd04fa4-f354-494d-9c95-93f6d9f75232 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:10:44.851057 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd04fa4-f354-494d-9c95-93f6d9f75232 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:10:44.852375 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 14:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:10:44.857514 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685cda0-b7c7-4502-bad9-75fa6cb38eab None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:10:44.857957 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685cda0-b7c7-4502-bad9-75fa6cb38eab None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:10:44.858086 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685cda0-b7c7-4502-bad9-75fa6cb38eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:10:44.877971 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-6685cda0-b7c7-4502-bad9-75fa6cb38eab None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:10:44.879094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6685cda0-b7c7-4502-bad9-75fa6cb38eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:10:44.886897 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 14:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:10:45.189057 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd04fa4-f354-494d-9c95-93f6d9f75232 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:10:45.190720 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8cd04fa4-f354-494d-9c95-93f6d9f75232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:10:45.203946 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd04fa4-f354-494d-9c95-93f6d9f75232 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:10:45.207444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e65452-e84c-4630-b170-9c62783dc187 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:10:45.208021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e65452-e84c-4630-b170-9c62783dc187 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:10:45.208292 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e65452-e84c-4630-b170-9c62783dc187 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:10:45.208553 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e65452-e84c-4630-b170-9c62783dc187 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:10:45.217210 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e65452-e84c-4630-b170-9c62783dc187 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:10:45.218608 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e65452-e84c-4630-b170-9c62783dc187 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:10:45.228262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 772/1539] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:10:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:10:54.873214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=11 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:10:55.224157 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=8 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:15.513139 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f7ca5-78db-45dd-a54c-af8b0b10f06f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:15.513139 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f7ca5-78db-45dd-a54c-af8b0b10f06f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:15.513139 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f7ca5-78db-45dd-a54c-af8b0b10f06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:15.545751 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-8e2f7ca5-78db-45dd-a54c-af8b0b10f06f None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:15.547314 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8e2f7ca5-78db-45dd-a54c-af8b0b10f06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:15.561465 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 768/1540] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:15.570065 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45a1cf-f9e7-4506-ad2d-ed856ca3f458 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:15.571059 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45a1cf-f9e7-4506-ad2d-ed856ca3f458 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:15.571523 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45a1cf-f9e7-4506-ad2d-ed856ca3f458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:15.605616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-8c45a1cf-f9e7-4506-ad2d-ed856ca3f458 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:15.607234 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8c45a1cf-f9e7-4506-ad2d-ed856ca3f458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:15.615959 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 773/1541] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:15.620763 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f7ca5-78db-45dd-a54c-af8b0b10f06f None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:15.634605 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f7ca5-78db-45dd-a54c-af8b0b10f06f None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:15.645179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae67bb6-0e96-4516-a7d1-9dbfe05fe433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:15.646141 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae67bb6-0e96-4516-a7d1-9dbfe05fe433 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:15.646710 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae67bb6-0e96-4516-a7d1-9dbfe05fe433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:15.647177 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae67bb6-0e96-4516-a7d1-9dbfe05fe433 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:15.648036 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae67bb6-0e96-4516-a7d1-9dbfe05fe433 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:12:15.648532 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae67bb6-0e96-4516-a7d1-9dbfe05fe433 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:15.650376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae67bb6-0e96-4516-a7d1-9dbfe05fe433 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:15.664248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 769/1542] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:12:15.669275 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ab761-544c-4273-be5d-ae2b6bc93b0b None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:15.670349 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ab761-544c-4273-be5d-ae2b6bc93b0b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:15.670814 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ab761-544c-4273-be5d-ae2b6bc93b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:15.679665 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae67bb6-0e96-4516-a7d1-9dbfe05fe433 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:15.700260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-1f5ab761-544c-4273-be5d-ae2b6bc93b0b None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:15.707587 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1f5ab761-544c-4273-be5d-ae2b6bc93b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:15.711663 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae67bb6-0e96-4516-a7d1-9dbfe05fe433 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:15.719110 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eccfb43-ebd6-45d1-8dd7-dae18f218296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:15.720005 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccfb43-ebd6-45d1-8dd7-dae18f218296 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:15.720449 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccfb43-ebd6-45d1-8dd7-dae18f218296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:15.720876 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccfb43-ebd6-45d1-8dd7-dae18f218296 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:15.721720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eccfb43-ebd6-45d1-8dd7-dae18f218296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:15.722926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: WARNING py.warnings [None req-5eccfb43-ebd6-45d1-8dd7-dae18f218296 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 14:12:15.722926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: warnings.warn(msg) Sep 13 14:12:15.722926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: Sep 13 14:12:15.724477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eccfb43-ebd6-45d1-8dd7-dae18f218296 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:15.726226 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 774/1543] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:15.728009 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e32dec-c5e4-4e63-91df-c1cb3f5c7338 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:15.728491 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e32dec-c5e4-4e63-91df-c1cb3f5c7338 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:15.728958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e32dec-c5e4-4e63-91df-c1cb3f5c7338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:15.771605 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-79e32dec-c5e4-4e63-91df-c1cb3f5c7338 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:15.773173 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-79e32dec-c5e4-4e63-91df-c1cb3f5c7338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:15.785910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 775/1544] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:15.787008 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e7994-76a2-4885-82b9-c3e4eafc11ce None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:15.787292 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e7994-76a2-4885-82b9-c3e4eafc11ce None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:15.787565 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e7994-76a2-4885-82b9-c3e4eafc11ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:15.814084 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 770/1545] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:12:15 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:15.815212 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4cc75-3bf6-4a08-840b-49634f04fbde None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:15.815434 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4cc75-3bf6-4a08-840b-49634f04fbde None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:15.815711 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4cc75-3bf6-4a08-840b-49634f04fbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:15.834173 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-c83e7994-76a2-4885-82b9-c3e4eafc11ce None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:15.835408 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c83e7994-76a2-4885-82b9-c3e4eafc11ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:15.850185 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-8ed4cc75-3bf6-4a08-840b-49634f04fbde None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:15.851753 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8ed4cc75-3bf6-4a08-840b-49634f04fbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:15.915717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 776/1546] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:15.915717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c90bf1-479c-4847-b5d5-88ba82747b1c None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:15.915717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c90bf1-479c-4847-b5d5-88ba82747b1c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:15.915717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c90bf1-479c-4847-b5d5-88ba82747b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:15.928130 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 771/1547] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:15.929009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4cc75-3bf6-4a08-840b-49634f04fbde None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:15.939319 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4cc75-3bf6-4a08-840b-49634f04fbde None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:15.940561 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-49c90bf1-479c-4847-b5d5-88ba82747b1c None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:15.941842 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-49c90bf1-479c-4847-b5d5-88ba82747b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:15.944282 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21e9c5-e403-476b-9751-c8c8b78529a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:15.944983 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21e9c5-e403-476b-9751-c8c8b78529a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:15.945296 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21e9c5-e403-476b-9751-c8c8b78529a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:15.945567 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21e9c5-e403-476b-9751-c8c8b78529a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:15.946201 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21e9c5-e403-476b-9751-c8c8b78529a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:15.948107 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21e9c5-e403-476b-9751-c8c8b78529a2 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:15.950197 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 777/1548] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:15.951838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7f141-1274-4dd3-8244-23d66fbcf3d0 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:15.952117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7f141-1274-4dd3-8244-23d66fbcf3d0 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:15.952383 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7f141-1274-4dd3-8244-23d66fbcf3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:15.972018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 772/1549] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:12:15 2022] POST /identity/v3/users => generated 294 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:15.973669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5af829-ac63-4809-9da5-db5f7c565f5b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:15.974203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5af829-ac63-4809-9da5-db5f7c565f5b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:15.974683 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5af829-ac63-4809-9da5-db5f7c565f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:15.983435 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-c3e7f141-1274-4dd3-8244-23d66fbcf3d0 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:15.990249 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c3e7f141-1274-4dd3-8244-23d66fbcf3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:15.995154 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-6e5af829-ac63-4809-9da5-db5f7c565f5b None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:15.996338 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6e5af829-ac63-4809-9da5-db5f7c565f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:15.999022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 778/1550] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:15.999919 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7f141-1274-4dd3-8244-23d66fbcf3d0 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:16.005572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 773/1551] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:16.007656 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3fcef-d3db-4538-9e73-de09555fdb25 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.007944 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3fcef-d3db-4538-9e73-de09555fdb25 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.008223 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3fcef-d3db-4538-9e73-de09555fdb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.012117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7f141-1274-4dd3-8244-23d66fbcf3d0 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:16.021701 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2557e4c-b6e3-4b31-94d8-1ec2581790a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:16.022240 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2557e4c-b6e3-4b31-94d8-1ec2581790a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.022520 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2557e4c-b6e3-4b31-94d8-1ec2581790a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.022780 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2557e4c-b6e3-4b31-94d8-1ec2581790a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.023425 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2557e4c-b6e3-4b31-94d8-1ec2581790a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:12:16.023721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2557e4c-b6e3-4b31-94d8-1ec2581790a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:16.024718 dv-cinder-857434-1-smb devstack@keystone.service[81625]: WARNING py.warnings [None req-d2557e4c-b6e3-4b31-94d8-1ec2581790a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 14:12:16.024718 dv-cinder-857434-1-smb devstack@keystone.service[81625]: warnings.warn(msg) Sep 13 14:12:16.024718 dv-cinder-857434-1-smb devstack@keystone.service[81625]: Sep 13 14:12:16.025639 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2557e4c-b6e3-4b31-94d8-1ec2581790a7 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:16.035129 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-79e3fcef-d3db-4538-9e73-de09555fdb25 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:16.036954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-79e3fcef-d3db-4538-9e73-de09555fdb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:16.038137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 779/1552] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:12:16.039320 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0153d-8336-4628-a748-1f26c334071e None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.039597 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0153d-8336-4628-a748-1f26c334071e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.039861 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0153d-8336-4628-a748-1f26c334071e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.045228 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 774/1553] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:16.045848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3fcef-d3db-4538-9e73-de09555fdb25 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:16.056692 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3fcef-d3db-4538-9e73-de09555fdb25 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:16.061299 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e1c0153d-8336-4628-a748-1f26c334071e None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:16.061957 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe4cf8-ae0e-41f3-963d-9eb6096dc582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:16.062498 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e1c0153d-8336-4628-a748-1f26c334071e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:16.062636 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe4cf8-ae0e-41f3-963d-9eb6096dc582 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.062797 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe4cf8-ae0e-41f3-963d-9eb6096dc582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.063065 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe4cf8-ae0e-41f3-963d-9eb6096dc582 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.063695 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe4cf8-ae0e-41f3-963d-9eb6096dc582 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:12:16.063995 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe4cf8-ae0e-41f3-963d-9eb6096dc582 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:16.065641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe4cf8-ae0e-41f3-963d-9eb6096dc582 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:16.070335 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 780/1554] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:16.071092 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0153d-8336-4628-a748-1f26c334071e None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:16.079607 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 775/1555] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:12:16.080911 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329798ae-4128-4b3b-b795-5d8e45afbdd5 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.081255 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329798ae-4128-4b3b-b795-5d8e45afbdd5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.081531 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329798ae-4128-4b3b-b795-5d8e45afbdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.083470 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0153d-8336-4628-a748-1f26c334071e None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:16.088804 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878efb3-c98f-44fd-b9ba-9b9cf6f80990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:16.089450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878efb3-c98f-44fd-b9ba-9b9cf6f80990 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.089730 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878efb3-c98f-44fd-b9ba-9b9cf6f80990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.089996 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878efb3-c98f-44fd-b9ba-9b9cf6f80990 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.090649 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878efb3-c98f-44fd-b9ba-9b9cf6f80990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:16.092842 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878efb3-c98f-44fd-b9ba-9b9cf6f80990 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:16.102732 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-329798ae-4128-4b3b-b795-5d8e45afbdd5 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:16.103255 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 781/1556] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:16.103980 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-329798ae-4128-4b3b-b795-5d8e45afbdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:16.104540 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cb491-d1fb-4342-80ef-125dfc551919 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.104833 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cb491-d1fb-4342-80ef-125dfc551919 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.105130 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cb491-d1fb-4342-80ef-125dfc551919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.113238 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 776/1557] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:16.114979 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91186f-d0e6-4152-a1ff-8c304737612d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.114979 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91186f-d0e6-4152-a1ff-8c304737612d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.114979 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91186f-d0e6-4152-a1ff-8c304737612d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.126175 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-569cb491-d1fb-4342-80ef-125dfc551919 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:16.127390 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-569cb491-d1fb-4342-80ef-125dfc551919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:16.133975 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-9a91186f-d0e6-4152-a1ff-8c304737612d None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:16.135132 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9a91186f-d0e6-4152-a1ff-8c304737612d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:16.138877 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 782/1558] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:16.138877 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cb491-d1fb-4342-80ef-125dfc551919 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:16.145962 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 777/1559] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:16.146123 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cb491-d1fb-4342-80ef-125dfc551919 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:16.147267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16732b50-478f-4adf-b841-c07f2d593575 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.147553 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16732b50-478f-4adf-b841-c07f2d593575 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.147936 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16732b50-478f-4adf-b841-c07f2d593575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.150910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083c4ac-0c4b-4108-9777-66825a9a8f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:16.151497 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083c4ac-0c4b-4108-9777-66825a9a8f98 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.151777 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083c4ac-0c4b-4108-9777-66825a9a8f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.152052 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083c4ac-0c4b-4108-9777-66825a9a8f98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.152669 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083c4ac-0c4b-4108-9777-66825a9a8f98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:16.205115 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083c4ac-0c4b-4108-9777-66825a9a8f98 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:16.219929 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-16732b50-478f-4adf-b841-c07f2d593575 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:16.221198 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-16732b50-478f-4adf-b841-c07f2d593575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:16.229670 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 778/1560] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:16.230540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16732b50-478f-4adf-b841-c07f2d593575 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:16.236658 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 783/1561] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:12:16 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:16.236658 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083c4ac-0c4b-4108-9777-66825a9a8f98 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:16.241265 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16732b50-478f-4adf-b841-c07f2d593575 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:16.285048 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:16.298763 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083c4ac-0c4b-4108-9777-66825a9a8f98 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:16.300501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9a96c-95f7-4828-8c2c-dd864409415d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:16.301176 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9a96c-95f7-4828-8c2c-dd864409415d admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.301420 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9a96c-95f7-4828-8c2c-dd864409415d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.301695 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9a96c-95f7-4828-8c2c-dd864409415d admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.302367 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9a96c-95f7-4828-8c2c-dd864409415d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:12:16.302667 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9a96c-95f7-4828-8c2c-dd864409415d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:16.303420 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae298dfa-8304-4f91-8e58-6356368c401d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:16.304047 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae298dfa-8304-4f91-8e58-6356368c401d admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.304333 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae298dfa-8304-4f91-8e58-6356368c401d admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.304467 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9a96c-95f7-4828-8c2c-dd864409415d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:16.304653 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae298dfa-8304-4f91-8e58-6356368c401d admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.305298 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae298dfa-8304-4f91-8e58-6356368c401d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:16.307274 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae298dfa-8304-4f91-8e58-6356368c401d admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:16.315942 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 779/1562] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:12:16.316747 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9a96c-95f7-4828-8c2c-dd864409415d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:16.322202 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:16.328355 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9a96c-95f7-4828-8c2c-dd864409415d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:16.332987 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70676bd2-74a4-4c31-b94f-4fe4059c1d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:16.333734 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70676bd2-74a4-4c31-b94f-4fe4059c1d2b admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.333962 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70676bd2-74a4-4c31-b94f-4fe4059c1d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.334234 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70676bd2-74a4-4c31-b94f-4fe4059c1d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.334890 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70676bd2-74a4-4c31-b94f-4fe4059c1d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:16.338882 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 784/1563] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:12:16 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:16.339036 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70676bd2-74a4-4c31-b94f-4fe4059c1d2b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:16.339154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e82ed-ece8-4013-ba25-1f75654367c1 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.339154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e82ed-ece8-4013-ba25-1f75654367c1 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.339154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e82ed-ece8-4013-ba25-1f75654367c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.347830 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 780/1564] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:16.348656 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70676bd2-74a4-4c31-b94f-4fe4059c1d2b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:16.362807 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70676bd2-74a4-4c31-b94f-4fe4059c1d2b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:16.363476 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-067e82ed-ece8-4013-ba25-1f75654367c1 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:16.364688 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-067e82ed-ece8-4013-ba25-1f75654367c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:16.421966 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86271dfb-7838-4c12-9165-314b17d879fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:16.422578 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86271dfb-7838-4c12-9165-314b17d879fa admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.422862 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86271dfb-7838-4c12-9165-314b17d879fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.423131 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86271dfb-7838-4c12-9165-314b17d879fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.423767 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86271dfb-7838-4c12-9165-314b17d879fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:12:16.424070 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86271dfb-7838-4c12-9165-314b17d879fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:16.425706 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86271dfb-7838-4c12-9165-314b17d879fa admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:16.426391 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 785/1565] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:16.427272 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e82ed-ece8-4013-ba25-1f75654367c1 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:16.436291 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e82ed-ece8-4013-ba25-1f75654367c1 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:16.440824 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 781/1566] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:12:16.440958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d785277-0e51-4f4c-a05e-70621b0d7f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:16.441450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d785277-0e51-4f4c-a05e-70621b0d7f31 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.441566 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86271dfb-7838-4c12-9165-314b17d879fa admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:16.441718 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d785277-0e51-4f4c-a05e-70621b0d7f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.441982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d785277-0e51-4f4c-a05e-70621b0d7f31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.442613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d785277-0e51-4f4c-a05e-70621b0d7f31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:12:16.442907 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d785277-0e51-4f4c-a05e-70621b0d7f31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:16.444569 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d785277-0e51-4f4c-a05e-70621b0d7f31 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:16.451955 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86271dfb-7838-4c12-9165-314b17d879fa admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:16.456727 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c96ecb-b176-47a6-bb35-e591ed9ee8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:16.461787 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 786/1567] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:12:16.461955 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c96ecb-b176-47a6-bb35-e591ed9ee8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.461955 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c96ecb-b176-47a6-bb35-e591ed9ee8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.462178 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d785277-0e51-4f4c-a05e-70621b0d7f31 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:16.462281 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c96ecb-b176-47a6-bb35-e591ed9ee8f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.462281 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c96ecb-b176-47a6-bb35-e591ed9ee8f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:12:16.462281 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c96ecb-b176-47a6-bb35-e591ed9ee8f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:16.462281 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c96ecb-b176-47a6-bb35-e591ed9ee8f1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:16.468162 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d785277-0e51-4f4c-a05e-70621b0d7f31 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:16.473026 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2693c2-dafc-4e9f-b55f-7dd270e8cc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:16.473885 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2693c2-dafc-4e9f-b55f-7dd270e8cc70 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.474162 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2693c2-dafc-4e9f-b55f-7dd270e8cc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.474430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2693c2-dafc-4e9f-b55f-7dd270e8cc70 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.475265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2693c2-dafc-4e9f-b55f-7dd270e8cc70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:16.475413 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 782/1568] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:12:16.475898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c96ecb-b176-47a6-bb35-e591ed9ee8f1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:16.476329 dv-cinder-857434-1-smb devstack@keystone.service[81625]: WARNING py.warnings [None req-ec2693c2-dafc-4e9f-b55f-7dd270e8cc70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 14:12:16.476329 dv-cinder-857434-1-smb devstack@keystone.service[81625]: warnings.warn(msg) Sep 13 14:12:16.476329 dv-cinder-857434-1-smb devstack@keystone.service[81625]: Sep 13 14:12:16.477732 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2693c2-dafc-4e9f-b55f-7dd270e8cc70 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:16.487220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c96ecb-b176-47a6-bb35-e591ed9ee8f1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:16.493362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a885f-878e-4563-bbee-20b9aa3a3a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:16.494063 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a885f-878e-4563-bbee-20b9aa3a3a3f admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.494344 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a885f-878e-4563-bbee-20b9aa3a3a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.494611 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a885f-878e-4563-bbee-20b9aa3a3a3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.495235 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a885f-878e-4563-bbee-20b9aa3a3a3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:16.497207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a885f-878e-4563-bbee-20b9aa3a3a3f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:16.500306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 787/1569] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:12:16 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:16.501198 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2693c2-dafc-4e9f-b55f-7dd270e8cc70 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:16.511255 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2693c2-dafc-4e9f-b55f-7dd270e8cc70 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:16.517485 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ebeeb-ffd0-40c7-9985-69bcc0441177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:16.518202 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ebeeb-ffd0-40c7-9985-69bcc0441177 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.518598 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ebeeb-ffd0-40c7-9985-69bcc0441177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.518871 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ebeeb-ffd0-40c7-9985-69bcc0441177 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.519498 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ebeeb-ffd0-40c7-9985-69bcc0441177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:16.521568 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ebeeb-ffd0-40c7-9985-69bcc0441177 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:16.524634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 783/1570] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:12:16 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:16.525335 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a885f-878e-4563-bbee-20b9aa3a3a3f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:16.543526 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 788/1571] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:12:16 2022] POST /identity/v3/users => generated 290 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:16.544279 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ebeeb-ffd0-40c7-9985-69bcc0441177 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:16.554691 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ebeeb-ffd0-40c7-9985-69bcc0441177 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:16.589899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a885f-878e-4563-bbee-20b9aa3a3a3f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:16.595092 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab994f0-bdbb-4c1e-9768-ee6f4b1201b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:16.595745 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab994f0-bdbb-4c1e-9768-ee6f4b1201b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.596020 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab994f0-bdbb-4c1e-9768-ee6f4b1201b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.596287 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab994f0-bdbb-4c1e-9768-ee6f4b1201b8 admin admin] PATH_INFO: `/v3/projects/56a108845fcb4358aa5697ab47adac2e/users/a06ffa78739345039aff49f6fb524b2b/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.612436 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab994f0-bdbb-4c1e-9768-ee6f4b1201b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56a108845fcb4358aa5697ab47adac2e, user_id=a06ffa78739345039aff49f6fb524b2b, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:16.613653 dv-cinder-857434-1-smb devstack@keystone.service[81626]: WARNING py.warnings [None req-6ab994f0-bdbb-4c1e-9768-ee6f4b1201b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 14:12:16.613653 dv-cinder-857434-1-smb devstack@keystone.service[81626]: warnings.warn(msg) Sep 13 14:12:16.613653 dv-cinder-857434-1-smb devstack@keystone.service[81626]: Sep 13 14:12:16.615406 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f2676-21f3-4a55-aff9-f33cde614d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:16.615894 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab994f0-bdbb-4c1e-9768-ee6f4b1201b8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:16.616087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f2676-21f3-4a55-aff9-f33cde614d09 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.616296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f2676-21f3-4a55-aff9-f33cde614d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.616566 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f2676-21f3-4a55-aff9-f33cde614d09 admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.617260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f2676-21f3-4a55-aff9-f33cde614d09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:12:16.617564 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f2676-21f3-4a55-aff9-f33cde614d09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:16.619313 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f2676-21f3-4a55-aff9-f33cde614d09 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:16.631710 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 784/1572] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:12:16 2022] PUT /identity/v3/projects/56a108845fcb4358aa5697ab47adac2e/users/a06ffa78739345039aff49f6fb524b2b/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:16.632670 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 789/1573] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:12:16.633531 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f2676-21f3-4a55-aff9-f33cde614d09 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:16.633652 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab994f0-bdbb-4c1e-9768-ee6f4b1201b8 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:16.649302 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f2676-21f3-4a55-aff9-f33cde614d09 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:16.651117 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:16.691082 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:16.703961 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab994f0-bdbb-4c1e-9768-ee6f4b1201b8 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:16.708682 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8082a8-4e94-46e0-ad2f-ad452a189bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:16.709434 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8082a8-4e94-46e0-ad2f-ad452a189bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.709723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8082a8-4e94-46e0-ad2f-ad452a189bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.710055 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8082a8-4e94-46e0-ad2f-ad452a189bf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.710624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8082a8-4e94-46e0-ad2f-ad452a189bf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:16.710740 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e2303-4fa0-485f-9c5e-242b67624e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:16.711217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e2303-4fa0-485f-9c5e-242b67624e00 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.711491 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e2303-4fa0-485f-9c5e-242b67624e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.711756 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e2303-4fa0-485f-9c5e-242b67624e00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.712399 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e2303-4fa0-485f-9c5e-242b67624e00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:16.712528 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8082a8-4e94-46e0-ad2f-ad452a189bf1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:16.714322 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e2303-4fa0-485f-9c5e-242b67624e00 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:16.739613 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 785/1574] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:12:16 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:16.740407 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8082a8-4e94-46e0-ad2f-ad452a189bf1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:16.741618 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 790/1575] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:12:16 2022] POST /identity/v3/projects => generated 393 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:16.745367 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e2303-4fa0-485f-9c5e-242b67624e00 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:16.802609 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8082a8-4e94-46e0-ad2f-ad452a189bf1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:16.807463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f91cff-90d5-476a-aed9-3d5eb788590c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:16.807748 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e2303-4fa0-485f-9c5e-242b67624e00 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:16.808175 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f91cff-90d5-476a-aed9-3d5eb788590c admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.808458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f91cff-90d5-476a-aed9-3d5eb788590c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.808763 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f91cff-90d5-476a-aed9-3d5eb788590c admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.809373 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f91cff-90d5-476a-aed9-3d5eb788590c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:16.811861 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f91cff-90d5-476a-aed9-3d5eb788590c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:16.812876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8d5b7-9d2d-4d50-84ce-35e9c1b7521b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:16.813497 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8d5b7-9d2d-4d50-84ce-35e9c1b7521b admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.813776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8d5b7-9d2d-4d50-84ce-35e9c1b7521b admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.814046 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8d5b7-9d2d-4d50-84ce-35e9c1b7521b admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.814700 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8d5b7-9d2d-4d50-84ce-35e9c1b7521b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:16.816297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8d5b7-9d2d-4d50-84ce-35e9c1b7521b admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:16.829403 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 791/1576] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:16.829403 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8d5b7-9d2d-4d50-84ce-35e9c1b7521b admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:16.838952 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8d5b7-9d2d-4d50-84ce-35e9c1b7521b admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:16.843595 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 786/1577] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:12:16 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:16.844414 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f91cff-90d5-476a-aed9-3d5eb788590c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:16.847210 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac93df-ea5b-4faf-9124-ee5882c980e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:16.847805 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac93df-ea5b-4faf-9124-ee5882c980e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.848079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac93df-ea5b-4faf-9124-ee5882c980e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.848346 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac93df-ea5b-4faf-9124-ee5882c980e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.848960 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac93df-ea5b-4faf-9124-ee5882c980e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:16.850893 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac93df-ea5b-4faf-9124-ee5882c980e4 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:16.873517 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 792/1578] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:12:16 2022] POST /identity/v3/users => generated 292 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:16.874746 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b869f-931c-46ae-9c3a-e4bf4d4cca9b None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.875021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b869f-931c-46ae-9c3a-e4bf4d4cca9b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.875287 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b869f-931c-46ae-9c3a-e4bf4d4cca9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.899691 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-c06b869f-931c-46ae-9c3a-e4bf4d4cca9b None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:16.900888 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c06b869f-931c-46ae-9c3a-e4bf4d4cca9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:16.913070 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f91cff-90d5-476a-aed9-3d5eb788590c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:16.917706 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a654f-f1ff-4fc4-a7c2-62c8adf70198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:16.918308 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a654f-f1ff-4fc4-a7c2-62c8adf70198 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.918591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a654f-f1ff-4fc4-a7c2-62c8adf70198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.918857 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a654f-f1ff-4fc4-a7c2-62c8adf70198 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.919522 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a654f-f1ff-4fc4-a7c2-62c8adf70198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:16.921151 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a654f-f1ff-4fc4-a7c2-62c8adf70198 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:16.931751 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 787/1579] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:16.932681 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a654f-f1ff-4fc4-a7c2-62c8adf70198 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:16.943070 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a654f-f1ff-4fc4-a7c2-62c8adf70198 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:16.949371 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67517a82-f76d-4039-83dd-4479ec171a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:16.950002 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67517a82-f76d-4039-83dd-4479ec171a30 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.950280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67517a82-f76d-4039-83dd-4479ec171a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.950547 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67517a82-f76d-4039-83dd-4479ec171a30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.951208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67517a82-f76d-4039-83dd-4479ec171a30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:16.953200 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67517a82-f76d-4039-83dd-4479ec171a30 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:16.968844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 793/1580] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:16.969407 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:16.969534 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b869f-931c-46ae-9c3a-e4bf4d4cca9b None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:16.981608 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b869f-931c-46ae-9c3a-e4bf4d4cca9b None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:16.985548 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 788/1581] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:12:16 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:16.986409 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67517a82-f76d-4039-83dd-4479ec171a30 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:16.989338 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81627654-19a1-4944-981f-be8c34fbf0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:16.989938 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81627654-19a1-4944-981f-be8c34fbf0bd admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:16.990220 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81627654-19a1-4944-981f-be8c34fbf0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:16.990500 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81627654-19a1-4944-981f-be8c34fbf0bd admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:16.991133 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81627654-19a1-4944-981f-be8c34fbf0bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:16.993051 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81627654-19a1-4944-981f-be8c34fbf0bd admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:17.015815 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 794/1582] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:12:16 2022] POST /identity/v3/users => generated 284 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:17.016838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81627654-19a1-4944-981f-be8c34fbf0bd admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:17.027293 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81627654-19a1-4944-981f-be8c34fbf0bd admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:17.051814 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:17.054274 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67517a82-f76d-4039-83dd-4479ec171a30 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:17.059088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856a825-82f2-4a84-a92e-1a80fa91d83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:17.059803 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856a825-82f2-4a84-a92e-1a80fa91d83e admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:17.059955 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856a825-82f2-4a84-a92e-1a80fa91d83e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:17.060747 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856a825-82f2-4a84-a92e-1a80fa91d83e admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:17.061466 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856a825-82f2-4a84-a92e-1a80fa91d83e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:17.063383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856a825-82f2-4a84-a92e-1a80fa91d83e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:17.086115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 789/1583] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:12:16 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:17.086995 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856a825-82f2-4a84-a92e-1a80fa91d83e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:17.087124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23000f-1a3d-4614-97f5-dd5710a456ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:17.088226 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23000f-1a3d-4614-97f5-dd5710a456ef admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:17.088583 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23000f-1a3d-4614-97f5-dd5710a456ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:17.088932 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23000f-1a3d-4614-97f5-dd5710a456ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:17.089698 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23000f-1a3d-4614-97f5-dd5710a456ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:17.091297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23000f-1a3d-4614-97f5-dd5710a456ef admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:17.100181 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856a825-82f2-4a84-a92e-1a80fa91d83e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:17.102012 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 795/1584] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:17.103148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23000f-1a3d-4614-97f5-dd5710a456ef admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:17.104948 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d69a1c-8c3d-40f3-9c9d-91c16b617b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:17.105583 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d69a1c-8c3d-40f3-9c9d-91c16b617b62 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:17.105858 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d69a1c-8c3d-40f3-9c9d-91c16b617b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:17.106127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d69a1c-8c3d-40f3-9c9d-91c16b617b62 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:17.106750 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d69a1c-8c3d-40f3-9c9d-91c16b617b62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:17.108793 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d69a1c-8c3d-40f3-9c9d-91c16b617b62 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:17.112871 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23000f-1a3d-4614-97f5-dd5710a456ef admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:17.123347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a7546-5b8d-49f3-976c-b957764379f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:17.124147 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a7546-5b8d-49f3-976c-b957764379f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:17.124553 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a7546-5b8d-49f3-976c-b957764379f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:17.124977 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a7546-5b8d-49f3-976c-b957764379f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:17.125768 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a7546-5b8d-49f3-976c-b957764379f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:17.127360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a7546-5b8d-49f3-976c-b957764379f7 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:17.131251 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 790/1585] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:12:17 2022] POST /identity/v3/users => generated 287 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:17.132077 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d69a1c-8c3d-40f3-9c9d-91c16b617b62 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:17.142993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 796/1586] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:17.142993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a7546-5b8d-49f3-976c-b957764379f7 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:17.143236 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d69a1c-8c3d-40f3-9c9d-91c16b617b62 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:17.146657 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c05245-6721-47dc-befa-9371d77727de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:17.147252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c05245-6721-47dc-befa-9371d77727de admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:17.147523 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c05245-6721-47dc-befa-9371d77727de admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:17.147790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c05245-6721-47dc-befa-9371d77727de admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:17.148422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c05245-6721-47dc-befa-9371d77727de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:17.150110 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c05245-6721-47dc-befa-9371d77727de admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:17.165305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 791/1587] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:17.165305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c05245-6721-47dc-befa-9371d77727de admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:17.175432 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c05245-6721-47dc-befa-9371d77727de admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:17.180243 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02533654-76a5-4c5d-a264-d5d764448eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:17.180818 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02533654-76a5-4c5d-a264-d5d764448eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:17.181114 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02533654-76a5-4c5d-a264-d5d764448eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:17.181403 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02533654-76a5-4c5d-a264-d5d764448eb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:17.182015 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02533654-76a5-4c5d-a264-d5d764448eb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:17.183928 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02533654-76a5-4c5d-a264-d5d764448eb4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:17.197933 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a7546-5b8d-49f3-976c-b957764379f7 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:17.202662 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c868f7b-957e-4110-9109-e98ac342c82f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:17.203258 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c868f7b-957e-4110-9109-e98ac342c82f service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:17.203643 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c868f7b-957e-4110-9109-e98ac342c82f service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:17.204215 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c868f7b-957e-4110-9109-e98ac342c82f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:17.209313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 792/1588] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:12:17 2022] POST /identity/v3/users => generated 287 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:17.209313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02533654-76a5-4c5d-a264-d5d764448eb4 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:17.214323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c868f7b-957e-4110-9109-e98ac342c82f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:17.215763 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c868f7b-957e-4110-9109-e98ac342c82f service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:17.216831 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02533654-76a5-4c5d-a264-d5d764448eb4 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:17.222032 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93ba38-513a-4e9d-8d6e-b935804f19cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:17.222694 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93ba38-513a-4e9d-8d6e-b935804f19cb admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:17.223040 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93ba38-513a-4e9d-8d6e-b935804f19cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:17.223171 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93ba38-513a-4e9d-8d6e-b935804f19cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:17.223834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93ba38-513a-4e9d-8d6e-b935804f19cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:17.225804 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93ba38-513a-4e9d-8d6e-b935804f19cb admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:17.226106 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 797/1589] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:17.226911 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c868f7b-957e-4110-9109-e98ac342c82f service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:17.236638 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c868f7b-957e-4110-9109-e98ac342c82f service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:17.240439 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 793/1590] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:17.240439 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93ba38-513a-4e9d-8d6e-b935804f19cb admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:17.244691 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faab389-d44d-45b2-83a1-cb0da542389d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:17.245333 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faab389-d44d-45b2-83a1-cb0da542389d admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:17.245631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faab389-d44d-45b2-83a1-cb0da542389d admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:17.245902 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faab389-d44d-45b2-83a1-cb0da542389d admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:17.246550 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faab389-d44d-45b2-83a1-cb0da542389d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:17.249232 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faab389-d44d-45b2-83a1-cb0da542389d admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:17.250598 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93ba38-513a-4e9d-8d6e-b935804f19cb admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:17.255998 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833cd0b-ea2b-4aaf-a795-15cbed7e02e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:17.256664 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833cd0b-ea2b-4aaf-a795-15cbed7e02e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:17.257004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833cd0b-ea2b-4aaf-a795-15cbed7e02e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:17.257244 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833cd0b-ea2b-4aaf-a795-15cbed7e02e8 admin admin] PATH_INFO: `/v3/projects/335a1a885bfb4f5695e5b0e47777856f/users/c8289ecbf04143b1a136f876b1467c67/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:17.261877 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 798/1591] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:17.262924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faab389-d44d-45b2-83a1-cb0da542389d admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:17.272955 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faab389-d44d-45b2-83a1-cb0da542389d admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:17.278184 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee7959-ac40-49ab-9385-9fbd603921c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:17.278578 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833cd0b-ea2b-4aaf-a795-15cbed7e02e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=335a1a885bfb4f5695e5b0e47777856f, user_id=c8289ecbf04143b1a136f876b1467c67, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:17.278793 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee7959-ac40-49ab-9385-9fbd603921c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:17.279095 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee7959-ac40-49ab-9385-9fbd603921c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:17.279625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee7959-ac40-49ab-9385-9fbd603921c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:17.280268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee7959-ac40-49ab-9385-9fbd603921c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:17.281718 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833cd0b-ea2b-4aaf-a795-15cbed7e02e8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:17.281890 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee7959-ac40-49ab-9385-9fbd603921c9 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:17.293462 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 799/1592] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:17.297598 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee7959-ac40-49ab-9385-9fbd603921c9 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:17.298026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 794/1593] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:12:17 2022] PUT /identity/v3/projects/335a1a885bfb4f5695e5b0e47777856f/users/c8289ecbf04143b1a136f876b1467c67/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:17.301768 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833cd0b-ea2b-4aaf-a795-15cbed7e02e8 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:17.312632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee7959-ac40-49ab-9385-9fbd603921c9 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:17.376724 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833cd0b-ea2b-4aaf-a795-15cbed7e02e8 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:17.381657 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc8acc-f18d-43eb-aa3f-557a9e0f59a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:17.382328 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc8acc-f18d-43eb-aa3f-557a9e0f59a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:17.382611 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc8acc-f18d-43eb-aa3f-557a9e0f59a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:17.382885 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc8acc-f18d-43eb-aa3f-557a9e0f59a6 admin admin] PATH_INFO: `/v3/projects/a23107977116428c99ac940373c1a3f2/users/d80c0ee007b24a22b08e91ef863d330b/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:17.383896 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ce362-03ce-464f-8f16-8a5b7ed15bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:17.384513 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ce362-03ce-464f-8f16-8a5b7ed15bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:17.384794 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ce362-03ce-464f-8f16-8a5b7ed15bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:17.385637 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ce362-03ce-464f-8f16-8a5b7ed15bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:17.385986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ce362-03ce-464f-8f16-8a5b7ed15bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:17.387833 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ce362-03ce-464f-8f16-8a5b7ed15bc3 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:17.393142 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:17.400795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc8acc-f18d-43eb-aa3f-557a9e0f59a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23107977116428c99ac940373c1a3f2, user_id=d80c0ee007b24a22b08e91ef863d330b, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:17.407103 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc8acc-f18d-43eb-aa3f-557a9e0f59a6 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:17.407404 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 800/1594] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:17.407404 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ce362-03ce-464f-8f16-8a5b7ed15bc3 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:17.417607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ce362-03ce-464f-8f16-8a5b7ed15bc3 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:17.423773 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 795/1595] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:12:17 2022] PUT /identity/v3/projects/a23107977116428c99ac940373c1a3f2/users/d80c0ee007b24a22b08e91ef863d330b/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:17.424896 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc8acc-f18d-43eb-aa3f-557a9e0f59a6 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:17.449652 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:17.494540 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c1a61-a3bc-4e8e-8e34-a916c0bf4cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:17.495296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c1a61-a3bc-4e8e-8e34-a916c0bf4cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:17.495680 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c1a61-a3bc-4e8e-8e34-a916c0bf4cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:17.495965 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c1a61-a3bc-4e8e-8e34-a916c0bf4cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:17.496660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c1a61-a3bc-4e8e-8e34-a916c0bf4cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:17.498417 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c1a61-a3bc-4e8e-8e34-a916c0bf4cc7 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:17.500267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc8acc-f18d-43eb-aa3f-557a9e0f59a6 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:17.506460 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48371d-52b3-44c0-9fc3-ab59b9f83f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:17.507341 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48371d-52b3-44c0-9fc3-ab59b9f83f67 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:17.507341 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48371d-52b3-44c0-9fc3-ab59b9f83f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:17.507624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48371d-52b3-44c0-9fc3-ab59b9f83f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:17.508258 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48371d-52b3-44c0-9fc3-ab59b9f83f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:17.512267 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 801/1596] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:17.512425 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48371d-52b3-44c0-9fc3-ab59b9f83f67 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:17.512518 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c1a61-a3bc-4e8e-8e34-a916c0bf4cc7 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:17.522983 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 796/1597] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:17.523894 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48371d-52b3-44c0-9fc3-ab59b9f83f67 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:17.524826 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c1a61-a3bc-4e8e-8e34-a916c0bf4cc7 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:17.531300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384db26-b6ff-4d01-9125-82212bbedc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:17.531491 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384db26-b6ff-4d01-9125-82212bbedc60 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:17.531751 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384db26-b6ff-4d01-9125-82212bbedc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:17.532053 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384db26-b6ff-4d01-9125-82212bbedc60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:17.532704 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384db26-b6ff-4d01-9125-82212bbedc60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:17.534354 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384db26-b6ff-4d01-9125-82212bbedc60 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:17.534933 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48371d-52b3-44c0-9fc3-ab59b9f83f67 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:17.539840 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f94e1-502d-495b-903a-781b4ab5e65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:17.540549 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f94e1-502d-495b-903a-781b4ab5e65d admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:17.540831 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f94e1-502d-495b-903a-781b4ab5e65d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:17.541135 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f94e1-502d-495b-903a-781b4ab5e65d admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:17.541756 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f94e1-502d-495b-903a-781b4ab5e65d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:17.543599 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f94e1-502d-495b-903a-781b4ab5e65d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:17.546127 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 802/1598] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:17.547256 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48871643-fe89-4f1b-b9c8-65eb471935d9 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:17.547543 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48871643-fe89-4f1b-b9c8-65eb471935d9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:17.547814 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48871643-fe89-4f1b-b9c8-65eb471935d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:17.563651 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 797/1599] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:17.563651 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f94e1-502d-495b-903a-781b4ab5e65d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:17.566890 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-48871643-fe89-4f1b-b9c8-65eb471935d9 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:17.568100 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-48871643-fe89-4f1b-b9c8-65eb471935d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:17.574893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f94e1-502d-495b-903a-781b4ab5e65d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:17.578002 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 803/1600] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:17.579937 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a50c7-33df-4e38-b9ac-01c33cc05e39 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:17.580141 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d8699-bb07-419e-aa35-c690989b7277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:17.580730 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a50c7-33df-4e38-b9ac-01c33cc05e39 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:17.580851 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d8699-bb07-419e-aa35-c690989b7277 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:17.581316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d8699-bb07-419e-aa35-c690989b7277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:17.581575 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a50c7-33df-4e38-b9ac-01c33cc05e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:17.581690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d8699-bb07-419e-aa35-c690989b7277 admin admin] PATH_INFO: `/v3/projects/c42be1c1bc2e4183ae0610a27c182d13/users/23474da654d34937b6c421c9d225a272/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:17.611367 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d8699-bb07-419e-aa35-c690989b7277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42be1c1bc2e4183ae0610a27c182d13, user_id=23474da654d34937b6c421c9d225a272, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:17.614637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d8699-bb07-419e-aa35-c690989b7277 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:17.618060 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-884a50c7-33df-4e38-b9ac-01c33cc05e39 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:17.618955 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-884a50c7-33df-4e38-b9ac-01c33cc05e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:17.641076 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 798/1601] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:12:17 2022] PUT /identity/v3/projects/c42be1c1bc2e4183ae0610a27c182d13/users/23474da654d34937b6c421c9d225a272/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:17.641422 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 804/1602] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:17.641422 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a50c7-33df-4e38-b9ac-01c33cc05e39 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:17.641638 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d8699-bb07-419e-aa35-c690989b7277 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:17.651562 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a50c7-33df-4e38-b9ac-01c33cc05e39 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:17.722195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d8699-bb07-419e-aa35-c690989b7277 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:17.727412 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5cd55-3c07-4d10-9cd9-8a8674336cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:17.728028 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5cd55-3c07-4d10-9cd9-8a8674336cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:17.728306 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5cd55-3c07-4d10-9cd9-8a8674336cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:17.728577 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5cd55-3c07-4d10-9cd9-8a8674336cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:17.729266 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5cd55-3c07-4d10-9cd9-8a8674336cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:17.729896 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b9b5a-e29a-4d31-8a36-66599baca2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:17.730637 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b9b5a-e29a-4d31-8a36-66599baca2c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:17.731135 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5cd55-3c07-4d10-9cd9-8a8674336cd1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:17.731251 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b9b5a-e29a-4d31-8a36-66599baca2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:17.731363 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b9b5a-e29a-4d31-8a36-66599baca2c0 admin admin] PATH_INFO: `/v3/projects/ae18c370a859435a8d0356dff8a8fe5a/users/4978ac21fb0140e5af2c17b16e131c3a/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:17.745022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 799/1603] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:17.745022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5cd55-3c07-4d10-9cd9-8a8674336cd1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:17.748655 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b9b5a-e29a-4d31-8a36-66599baca2c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae18c370a859435a8d0356dff8a8fe5a, user_id=4978ac21fb0140e5af2c17b16e131c3a, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:17.751784 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b9b5a-e29a-4d31-8a36-66599baca2c0 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:17.756565 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5cd55-3c07-4d10-9cd9-8a8674336cd1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:17.762487 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f00f00-460b-49f2-bc4e-1ebf7f8eddf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:17.763154 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f00f00-460b-49f2-bc4e-1ebf7f8eddf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:17.763489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f00f00-460b-49f2-bc4e-1ebf7f8eddf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:17.763767 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f00f00-460b-49f2-bc4e-1ebf7f8eddf6 admin admin] PATH_INFO: `/v3/projects/f86e4ed6a55148d29b303b6dc146392a/users/8dd5ec91cd29468f97cb3045c12b819f/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:17.779920 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 805/1604] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:12:17 2022] PUT /identity/v3/projects/ae18c370a859435a8d0356dff8a8fe5a/users/4978ac21fb0140e5af2c17b16e131c3a/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:17.779920 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b9b5a-e29a-4d31-8a36-66599baca2c0 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:17.789142 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f00f00-460b-49f2-bc4e-1ebf7f8eddf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f86e4ed6a55148d29b303b6dc146392a, user_id=8dd5ec91cd29468f97cb3045c12b819f, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:17.792296 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f00f00-460b-49f2-bc4e-1ebf7f8eddf6 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:17.813178 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 800/1605] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:12:17 2022] PUT /identity/v3/projects/f86e4ed6a55148d29b303b6dc146392a/users/8dd5ec91cd29468f97cb3045c12b819f/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:17.814928 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f00f00-460b-49f2-bc4e-1ebf7f8eddf6 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:17.817406 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d5f00f00-460b-49f2-bc4e-1ebf7f8eddf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:17.843585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:17.851710 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b9b5a-e29a-4d31-8a36-66599baca2c0 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:17.887552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f00f00-460b-49f2-bc4e-1ebf7f8eddf6 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:17.889395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:17.892366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915d598-63d3-4552-8465-bf6ae645b1cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:17.893177 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915d598-63d3-4552-8465-bf6ae645b1cd service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:17.893528 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915d598-63d3-4552-8465-bf6ae645b1cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:17.893866 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915d598-63d3-4552-8465-bf6ae645b1cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:17.925001 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9603b-908a-4f52-b60a-0a59f99b4090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:17.925807 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9603b-908a-4f52-b60a-0a59f99b4090 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:17.926151 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9603b-908a-4f52-b60a-0a59f99b4090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:17.926497 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9603b-908a-4f52-b60a-0a59f99b4090 admin admin] PATH_INFO: `/v3/projects/7ec015d031f24a1288a86983bf7385b4/users/056b84d288cd4bf1aaeb7152acbb6c3a/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:17.946011 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9603b-908a-4f52-b60a-0a59f99b4090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec015d031f24a1288a86983bf7385b4, user_id=056b84d288cd4bf1aaeb7152acbb6c3a, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:17.949243 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9603b-908a-4f52-b60a-0a59f99b4090 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:17.971226 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 806/1606] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:12:17 2022] PUT /identity/v3/projects/7ec015d031f24a1288a86983bf7385b4/users/056b84d288cd4bf1aaeb7152acbb6c3a/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:17.972473 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9603b-908a-4f52-b60a-0a59f99b4090 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:17.991308 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915d598-63d3-4552-8465-bf6ae645b1cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:17.994066 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915d598-63d3-4552-8465-bf6ae645b1cd service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:18.005063 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 801/1607] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:18.006397 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de18d7-7643-42e8-8557-1f4aed9f9c3c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:18.006683 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de18d7-7643-42e8-8557-1f4aed9f9c3c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:18.006958 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de18d7-7643-42e8-8557-1f4aed9f9c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:18.058926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a0de18d7-7643-42e8-8557-1f4aed9f9c3c None None] MFA Rules not processed for user `23474da654d34937b6c421c9d225a272`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:18.060220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a0de18d7-7643-42e8-8557-1f4aed9f9c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:18.064496 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9603b-908a-4f52-b60a-0a59f99b4090 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:18.080295 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1dbdb-41a0-4e1a-b491-711b27cf9cad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:18.081037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1dbdb-41a0-4e1a-b491-711b27cf9cad service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:18.081434 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1dbdb-41a0-4e1a-b491-711b27cf9cad service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:18.081781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1dbdb-41a0-4e1a-b491-711b27cf9cad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:18.169313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 802/1608] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:18.171909 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de18d7-7643-42e8-8557-1f4aed9f9c3c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:18.210090 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1dbdb-41a0-4e1a-b491-711b27cf9cad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:18.214908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1dbdb-41a0-4e1a-b491-711b27cf9cad service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:18.230375 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 807/1609] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:18.232521 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80831c8-46d7-45a9-9580-279758537d11 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:18.233477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80831c8-46d7-45a9-9580-279758537d11 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:18.233477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80831c8-46d7-45a9-9580-279758537d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:18.269204 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-a80831c8-46d7-45a9-9580-279758537d11 None None] MFA Rules not processed for user `4978ac21fb0140e5af2c17b16e131c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:18.270605 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a80831c8-46d7-45a9-9580-279758537d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:18.277424 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de18d7-7643-42e8-8557-1f4aed9f9c3c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:18.285697 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5613c-4a87-4277-9b68-f66f62fcb483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:18.285697 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5613c-4a87-4277-9b68-f66f62fcb483 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:18.286286 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5613c-4a87-4277-9b68-f66f62fcb483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:18.286632 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5613c-4a87-4277-9b68-f66f62fcb483 admin admin] PATH_INFO: `/v3/projects/3c9fd6b09b354cc3953394b716fdb253/users/fb7966481c974ee78cd131d5a14f99a5/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:18.290429 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:18.306117 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5613c-4a87-4277-9b68-f66f62fcb483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c9fd6b09b354cc3953394b716fdb253, user_id=fb7966481c974ee78cd131d5a14f99a5, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:18.309382 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5613c-4a87-4277-9b68-f66f62fcb483 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:18.339531 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 803/1610] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:12:18 2022] PUT /identity/v3/projects/3c9fd6b09b354cc3953394b716fdb253/users/fb7966481c974ee78cd131d5a14f99a5/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:18.340945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02900674-a7b9-4bbb-93da-2249706e7db0 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:18.341259 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02900674-a7b9-4bbb-93da-2249706e7db0 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:18.342117 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02900674-a7b9-4bbb-93da-2249706e7db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:18.360944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:18.371241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-02900674-a7b9-4bbb-93da-2249706e7db0 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:18.372177 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-02900674-a7b9-4bbb-93da-2249706e7db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:18.380413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 808/1611] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:18.382119 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b0b81-16e0-484a-9ad4-7319512263c0 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:18.382614 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b0b81-16e0-484a-9ad4-7319512263c0 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:18.383106 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b0b81-16e0-484a-9ad4-7319512263c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:18.420025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-9e5b0b81-16e0-484a-9ad4-7319512263c0 None None] MFA Rules not processed for user `056b84d288cd4bf1aaeb7152acbb6c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:18.421752 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-9e5b0b81-16e0-484a-9ad4-7319512263c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:18.446921 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 804/1612] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:18.449619 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417889ed-6923-4158-8902-142def0e5e0f None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:18.449942 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417889ed-6923-4158-8902-142def0e5e0f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:18.450172 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417889ed-6923-4158-8902-142def0e5e0f None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:18.461347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 805/1613] 10.222.0.26 () {54 vars in 962 bytes} [Tue Sep 13 14:12:18 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:12:18.462689 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84f6ff-0285-4939-97fa-4f63ca776482 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:18.462969 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84f6ff-0285-4939-97fa-4f63ca776482 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:18.463236 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84f6ff-0285-4939-97fa-4f63ca776482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:18.502333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-cf84f6ff-0285-4939-97fa-4f63ca776482 None None] MFA Rules not processed for user `fb7966481c974ee78cd131d5a14f99a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:18.503050 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cf84f6ff-0285-4939-97fa-4f63ca776482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:18.543367 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 809/1614] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:18.545606 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b0b81-16e0-484a-9ad4-7319512263c0 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:18.609184 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 806/1615] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:18.610300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde869b5-4565-4fa8-a7dc-b864370690a9 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:18.610702 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde869b5-4565-4fa8-a7dc-b864370690a9 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:18.611046 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde869b5-4565-4fa8-a7dc-b864370690a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:18.632033 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b0b81-16e0-484a-9ad4-7319512263c0 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:18.651050 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70daa300-294e-471f-9a0d-609d97b0d0a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:18.651683 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daa300-294e-471f-9a0d-609d97b0d0a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:18.651961 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daa300-294e-471f-9a0d-609d97b0d0a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:18.652230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daa300-294e-471f-9a0d-609d97b0d0a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:18.673206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-dde869b5-4565-4fa8-a7dc-b864370690a9 None None] MFA Rules not processed for user `1b3533d0a24e4e7bbf5c7137d3511b13`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:18.674672 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-dde869b5-4565-4fa8-a7dc-b864370690a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:18.743808 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:18.756893 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70daa300-294e-471f-9a0d-609d97b0d0a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:18.759519 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70daa300-294e-471f-9a0d-609d97b0d0a1 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:18.770264 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 807/1616] 10.222.0.26 () {58 vars in 1059 bytes} [Tue Sep 13 14:12:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:18.772444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 810/1617] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:18.772593 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde869b5-4565-4fa8-a7dc-b864370690a9 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:18.774006 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d449bb-3d62-48b6-b140-b5545f05bef4 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:18.774584 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d449bb-3d62-48b6-b140-b5545f05bef4 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:18.774869 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d449bb-3d62-48b6-b140-b5545f05bef4 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:18.776416 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 811/1618] 10.222.0.26 () {54 vars in 962 bytes} [Tue Sep 13 14:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:12:18.777502 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d449bb-3d62-48b6-b140-b5545f05bef4 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:18.797787 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d449bb-3d62-48b6-b140-b5545f05bef4 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:18.807779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef53e70-7085-48f1-8691-fa7a64d742ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:18.808632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef53e70-7085-48f1-8691-fa7a64d742ec service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:18.809606 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef53e70-7085-48f1-8691-fa7a64d742ec service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:18.809989 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef53e70-7085-48f1-8691-fa7a64d742ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:18.864525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde869b5-4565-4fa8-a7dc-b864370690a9 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:18.869286 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a214f-5d12-4af2-b5af-34ece5719077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:18.870479 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a214f-5d12-4af2-b5af-34ece5719077 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:18.870772 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a214f-5d12-4af2-b5af-34ece5719077 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:18.871042 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a214f-5d12-4af2-b5af-34ece5719077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:18.883661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a214f-5d12-4af2-b5af-34ece5719077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:18.885510 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a214f-5d12-4af2-b5af-34ece5719077 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:18.892651 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:18.901695 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 808/1619] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:18.904019 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fc1ba-efb9-4f36-926b-ad634fd0dfc5 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:18.904581 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fc1ba-efb9-4f36-926b-ad634fd0dfc5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:18.904858 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fc1ba-efb9-4f36-926b-ad634fd0dfc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:18.942533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef53e70-7085-48f1-8691-fa7a64d742ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:18.944668 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef53e70-7085-48f1-8691-fa7a64d742ec service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:18.945864 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-091fc1ba-efb9-4f36-926b-ad634fd0dfc5 None None] MFA Rules not processed for user `1b3533d0a24e4e7bbf5c7137d3511b13`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:18.947305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-091fc1ba-efb9-4f36-926b-ad634fd0dfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:18.970171 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 809/1620] 10.222.0.26 () {58 vars in 1059 bytes} [Tue Sep 13 14:12:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:18.981112 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091fc1ba-efb9-4f36-926b-ad634fd0dfc5 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:18.981293 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 812/1621] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 14:12:18.998874 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091fc1ba-efb9-4f36-926b-ad634fd0dfc5 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:19.015913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0af86-be79-4926-b65c-7d301a99fb55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:19.018594 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0af86-be79-4926-b65c-7d301a99fb55 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:19.019033 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0af86-be79-4926-b65c-7d301a99fb55 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:19.019311 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0af86-be79-4926-b65c-7d301a99fb55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:19.035981 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0af86-be79-4926-b65c-7d301a99fb55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:19.037800 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0af86-be79-4926-b65c-7d301a99fb55 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:19.058531 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 810/1622] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:19.424813 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90514a70-bdac-4de5-98e0-6b2a559cefd6 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:19.425059 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90514a70-bdac-4de5-98e0-6b2a559cefd6 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:19.425478 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90514a70-bdac-4de5-98e0-6b2a559cefd6 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:19.426740 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 813/1623] 10.222.0.26 () {54 vars in 912 bytes} [Tue Sep 13 14:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:12:19.431593 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75741a-28d7-4983-b394-3f61a560be0b None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:19.432008 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75741a-28d7-4983-b394-3f61a560be0b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:19.432370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75741a-28d7-4983-b394-3f61a560be0b None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:19.434180 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 811/1624] 10.222.0.26 () {54 vars in 912 bytes} [Tue Sep 13 14:12:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:12:19.438188 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb623e-b74c-4758-b70c-5c4aba376d2d None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:19.438712 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb623e-b74c-4758-b70c-5c4aba376d2d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:19.439253 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb623e-b74c-4758-b70c-5c4aba376d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:19.446137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce7280-3063-46fe-b3e7-0f563456a74e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:19.446840 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce7280-3063-46fe-b3e7-0f563456a74e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:19.446964 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce7280-3063-46fe-b3e7-0f563456a74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:19.477864 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-12ce7280-3063-46fe-b3e7-0f563456a74e None None] MFA Rules not processed for user `1b3533d0a24e4e7bbf5c7137d3511b13`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:19.478524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-9edb623e-b74c-4758-b70c-5c4aba376d2d None None] MFA Rules not processed for user `1b3533d0a24e4e7bbf5c7137d3511b13`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:19.479638 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-12ce7280-3063-46fe-b3e7-0f563456a74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:19.480354 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-9edb623e-b74c-4758-b70c-5c4aba376d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:19.494793 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 812/1625] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 13 14:12:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:12:19.505248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 814/1626] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 13 14:12:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:12:19.516149 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ce7280-3063-46fe-b3e7-0f563456a74e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:19.528484 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ce7280-3063-46fe-b3e7-0f563456a74e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:19.533702 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757576b7-8155-4651-bdc8-edf11ff993ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:19.534370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757576b7-8155-4651-bdc8-edf11ff993ba service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:19.534893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757576b7-8155-4651-bdc8-edf11ff993ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:19.535253 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757576b7-8155-4651-bdc8-edf11ff993ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:19.555204 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757576b7-8155-4651-bdc8-edf11ff993ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:19.557507 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757576b7-8155-4651-bdc8-edf11ff993ba service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:19.571483 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 813/1627] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:19.674049 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb623e-b74c-4758-b70c-5c4aba376d2d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:19.692735 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb623e-b74c-4758-b70c-5c4aba376d2d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:19.698237 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed5f46-602e-42dd-a3b5-d1eeb148d800 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:19.699304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed5f46-602e-42dd-a3b5-d1eeb148d800 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:19.699814 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed5f46-602e-42dd-a3b5-d1eeb148d800 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:19.700309 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed5f46-602e-42dd-a3b5-d1eeb148d800 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:19.713736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed5f46-602e-42dd-a3b5-d1eeb148d800 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:19.715784 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed5f46-602e-42dd-a3b5-d1eeb148d800 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:19.732867 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 815/1628] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:20.674474 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757576b7-8155-4651-bdc8-edf11ff993ba service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:20.692851 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757576b7-8155-4651-bdc8-edf11ff993ba service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:20.707142 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac9a57-e334-402c-8013-0cb2d065240e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:20.708275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac9a57-e334-402c-8013-0cb2d065240e service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:20.708275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac9a57-e334-402c-8013-0cb2d065240e service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:20.708275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac9a57-e334-402c-8013-0cb2d065240e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:20.738305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac9a57-e334-402c-8013-0cb2d065240e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:20.740264 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac9a57-e334-402c-8013-0cb2d065240e service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:20.750730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 814/1629] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:21.085446 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed5f46-602e-42dd-a3b5-d1eeb148d800 service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:21.103356 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed5f46-602e-42dd-a3b5-d1eeb148d800 service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:21.112488 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642130f8-cb7e-454b-b242-5172bd8fcf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:21.113421 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642130f8-cb7e-454b-b242-5172bd8fcf10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:21.113803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642130f8-cb7e-454b-b242-5172bd8fcf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:21.114223 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642130f8-cb7e-454b-b242-5172bd8fcf10 admin admin] PATH_INFO: `/v3/users/fb7966481c974ee78cd131d5a14f99a5` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:21.117679 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642130f8-cb7e-454b-b242-5172bd8fcf10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb7966481c974ee78cd131d5a14f99a5)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:21.120608 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642130f8-cb7e-454b-b242-5172bd8fcf10 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:21.191886 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-642130f8-cb7e-454b-b242-5172bd8fcf10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb7966481c974ee78cd131d5a14f99a5'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:21.218076 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-642130f8-cb7e-454b-b242-5172bd8fcf10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb7966481c974ee78cd131d5a14f99a5'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:21.244954 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-642130f8-cb7e-454b-b242-5172bd8fcf10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb7966481c974ee78cd131d5a14f99a5'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:21.247067 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-642130f8-cb7e-454b-b242-5172bd8fcf10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb7966481c974ee78cd131d5a14f99a5'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:21.332804 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-642130f8-cb7e-454b-b242-5172bd8fcf10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb7966481c974ee78cd131d5a14f99a5'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:21.385115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235b869-61a8-4b46-9f7b-a4584743fb85 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:21.385805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235b869-61a8-4b46-9f7b-a4584743fb85 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:21.386237 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235b869-61a8-4b46-9f7b-a4584743fb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:21.387896 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 816/1630] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:12:21 2022] DELETE /identity/v3/users/fb7966481c974ee78cd131d5a14f99a5 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:21.431299 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-0235b869-61a8-4b46-9f7b-a4584743fb85 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:21.434917 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0235b869-61a8-4b46-9f7b-a4584743fb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:21.596135 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 815/1631] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:21.677420 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642130f8-cb7e-454b-b242-5172bd8fcf10 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:21.677420 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-642130f8-cb7e-454b-b242-5172bd8fcf10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:21.851685 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642130f8-cb7e-454b-b242-5172bd8fcf10 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:21.856108 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4e890-8534-4985-a184-064f82f00a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:21.856836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4e890-8534-4985-a184-064f82f00a20 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:21.857764 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4e890-8534-4985-a184-064f82f00a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:21.858140 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4e890-8534-4985-a184-064f82f00a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:21.887587 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4e890-8534-4985-a184-064f82f00a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:21.889840 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4e890-8534-4985-a184-064f82f00a20 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:21.907983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 817/1632] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:23.505067 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235b869-61a8-4b46-9f7b-a4584743fb85 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:23.507165 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0235b869-61a8-4b46-9f7b-a4584743fb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:23.520860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235b869-61a8-4b46-9f7b-a4584743fb85 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:23.526964 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c38924-73e3-4d59-b20f-e19f199ed74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:23.527883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c38924-73e3-4d59-b20f-e19f199ed74d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:23.528611 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c38924-73e3-4d59-b20f-e19f199ed74d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:23.529916 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c38924-73e3-4d59-b20f-e19f199ed74d admin admin] PATH_INFO: `/v3/projects/3c9fd6b09b354cc3953394b716fdb253` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:23.531453 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c38924-73e3-4d59-b20f-e19f199ed74d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c9fd6b09b354cc3953394b716fdb253)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:23.533888 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c38924-73e3-4d59-b20f-e19f199ed74d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:23.594038 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:23.617890 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f0c38924-73e3-4d59-b20f-e19f199ed74d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c9fd6b09b354cc3953394b716fdb253', 'request_id': 'req-f0c38924-73e3-4d59-b20f-e19f199ed74d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:23.635134 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f0c38924-73e3-4d59-b20f-e19f199ed74d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c9fd6b09b354cc3953394b716fdb253', 'request_id': 'req-f0c38924-73e3-4d59-b20f-e19f199ed74d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:23.672650 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f0c38924-73e3-4d59-b20f-e19f199ed74d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c9fd6b09b354cc3953394b716fdb253', 'request_id': 'req-f0c38924-73e3-4d59-b20f-e19f199ed74d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:23.714105 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f0c38924-73e3-4d59-b20f-e19f199ed74d admin admin] The token cache is being invalidate because project 3c9fd6b09b354cc3953394b716fdb253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:12:23.714652 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f0c38924-73e3-4d59-b20f-e19f199ed74d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:23.716136 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f0c38924-73e3-4d59-b20f-e19f199ed74d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:23.724967 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 816/1633] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:12:23 2022] DELETE /identity/v3/projects/3c9fd6b09b354cc3953394b716fdb253 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:23.726415 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19636d-52e3-41f5-9a99-6e4dafa91f9b None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:23.727718 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19636d-52e3-41f5-9a99-6e4dafa91f9b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:23.728131 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19636d-52e3-41f5-9a99-6e4dafa91f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:23.757547 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-8d19636d-52e3-41f5-9a99-6e4dafa91f9b None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:23.763778 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8d19636d-52e3-41f5-9a99-6e4dafa91f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:23.817272 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:23.905290 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 818/1634] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:12:23.905821 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834a26c-e1ea-46eb-94ee-b93f60ae3db8 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:23.906177 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834a26c-e1ea-46eb-94ee-b93f60ae3db8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:23.906542 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834a26c-e1ea-46eb-94ee-b93f60ae3db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:23.997641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19636d-52e3-41f5-9a99-6e4dafa91f9b None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:23.998430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d834a26c-e1ea-46eb-94ee-b93f60ae3db8 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:23.999012 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8d19636d-52e3-41f5-9a99-6e4dafa91f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:24.000045 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d834a26c-e1ea-46eb-94ee-b93f60ae3db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:24.025208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 817/1635] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:24.026316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834a26c-e1ea-46eb-94ee-b93f60ae3db8 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:24.032481 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19636d-52e3-41f5-9a99-6e4dafa91f9b None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:24.042664 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834a26c-e1ea-46eb-94ee-b93f60ae3db8 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:24.055410 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f697dfd-9066-4280-a4df-ace0152a921a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:24.056024 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f697dfd-9066-4280-a4df-ace0152a921a admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:24.056312 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f697dfd-9066-4280-a4df-ace0152a921a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:24.056575 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f697dfd-9066-4280-a4df-ace0152a921a admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:24.057330 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f697dfd-9066-4280-a4df-ace0152a921a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:12:24.057635 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f697dfd-9066-4280-a4df-ace0152a921a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:24.059116 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f818aab-8793-47f4-9b5f-a32415472802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:24.059274 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f697dfd-9066-4280-a4df-ace0152a921a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:24.060181 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f818aab-8793-47f4-9b5f-a32415472802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:24.060871 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f818aab-8793-47f4-9b5f-a32415472802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:24.061329 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f818aab-8793-47f4-9b5f-a32415472802 admin admin] PATH_INFO: `/v3/users/056b84d288cd4bf1aaeb7152acbb6c3a` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:24.063735 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f818aab-8793-47f4-9b5f-a32415472802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=056b84d288cd4bf1aaeb7152acbb6c3a)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:24.071663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f818aab-8793-47f4-9b5f-a32415472802 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:24.108641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 818/1636] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:12:24.112130 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f697dfd-9066-4280-a4df-ace0152a921a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:24.147293 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f697dfd-9066-4280-a4df-ace0152a921a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:24.168894 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144ec74-bfa0-4dfc-b6db-89c0ddf17c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:24.170245 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144ec74-bfa0-4dfc-b6db-89c0ddf17c74 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:24.170629 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144ec74-bfa0-4dfc-b6db-89c0ddf17c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:24.170912 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144ec74-bfa0-4dfc-b6db-89c0ddf17c74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:24.173200 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144ec74-bfa0-4dfc-b6db-89c0ddf17c74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:24.179345 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144ec74-bfa0-4dfc-b6db-89c0ddf17c74 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:24.239444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6f818aab-8793-47f4-9b5f-a32415472802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '056b84d288cd4bf1aaeb7152acbb6c3a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:24.280971 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 819/1637] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:12:24 2022] POST /identity/v3/projects => generated 367 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:24.283677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144ec74-bfa0-4dfc-b6db-89c0ddf17c74 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:24.296729 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6f818aab-8793-47f4-9b5f-a32415472802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '056b84d288cd4bf1aaeb7152acbb6c3a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:24.385357 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6f818aab-8793-47f4-9b5f-a32415472802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '056b84d288cd4bf1aaeb7152acbb6c3a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:24.386629 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6f818aab-8793-47f4-9b5f-a32415472802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '056b84d288cd4bf1aaeb7152acbb6c3a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:24.424664 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6f818aab-8793-47f4-9b5f-a32415472802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '056b84d288cd4bf1aaeb7152acbb6c3a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:24.450638 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 819/1638] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:12:23 2022] DELETE /identity/v3/users/056b84d288cd4bf1aaeb7152acbb6c3a => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:24.457608 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51617348-eb16-41ac-b5b5-e76beaa70bf1 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:24.457890 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51617348-eb16-41ac-b5b5-e76beaa70bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:24.464718 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51617348-eb16-41ac-b5b5-e76beaa70bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:24.540617 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-51617348-eb16-41ac-b5b5-e76beaa70bf1 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:24.554674 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-51617348-eb16-41ac-b5b5-e76beaa70bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:24.648504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144ec74-bfa0-4dfc-b6db-89c0ddf17c74 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:24.799859 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 820/1639] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:24.824373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51617348-eb16-41ac-b5b5-e76beaa70bf1 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:24.826386 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-51617348-eb16-41ac-b5b5-e76beaa70bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:24.865382 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae5d5c-314e-4f5d-a4f3-27fb89563c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:24.865917 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae5d5c-314e-4f5d-a4f3-27fb89563c4d admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:24.866199 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae5d5c-314e-4f5d-a4f3-27fb89563c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:24.866475 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae5d5c-314e-4f5d-a4f3-27fb89563c4d admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:24.867125 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae5d5c-314e-4f5d-a4f3-27fb89563c4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:24.869082 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae5d5c-314e-4f5d-a4f3-27fb89563c4d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:24.928353 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 820/1640] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:12:24 2022] POST /identity/v3/users => generated 284 bytes in 646 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:24.933659 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae5d5c-314e-4f5d-a4f3-27fb89563c4d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:24.940859 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c6ae5d5c-314e-4f5d-a4f3-27fb89563c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:24.941458 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:24.970527 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51617348-eb16-41ac-b5b5-e76beaa70bf1 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:24.976362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae5d5c-314e-4f5d-a4f3-27fb89563c4d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:24.979398 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2696de-dd29-46f3-bf24-937ae9878b42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:24.980042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2696de-dd29-46f3-bf24-937ae9878b42 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:24.980311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2696de-dd29-46f3-bf24-937ae9878b42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:24.980584 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2696de-dd29-46f3-bf24-937ae9878b42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:24.992170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ece40c-0d55-4890-9f05-ba15c9e8809a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:24.993372 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ece40c-0d55-4890-9f05-ba15c9e8809a admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:24.993852 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ece40c-0d55-4890-9f05-ba15c9e8809a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:24.994337 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ece40c-0d55-4890-9f05-ba15c9e8809a admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:24.995188 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ece40c-0d55-4890-9f05-ba15c9e8809a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:24.998309 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ece40c-0d55-4890-9f05-ba15c9e8809a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:25.007521 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2696de-dd29-46f3-bf24-937ae9878b42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:25.009032 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2696de-dd29-46f3-bf24-937ae9878b42 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:25.023802 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 821/1641] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:25.027583 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ece40c-0d55-4890-9f05-ba15c9e8809a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:25.041488 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 821/1642] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:25.061875 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ece40c-0d55-4890-9f05-ba15c9e8809a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:25.067176 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebeb3d2-dd79-4b41-8d6a-81a3e4e20d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:25.067959 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebeb3d2-dd79-4b41-8d6a-81a3e4e20d0d admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:25.069525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebeb3d2-dd79-4b41-8d6a-81a3e4e20d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:25.073256 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebeb3d2-dd79-4b41-8d6a-81a3e4e20d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:25.074240 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebeb3d2-dd79-4b41-8d6a-81a3e4e20d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:25.079520 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebeb3d2-dd79-4b41-8d6a-81a3e4e20d0d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:25.084936 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:25.101879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 822/1643] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:12:25.105988 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2696de-dd29-46f3-bf24-937ae9878b42 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:25.125727 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2696de-dd29-46f3-bf24-937ae9878b42 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:25.131148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672b0d8-a9e7-466a-8156-4b8c9f772d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:25.131980 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672b0d8-a9e7-466a-8156-4b8c9f772d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:25.132372 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672b0d8-a9e7-466a-8156-4b8c9f772d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:25.132754 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672b0d8-a9e7-466a-8156-4b8c9f772d8c admin admin] PATH_INFO: `/v3/projects/61d067e39e2e4f8e9d54fc7afb6d1c46/users/9df5380a2df44407ad5d565ed4538cb1/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:25.154996 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672b0d8-a9e7-466a-8156-4b8c9f772d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=61d067e39e2e4f8e9d54fc7afb6d1c46, user_id=9df5380a2df44407ad5d565ed4538cb1, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:25.156946 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672b0d8-a9e7-466a-8156-4b8c9f772d8c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:25.183934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 822/1644] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:12:25 2022] PUT /identity/v3/projects/61d067e39e2e4f8e9d54fc7afb6d1c46/users/9df5380a2df44407ad5d565ed4538cb1/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:25.186690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed7d67-a3f6-4af4-8900-b2c2680885b1 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:25.186970 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed7d67-a3f6-4af4-8900-b2c2680885b1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:25.187241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed7d67-a3f6-4af4-8900-b2c2680885b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:25.253028 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-faed7d67-a3f6-4af4-8900-b2c2680885b1 None None] MFA Rules not processed for user `9df5380a2df44407ad5d565ed4538cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:25.259638 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-faed7d67-a3f6-4af4-8900-b2c2680885b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:25.436540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 823/1645] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:25.442019 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672b0d8-a9e7-466a-8156-4b8c9f772d8c admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:25.609968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672b0d8-a9e7-466a-8156-4b8c9f772d8c admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:25.617833 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef90abb-499e-4318-ab74-2036a566179c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:25.618515 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef90abb-499e-4318-ab74-2036a566179c admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:25.618791 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef90abb-499e-4318-ab74-2036a566179c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:25.619111 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef90abb-499e-4318-ab74-2036a566179c admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:25.619757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef90abb-499e-4318-ab74-2036a566179c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:25.621790 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef90abb-499e-4318-ab74-2036a566179c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:25.698607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 823/1646] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:12:25 2022] POST /identity/v3/projects => generated 369 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:25.699262 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed7d67-a3f6-4af4-8900-b2c2680885b1 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:25.722014 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed7d67-a3f6-4af4-8900-b2c2680885b1 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:25.894106 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61982bf9-557e-4b8e-829b-d80a6bf6ae49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:25.894738 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61982bf9-557e-4b8e-829b-d80a6bf6ae49 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:25.895014 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61982bf9-557e-4b8e-829b-d80a6bf6ae49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:25.895349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61982bf9-557e-4b8e-829b-d80a6bf6ae49 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:25.896166 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61982bf9-557e-4b8e-829b-d80a6bf6ae49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:25.898271 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61982bf9-557e-4b8e-829b-d80a6bf6ae49 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:25.961993 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 824/1647] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:12:25 2022] POST /identity/v3/users => generated 291 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:25.963018 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef90abb-499e-4318-ab74-2036a566179c admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:25.990837 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef90abb-499e-4318-ab74-2036a566179c admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:26.006062 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a70b5-a8d9-4fea-8f84-97b971b5f2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:26.008275 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a70b5-a8d9-4fea-8f84-97b971b5f2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:26.008576 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a70b5-a8d9-4fea-8f84-97b971b5f2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:26.011495 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a70b5-a8d9-4fea-8f84-97b971b5f2d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:26.012933 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a70b5-a8d9-4fea-8f84-97b971b5f2d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:26.021311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a70b5-a8d9-4fea-8f84-97b971b5f2d7 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:26.079734 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61982bf9-557e-4b8e-829b-d80a6bf6ae49 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:26.092353 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61982bf9-557e-4b8e-829b-d80a6bf6ae49 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:26.098181 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 824/1648] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:26.115694 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af25c1-8c05-46fd-9ad3-ec65bc17060c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:26.116472 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af25c1-8c05-46fd-9ad3-ec65bc17060c admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:26.116754 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af25c1-8c05-46fd-9ad3-ec65bc17060c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:26.117028 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af25c1-8c05-46fd-9ad3-ec65bc17060c admin admin] PATH_INFO: `/v3/projects/c1f724adab5549428b92177e5429a829/users/6a043c6aeaf74738b9c12011ba8cd8c9/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:26.197387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af25c1-8c05-46fd-9ad3-ec65bc17060c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1f724adab5549428b92177e5429a829, user_id=6a043c6aeaf74738b9c12011ba8cd8c9, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:26.199903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af25c1-8c05-46fd-9ad3-ec65bc17060c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:26.235902 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 825/1649] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:12:26 2022] PUT /identity/v3/projects/c1f724adab5549428b92177e5429a829/users/6a043c6aeaf74738b9c12011ba8cd8c9/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:26.240299 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a70b5-a8d9-4fea-8f84-97b971b5f2d7 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:26.257276 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a70b5-a8d9-4fea-8f84-97b971b5f2d7 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:26.478799 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed5a09-41e8-4fc9-ac8f-15b77b4b2ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:26.479449 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed5a09-41e8-4fc9-ac8f-15b77b4b2ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:26.479729 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed5a09-41e8-4fc9-ac8f-15b77b4b2ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:26.480002 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed5a09-41e8-4fc9-ac8f-15b77b4b2ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:26.480728 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed5a09-41e8-4fc9-ac8f-15b77b4b2ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:26.482959 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed5a09-41e8-4fc9-ac8f-15b77b4b2ac4 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:26.512796 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af25c1-8c05-46fd-9ad3-ec65bc17060c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:26.527823 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 825/1650] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:26.532286 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af25c1-8c05-46fd-9ad3-ec65bc17060c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:26.544185 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943652bd-1f68-4987-9d5d-7aec98b6943b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:26.544996 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943652bd-1f68-4987-9d5d-7aec98b6943b admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:26.545300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943652bd-1f68-4987-9d5d-7aec98b6943b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:26.545598 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943652bd-1f68-4987-9d5d-7aec98b6943b admin admin] PATH_INFO: `/v3/projects/c1f724adab5549428b92177e5429a829/users/6a043c6aeaf74738b9c12011ba8cd8c9/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:26.550830 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943652bd-1f68-4987-9d5d-7aec98b6943b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1f724adab5549428b92177e5429a829, user_id=6a043c6aeaf74738b9c12011ba8cd8c9, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:26.553921 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943652bd-1f68-4987-9d5d-7aec98b6943b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:26.584310 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 826/1651] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:12:26 2022] PUT /identity/v3/projects/c1f724adab5549428b92177e5429a829/users/6a043c6aeaf74738b9c12011ba8cd8c9/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:12:26.595604 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b6a72-db62-4337-bd4b-a34d2a6fcfea None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:26.596119 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b6a72-db62-4337-bd4b-a34d2a6fcfea None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:26.596987 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b6a72-db62-4337-bd4b-a34d2a6fcfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:26.677402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-780b6a72-db62-4337-bd4b-a34d2a6fcfea None None] MFA Rules not processed for user `6a043c6aeaf74738b9c12011ba8cd8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:26.678638 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-780b6a72-db62-4337-bd4b-a34d2a6fcfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:26.722623 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:26.835810 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 826/1652] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:26 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:26.868664 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943652bd-1f68-4987-9d5d-7aec98b6943b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:26.871363 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-943652bd-1f68-4987-9d5d-7aec98b6943b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:26.931349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:26.955352 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943652bd-1f68-4987-9d5d-7aec98b6943b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:26.976641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48d07c-c387-4f75-af73-d516d2c8f1da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:26.977306 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48d07c-c387-4f75-af73-d516d2c8f1da service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:26.977586 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48d07c-c387-4f75-af73-d516d2c8f1da service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:26.977857 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48d07c-c387-4f75-af73-d516d2c8f1da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:27.006496 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48d07c-c387-4f75-af73-d516d2c8f1da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:27.008339 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48d07c-c387-4f75-af73-d516d2c8f1da service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:27.028178 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 827/1653] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:26 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:27.185903 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b6a72-db62-4337-bd4b-a34d2a6fcfea None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:27.187324 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-780b6a72-db62-4337-bd4b-a34d2a6fcfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:27.214315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b6a72-db62-4337-bd4b-a34d2a6fcfea None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:27.227311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ec731-1f18-4a54-952f-d63c306850f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:27.227940 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ec731-1f18-4a54-952f-d63c306850f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:27.228216 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ec731-1f18-4a54-952f-d63c306850f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:27.228481 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ec731-1f18-4a54-952f-d63c306850f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:27.368178 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ec731-1f18-4a54-952f-d63c306850f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:27.369905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ec731-1f18-4a54-952f-d63c306850f7 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:27.397681 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 827/1654] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:27.584044 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48d07c-c387-4f75-af73-d516d2c8f1da service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:27.585503 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6c48d07c-c387-4f75-af73-d516d2c8f1da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:27.845730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48d07c-c387-4f75-af73-d516d2c8f1da service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:27.860086 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdcc29-9a34-4583-8035-5ad32e851659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:27.860831 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdcc29-9a34-4583-8035-5ad32e851659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:27.861132 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdcc29-9a34-4583-8035-5ad32e851659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:27.861492 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdcc29-9a34-4583-8035-5ad32e851659 admin admin] PATH_INFO: `/v3/projects/7ec015d031f24a1288a86983bf7385b4` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:27.863198 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdcc29-9a34-4583-8035-5ad32e851659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ec015d031f24a1288a86983bf7385b4)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:27.865315 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdcc29-9a34-4583-8035-5ad32e851659 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:27.992287 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f3bdcc29-9a34-4583-8035-5ad32e851659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ec015d031f24a1288a86983bf7385b4', 'request_id': 'req-f3bdcc29-9a34-4583-8035-5ad32e851659'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:28.014952 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f3bdcc29-9a34-4583-8035-5ad32e851659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ec015d031f24a1288a86983bf7385b4', 'request_id': 'req-f3bdcc29-9a34-4583-8035-5ad32e851659'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:28.046481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f3bdcc29-9a34-4583-8035-5ad32e851659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ec015d031f24a1288a86983bf7385b4', 'request_id': 'req-f3bdcc29-9a34-4583-8035-5ad32e851659'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:28.096346 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f3bdcc29-9a34-4583-8035-5ad32e851659 admin admin] The token cache is being invalidate because project 7ec015d031f24a1288a86983bf7385b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:12:28.096700 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f3bdcc29-9a34-4583-8035-5ad32e851659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:28.098173 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f3bdcc29-9a34-4583-8035-5ad32e851659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:28.110048 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 828/1655] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:12:27 2022] DELETE /identity/v3/projects/7ec015d031f24a1288a86983bf7385b4 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:28.111099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6edf5-a4ef-4fd1-96c5-177d29ff0da4 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:28.111392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6edf5-a4ef-4fd1-96c5-177d29ff0da4 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:28.111669 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6edf5-a4ef-4fd1-96c5-177d29ff0da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:28.138731 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdcc29-9a34-4583-8035-5ad32e851659 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:28.140535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f3bdcc29-9a34-4583-8035-5ad32e851659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:28.175634 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-b5c6edf5-a4ef-4fd1-96c5-177d29ff0da4 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:28.178064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b5c6edf5-a4ef-4fd1-96c5-177d29ff0da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:28.401039 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdcc29-9a34-4583-8035-5ad32e851659 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:28.422640 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db6943-5a38-4e4e-aedd-35ea2b53b197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:28.423389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db6943-5a38-4e4e-aedd-35ea2b53b197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:28.423666 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db6943-5a38-4e4e-aedd-35ea2b53b197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:28.423953 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db6943-5a38-4e4e-aedd-35ea2b53b197 admin admin] PATH_INFO: `/v3/users/23474da654d34937b6c421c9d225a272` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:28.426368 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db6943-5a38-4e4e-aedd-35ea2b53b197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23474da654d34937b6c421c9d225a272)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:28.429210 dv-cinder-857434-1-smb devstack@keystone.service[81626]: WARNING py.warnings [None req-79db6943-5a38-4e4e-aedd-35ea2b53b197 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 14:12:28.429210 dv-cinder-857434-1-smb devstack@keystone.service[81626]: warnings.warn(msg) Sep 13 14:12:28.429210 dv-cinder-857434-1-smb devstack@keystone.service[81626]: Sep 13 14:12:28.430473 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db6943-5a38-4e4e-aedd-35ea2b53b197 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:28.448367 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 828/1656] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:12:28.457231 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f67f4-3572-40a8-bd88-0e40c3b9f28c None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:28.457900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f67f4-3572-40a8-bd88-0e40c3b9f28c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:28.458451 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f67f4-3572-40a8-bd88-0e40c3b9f28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:28.494782 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:28.514127 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-fa8f67f4-3572-40a8-bd88-0e40c3b9f28c None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:28.515372 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-fa8f67f4-3572-40a8-bd88-0e40c3b9f28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:28.535746 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 829/1657] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:12:28.539950 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f67f4-3572-40a8-bd88-0e40c3b9f28c None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:28.558011 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f67f4-3572-40a8-bd88-0e40c3b9f28c None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:28.573830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a683d-aac3-4aa7-8df1-e569c217857c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:28.576656 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a683d-aac3-4aa7-8df1-e569c217857c admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:28.576925 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a683d-aac3-4aa7-8df1-e569c217857c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:28.580629 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a683d-aac3-4aa7-8df1-e569c217857c admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:28.584546 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a683d-aac3-4aa7-8df1-e569c217857c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:12:28.586474 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a683d-aac3-4aa7-8df1-e569c217857c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:28.590122 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a683d-aac3-4aa7-8df1-e569c217857c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:28.639064 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-79db6943-5a38-4e4e-aedd-35ea2b53b197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23474da654d34937b6c421c9d225a272'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:28.641048 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 830/1658] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:12:28.643059 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a683d-aac3-4aa7-8df1-e569c217857c admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:28.653621 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-79db6943-5a38-4e4e-aedd-35ea2b53b197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23474da654d34937b6c421c9d225a272'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:28.667667 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a683d-aac3-4aa7-8df1-e569c217857c admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:28.689545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b755b57-1a65-41aa-874c-2a8f9e472b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:28.690168 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b755b57-1a65-41aa-874c-2a8f9e472b98 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:28.690494 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b755b57-1a65-41aa-874c-2a8f9e472b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:28.690772 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b755b57-1a65-41aa-874c-2a8f9e472b98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:28.691444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b755b57-1a65-41aa-874c-2a8f9e472b98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:28.700304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b755b57-1a65-41aa-874c-2a8f9e472b98 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:28.731466 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-79db6943-5a38-4e4e-aedd-35ea2b53b197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23474da654d34937b6c421c9d225a272'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:28.732954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-79db6943-5a38-4e4e-aedd-35ea2b53b197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23474da654d34937b6c421c9d225a272'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:28.762016 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-79db6943-5a38-4e4e-aedd-35ea2b53b197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23474da654d34937b6c421c9d225a272'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:28.798638 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 831/1659] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:12:28 2022] POST /identity/v3/projects => generated 405 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:28.803794 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9c244-8360-43f8-9eae-67c17d7b7e46 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:28.804100 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9c244-8360-43f8-9eae-67c17d7b7e46 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:28.804331 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9c244-8360-43f8-9eae-67c17d7b7e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:28.805188 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 829/1660] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:12:28 2022] DELETE /identity/v3/users/23474da654d34937b6c421c9d225a272 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:12:28.806217 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db6943-5a38-4e4e-aedd-35ea2b53b197 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:28.814533 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-79db6943-5a38-4e4e-aedd-35ea2b53b197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:28.877697 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-74c9c244-8360-43f8-9eae-67c17d7b7e46 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:28.884690 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-74c9c244-8360-43f8-9eae-67c17d7b7e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:28.906590 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:28.985928 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db6943-5a38-4e4e-aedd-35ea2b53b197 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:29.023206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 832/1661] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:29.058771 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9c244-8360-43f8-9eae-67c17d7b7e46 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:29.061363 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-74c9c244-8360-43f8-9eae-67c17d7b7e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:29.112991 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99618c91-c944-4d71-bc77-17c81664d836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:29.113670 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99618c91-c944-4d71-bc77-17c81664d836 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:29.113949 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99618c91-c944-4d71-bc77-17c81664d836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:29.114217 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99618c91-c944-4d71-bc77-17c81664d836 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:29.114852 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99618c91-c944-4d71-bc77-17c81664d836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:29.119576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99618c91-c944-4d71-bc77-17c81664d836 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:29.173066 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9c244-8360-43f8-9eae-67c17d7b7e46 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:29.173795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 830/1662] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:12:28 2022] POST /identity/v3/users => generated 303 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:29.179072 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99618c91-c944-4d71-bc77-17c81664d836 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:29.185619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cf469-41a7-4dd6-a20b-c055d7b08168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:29.186250 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cf469-41a7-4dd6-a20b-c055d7b08168 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:29.186532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cf469-41a7-4dd6-a20b-c055d7b08168 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:29.186804 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cf469-41a7-4dd6-a20b-c055d7b08168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:29.208171 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cf469-41a7-4dd6-a20b-c055d7b08168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:29.208936 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99618c91-c944-4d71-bc77-17c81664d836 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:29.212113 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cf469-41a7-4dd6-a20b-c055d7b08168 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:29.227293 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c73d1d-3d6e-4cb0-aec6-7f82cfac0135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:29.230766 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c73d1d-3d6e-4cb0-aec6-7f82cfac0135 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:29.231311 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c73d1d-3d6e-4cb0-aec6-7f82cfac0135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:29.233038 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c73d1d-3d6e-4cb0-aec6-7f82cfac0135 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:29.234882 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c73d1d-3d6e-4cb0-aec6-7f82cfac0135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:29.236668 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 833/1663] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 14:12:29.239179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c73d1d-3d6e-4cb0-aec6-7f82cfac0135 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:29.272898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 831/1664] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:29.276727 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cf469-41a7-4dd6-a20b-c055d7b08168 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:29.294176 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cf469-41a7-4dd6-a20b-c055d7b08168 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:29.316651 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d7b6e-4cab-46fa-b380-e190925cd647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:29.318992 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d7b6e-4cab-46fa-b380-e190925cd647 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:29.319277 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d7b6e-4cab-46fa-b380-e190925cd647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:29.321223 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d7b6e-4cab-46fa-b380-e190925cd647 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:29.322673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d7b6e-4cab-46fa-b380-e190925cd647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:29.328031 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d7b6e-4cab-46fa-b380-e190925cd647 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:29.386307 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 834/1665] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:29.388668 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c73d1d-3d6e-4cb0-aec6-7f82cfac0135 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:29.402755 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c73d1d-3d6e-4cb0-aec6-7f82cfac0135 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:29.408257 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979dda84-cc80-4677-a87a-37ab60df0a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:29.408934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dda84-cc80-4677-a87a-37ab60df0a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:29.409260 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dda84-cc80-4677-a87a-37ab60df0a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:29.409683 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dda84-cc80-4677-a87a-37ab60df0a0a admin admin] PATH_INFO: `/v3/projects/0c0e5f40ba1f4d2eb44d2872617c970a/users/39e5cef72916452199806f228f20ec36/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:29.431801 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979dda84-cc80-4677-a87a-37ab60df0a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c0e5f40ba1f4d2eb44d2872617c970a, user_id=39e5cef72916452199806f228f20ec36, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:29.434764 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979dda84-cc80-4677-a87a-37ab60df0a0a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:29.437540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:29.459351 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 832/1666] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:12:29 2022] PUT /identity/v3/projects/0c0e5f40ba1f4d2eb44d2872617c970a/users/39e5cef72916452199806f228f20ec36/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:29.472358 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299db400-2675-43af-a246-ff0bf4d8e429 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:29.474661 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299db400-2675-43af-a246-ff0bf4d8e429 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:29.475435 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299db400-2675-43af-a246-ff0bf4d8e429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:29.558929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-299db400-2675-43af-a246-ff0bf4d8e429 None None] MFA Rules not processed for user `39e5cef72916452199806f228f20ec36`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:29.560990 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-299db400-2675-43af-a246-ff0bf4d8e429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:29.798836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 835/1667] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:29 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:29.803412 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979dda84-cc80-4677-a87a-37ab60df0a0a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:30.062153 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979dda84-cc80-4677-a87a-37ab60df0a0a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:30.072765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00640f6-ad02-409d-99bd-0b2eaa9debbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:30.073425 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00640f6-ad02-409d-99bd-0b2eaa9debbb admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:30.073704 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00640f6-ad02-409d-99bd-0b2eaa9debbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:30.073973 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00640f6-ad02-409d-99bd-0b2eaa9debbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:30.077844 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00640f6-ad02-409d-99bd-0b2eaa9debbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:30.083996 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00640f6-ad02-409d-99bd-0b2eaa9debbb admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:30.174984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 833/1668] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:12:29 2022] POST /identity/v3/projects => generated 405 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:30.180055 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299db400-2675-43af-a246-ff0bf4d8e429 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:30.207831 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299db400-2675-43af-a246-ff0bf4d8e429 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:30.316832 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:30.381578 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a1106-1a42-41a5-a89b-df926cf5c76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:30.382426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a1106-1a42-41a5-a89b-df926cf5c76f admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:30.383581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a1106-1a42-41a5-a89b-df926cf5c76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:30.386603 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a1106-1a42-41a5-a89b-df926cf5c76f admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:30.387692 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a1106-1a42-41a5-a89b-df926cf5c76f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:30.392341 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a1106-1a42-41a5-a89b-df926cf5c76f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:30.465504 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 836/1669] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:12:30 2022] POST /identity/v3/users => generated 309 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:30.470210 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00640f6-ad02-409d-99bd-0b2eaa9debbb admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:30.485824 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00640f6-ad02-409d-99bd-0b2eaa9debbb admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:30.498474 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03f22b-b9f4-49ae-a611-43e86bc37362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:30.499194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03f22b-b9f4-49ae-a611-43e86bc37362 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:30.499638 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03f22b-b9f4-49ae-a611-43e86bc37362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:30.499912 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03f22b-b9f4-49ae-a611-43e86bc37362 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:30.500569 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03f22b-b9f4-49ae-a611-43e86bc37362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:30.502231 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03f22b-b9f4-49ae-a611-43e86bc37362 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:30.522138 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 834/1670] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:30.524915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a1106-1a42-41a5-a89b-df926cf5c76f admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:30.541630 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a1106-1a42-41a5-a89b-df926cf5c76f admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:30.557436 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929844e-386a-48a4-a2a9-c43a0c4ee199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:30.558258 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929844e-386a-48a4-a2a9-c43a0c4ee199 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:30.558448 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929844e-386a-48a4-a2a9-c43a0c4ee199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:30.565325 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929844e-386a-48a4-a2a9-c43a0c4ee199 admin admin] PATH_INFO: `/v3/projects/4150ba4ed3cc492387b59e5c4c1194a1/users/2224e04c851f48a6b1b0b5a570a93613/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:30.600942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929844e-386a-48a4-a2a9-c43a0c4ee199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4150ba4ed3cc492387b59e5c4c1194a1, user_id=2224e04c851f48a6b1b0b5a570a93613, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:30.603722 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929844e-386a-48a4-a2a9-c43a0c4ee199 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:30.650560 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 837/1671] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:12:30 2022] PUT /identity/v3/projects/4150ba4ed3cc492387b59e5c4c1194a1/users/2224e04c851f48a6b1b0b5a570a93613/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:30.655457 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03f22b-b9f4-49ae-a611-43e86bc37362 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:30.673579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03f22b-b9f4-49ae-a611-43e86bc37362 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:30.713903 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929844e-386a-48a4-a2a9-c43a0c4ee199 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:30.715814 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4929844e-386a-48a4-a2a9-c43a0c4ee199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:30.781191 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce87db8-18c6-4587-af10-e423a94dd880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:30.782215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce87db8-18c6-4587-af10-e423a94dd880 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:30.782646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce87db8-18c6-4587-af10-e423a94dd880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:30.783018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce87db8-18c6-4587-af10-e423a94dd880 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:30.783957 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce87db8-18c6-4587-af10-e423a94dd880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:30.785787 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce87db8-18c6-4587-af10-e423a94dd880 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:30.828687 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 835/1672] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:30.831987 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce87db8-18c6-4587-af10-e423a94dd880 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:30.875454 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce87db8-18c6-4587-af10-e423a94dd880 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:30.891907 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d0e1a-138f-4389-abc2-42a1521ff317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:30.892812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d0e1a-138f-4389-abc2-42a1521ff317 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:30.893262 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d0e1a-138f-4389-abc2-42a1521ff317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:30.895072 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d0e1a-138f-4389-abc2-42a1521ff317 admin admin] PATH_INFO: `/v3/projects/4150ba4ed3cc492387b59e5c4c1194a1/users/2224e04c851f48a6b1b0b5a570a93613/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:30.899886 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d0e1a-138f-4389-abc2-42a1521ff317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4150ba4ed3cc492387b59e5c4c1194a1, user_id=2224e04c851f48a6b1b0b5a570a93613, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:30.902602 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929844e-386a-48a4-a2a9-c43a0c4ee199 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:30.911039 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d0e1a-138f-4389-abc2-42a1521ff317 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:30.932554 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097acd78-7da1-4c68-996f-c4bc0a4aac21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:30.933240 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097acd78-7da1-4c68-996f-c4bc0a4aac21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:30.933745 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097acd78-7da1-4c68-996f-c4bc0a4aac21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:30.933969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097acd78-7da1-4c68-996f-c4bc0a4aac21 admin admin] PATH_INFO: `/v3/projects/c42be1c1bc2e4183ae0610a27c182d13` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:30.935258 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097acd78-7da1-4c68-996f-c4bc0a4aac21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c42be1c1bc2e4183ae0610a27c182d13)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:30.936290 dv-cinder-857434-1-smb devstack@keystone.service[81625]: WARNING py.warnings [None req-097acd78-7da1-4c68-996f-c4bc0a4aac21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 14:12:30.936290 dv-cinder-857434-1-smb devstack@keystone.service[81625]: warnings.warn(msg) Sep 13 14:12:30.936290 dv-cinder-857434-1-smb devstack@keystone.service[81625]: Sep 13 14:12:30.937942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097acd78-7da1-4c68-996f-c4bc0a4aac21 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:30.947361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 836/1673] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:12:30 2022] PUT /identity/v3/projects/4150ba4ed3cc492387b59e5c4c1194a1/users/2224e04c851f48a6b1b0b5a570a93613/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:30.954251 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3e531-bbc4-478d-bcfa-1bcd3aae854c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:30.954914 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3e531-bbc4-478d-bcfa-1bcd3aae854c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:30.957381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3e531-bbc4-478d-bcfa-1bcd3aae854c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:31.127922 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-bee3e531-bbc4-478d-bcfa-1bcd3aae854c None None] MFA Rules not processed for user `2224e04c851f48a6b1b0b5a570a93613`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:31.137422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-bee3e531-bbc4-478d-bcfa-1bcd3aae854c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:31.149604 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-097acd78-7da1-4c68-996f-c4bc0a4aac21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c42be1c1bc2e4183ae0610a27c182d13', 'request_id': 'req-097acd78-7da1-4c68-996f-c4bc0a4aac21'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:31.202632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-097acd78-7da1-4c68-996f-c4bc0a4aac21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c42be1c1bc2e4183ae0610a27c182d13', 'request_id': 'req-097acd78-7da1-4c68-996f-c4bc0a4aac21'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:31.223523 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-097acd78-7da1-4c68-996f-c4bc0a4aac21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c42be1c1bc2e4183ae0610a27c182d13', 'request_id': 'req-097acd78-7da1-4c68-996f-c4bc0a4aac21'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:31.294338 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-097acd78-7da1-4c68-996f-c4bc0a4aac21 admin admin] The token cache is being invalidate because project c42be1c1bc2e4183ae0610a27c182d13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:12:31.295045 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-097acd78-7da1-4c68-996f-c4bc0a4aac21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:31.299894 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-097acd78-7da1-4c68-996f-c4bc0a4aac21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:31.309531 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 838/1674] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:12:30 2022] DELETE /identity/v3/projects/c42be1c1bc2e4183ae0610a27c182d13 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:12:31.313216 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e975ea-1fa1-440b-a572-32aabeaefba5 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:31.313491 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e975ea-1fa1-440b-a572-32aabeaefba5 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:31.315647 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e975ea-1fa1-440b-a572-32aabeaefba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:31.326661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:31.371903 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-25e975ea-1fa1-440b-a572-32aabeaefba5 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:31.378209 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-25e975ea-1fa1-440b-a572-32aabeaefba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:31.404494 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 837/1675] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:30 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:31.418192 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3e531-bbc4-478d-bcfa-1bcd3aae854c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:31.430607 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-bee3e531-bbc4-478d-bcfa-1bcd3aae854c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:31.513411 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:31.631326 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 839/1676] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:31.639400 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc98c03-9ff1-4e2c-a365-1584cba81378 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:31.649251 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc98c03-9ff1-4e2c-a365-1584cba81378 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:31.649801 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc98c03-9ff1-4e2c-a365-1584cba81378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:31.655164 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3e531-bbc4-478d-bcfa-1bcd3aae854c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:31.659568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead2a1c-69c2-4b3b-aa35-4f8c0370778f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:31.660261 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead2a1c-69c2-4b3b-aa35-4f8c0370778f service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:31.660540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead2a1c-69c2-4b3b-aa35-4f8c0370778f service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:31.660805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead2a1c-69c2-4b3b-aa35-4f8c0370778f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:31.676879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead2a1c-69c2-4b3b-aa35-4f8c0370778f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:31.678629 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead2a1c-69c2-4b3b-aa35-4f8c0370778f service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:31.691871 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 838/1677] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:31 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:31.721931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-4bc98c03-9ff1-4e2c-a365-1584cba81378 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:31.729766 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4bc98c03-9ff1-4e2c-a365-1584cba81378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:31.761475 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 840/1678] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:31.763078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead2a1c-69c2-4b3b-aa35-4f8c0370778f service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:31.780975 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead2a1c-69c2-4b3b-aa35-4f8c0370778f service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:31.795170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847db7f-79b7-43ff-bea0-e9ac8426186a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:31.802422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847db7f-79b7-43ff-bea0-e9ac8426186a admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:31.802422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847db7f-79b7-43ff-bea0-e9ac8426186a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:31.802422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847db7f-79b7-43ff-bea0-e9ac8426186a admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:31.807403 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847db7f-79b7-43ff-bea0-e9ac8426186a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:12:31.808332 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847db7f-79b7-43ff-bea0-e9ac8426186a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:31.816521 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847db7f-79b7-43ff-bea0-e9ac8426186a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:31.850300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc5d1d-1b17-4313-97bb-373e2fd39e03 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:31.850706 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc5d1d-1b17-4313-97bb-373e2fd39e03 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:31.851078 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc5d1d-1b17-4313-97bb-373e2fd39e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:31.875239 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 839/1679] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:12:31.875606 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847db7f-79b7-43ff-bea0-e9ac8426186a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:31.906151 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847db7f-79b7-43ff-bea0-e9ac8426186a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:31.920152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749a5c6-2767-47e7-a042-e1e5a0466222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:31.920827 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749a5c6-2767-47e7-a042-e1e5a0466222 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:31.923152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749a5c6-2767-47e7-a042-e1e5a0466222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:31.923515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749a5c6-2767-47e7-a042-e1e5a0466222 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:31.924331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749a5c6-2767-47e7-a042-e1e5a0466222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:31.928610 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749a5c6-2767-47e7-a042-e1e5a0466222 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:31.930892 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-c8fc5d1d-1b17-4313-97bb-373e2fd39e03 None None] MFA Rules not processed for user `a06ffa78739345039aff49f6fb524b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:31.937293 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c8fc5d1d-1b17-4313-97bb-373e2fd39e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:32.030498 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 840/1680] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:12:31 2022] POST /identity/v3/projects => generated 363 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:32.031808 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749a5c6-2767-47e7-a042-e1e5a0466222 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:32.033847 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d749a5c6-2767-47e7-a042-e1e5a0466222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:32.155847 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 841/1681] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:12:32.157889 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc5d1d-1b17-4313-97bb-373e2fd39e03 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:32.189184 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc5d1d-1b17-4313-97bb-373e2fd39e03 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:32.201844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcae72c-e326-4ce1-8fb3-bd2a188acb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:32.205077 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcae72c-e326-4ce1-8fb3-bd2a188acb33 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:32.205557 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcae72c-e326-4ce1-8fb3-bd2a188acb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:32.206143 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcae72c-e326-4ce1-8fb3-bd2a188acb33 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:32.206630 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749a5c6-2767-47e7-a042-e1e5a0466222 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:32.208457 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcae72c-e326-4ce1-8fb3-bd2a188acb33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:32.212585 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcae72c-e326-4ce1-8fb3-bd2a188acb33 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:32.217803 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1c57f-b064-441d-b6ec-9cedd6fb4c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:32.219804 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1c57f-b064-441d-b6ec-9cedd6fb4c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:32.220866 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1c57f-b064-441d-b6ec-9cedd6fb4c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:32.221324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1c57f-b064-441d-b6ec-9cedd6fb4c89 admin admin] PATH_INFO: `/v3/users/39e5cef72916452199806f228f20ec36` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:32.225356 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1c57f-b064-441d-b6ec-9cedd6fb4c89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39e5cef72916452199806f228f20ec36)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:32.230143 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1c57f-b064-441d-b6ec-9cedd6fb4c89 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:32.273361 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 842/1682] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:12:32 2022] POST /identity/v3/users => generated 282 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:32.280119 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcae72c-e326-4ce1-8fb3-bd2a188acb33 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:32.283590 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1dcae72c-e326-4ce1-8fb3-bd2a188acb33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:32.361534 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:32.377889 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7ce1c57f-b064-441d-b6ec-9cedd6fb4c89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39e5cef72916452199806f228f20ec36'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:32.393849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7ce1c57f-b064-441d-b6ec-9cedd6fb4c89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39e5cef72916452199806f228f20ec36'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:32.429147 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7ce1c57f-b064-441d-b6ec-9cedd6fb4c89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39e5cef72916452199806f228f20ec36'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:32.430241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7ce1c57f-b064-441d-b6ec-9cedd6fb4c89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39e5cef72916452199806f228f20ec36'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:32.445910 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7ce1c57f-b064-441d-b6ec-9cedd6fb4c89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39e5cef72916452199806f228f20ec36'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:32.490814 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 841/1683] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:12:32 2022] DELETE /identity/v3/users/39e5cef72916452199806f228f20ec36 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:32.495708 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1c57f-b064-441d-b6ec-9cedd6fb4c89 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:32.497888 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7ce1c57f-b064-441d-b6ec-9cedd6fb4c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:32.499898 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcae72c-e326-4ce1-8fb3-bd2a188acb33 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:32.627535 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:32.639494 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1c57f-b064-441d-b6ec-9cedd6fb4c89 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:32.671865 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fe76d-f8c6-4d40-9e42-a45032248c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:32.672537 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fe76d-f8c6-4d40-9e42-a45032248c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:32.675408 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fe76d-f8c6-4d40-9e42-a45032248c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:32.677836 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fe76d-f8c6-4d40-9e42-a45032248c39 admin admin] PATH_INFO: `/v3/users/4978ac21fb0140e5af2c17b16e131c3a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:32.688063 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fe76d-f8c6-4d40-9e42-a45032248c39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4978ac21fb0140e5af2c17b16e131c3a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:32.696788 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fe76d-f8c6-4d40-9e42-a45032248c39 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:32.737068 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e724ee-8083-4aa4-9c23-ef04999500a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:32.738265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e724ee-8083-4aa4-9c23-ef04999500a0 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:32.738265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e724ee-8083-4aa4-9c23-ef04999500a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:32.738792 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e724ee-8083-4aa4-9c23-ef04999500a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:32.745762 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-09e724ee-8083-4aa4-9c23-ef04999500a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:32.892257 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e86fe76d-f8c6-4d40-9e42-a45032248c39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4978ac21fb0140e5af2c17b16e131c3a'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:32.908845 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e86fe76d-f8c6-4d40-9e42-a45032248c39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4978ac21fb0140e5af2c17b16e131c3a'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:32.936941 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e86fe76d-f8c6-4d40-9e42-a45032248c39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4978ac21fb0140e5af2c17b16e131c3a'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:32.939937 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e86fe76d-f8c6-4d40-9e42-a45032248c39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4978ac21fb0140e5af2c17b16e131c3a'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:32.943252 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e724ee-8083-4aa4-9c23-ef04999500a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:32.944871 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e724ee-8083-4aa4-9c23-ef04999500a0 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:32.965268 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e86fe76d-f8c6-4d40-9e42-a45032248c39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4978ac21fb0140e5af2c17b16e131c3a'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:32.982765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 842/1684] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:12:32 2022] DELETE /identity/v3/users/4978ac21fb0140e5af2c17b16e131c3a => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:32.986804 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fe76d-f8c6-4d40-9e42-a45032248c39 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:32.991031 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e86fe76d-f8c6-4d40-9e42-a45032248c39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:32.999981 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 843/1685] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:32 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:33.001618 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1457c72-5ae1-4f4a-99d6-a439529d28df None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:33.001901 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1457c72-5ae1-4f4a-99d6-a439529d28df None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:33.002180 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1457c72-5ae1-4f4a-99d6-a439529d28df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:33.082310 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e1457c72-5ae1-4f4a-99d6-a439529d28df None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:33.083551 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e1457c72-5ae1-4f4a-99d6-a439529d28df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:33.111370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:33.172311 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fe76d-f8c6-4d40-9e42-a45032248c39 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:33.190643 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4bc43-ca9e-4e92-a378-4780f593f7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:33.191277 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4bc43-ca9e-4e92-a378-4780f593f7a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:33.191557 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4bc43-ca9e-4e92-a378-4780f593f7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:33.191829 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4bc43-ca9e-4e92-a378-4780f593f7a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:33.192547 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4bc43-ca9e-4e92-a378-4780f593f7a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:33.198848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4bc43-ca9e-4e92-a378-4780f593f7a2 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:33.229268 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 843/1686] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:33.230256 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4bc43-ca9e-4e92-a378-4780f593f7a2 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:33.239495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-41b4bc43-ca9e-4e92-a378-4780f593f7a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:33.266497 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4bc43-ca9e-4e92-a378-4780f593f7a2 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:33.284587 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6c72a-aabe-4d36-ba6e-9057621b8d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:33.285639 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6c72a-aabe-4d36-ba6e-9057621b8d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:33.285953 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6c72a-aabe-4d36-ba6e-9057621b8d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:33.286229 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6c72a-aabe-4d36-ba6e-9057621b8d95 admin admin] PATH_INFO: `/v3/users/9df5380a2df44407ad5d565ed4538cb1` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:33.289587 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6c72a-aabe-4d36-ba6e-9057621b8d95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9df5380a2df44407ad5d565ed4538cb1)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:33.294617 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6c72a-aabe-4d36-ba6e-9057621b8d95 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:33.305077 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 844/1687] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:33.306640 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741ffb6-8637-4403-97dc-08c5634eb623 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:33.307104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741ffb6-8637-4403-97dc-08c5634eb623 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:33.307512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741ffb6-8637-4403-97dc-08c5634eb623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:33.331269 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-c741ffb6-8637-4403-97dc-08c5634eb623 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:33.332563 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c741ffb6-8637-4403-97dc-08c5634eb623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:33.366333 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 845/1688] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:33.367531 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741ffb6-8637-4403-97dc-08c5634eb623 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:33.392595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741ffb6-8637-4403-97dc-08c5634eb623 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:33.407370 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d31b5e-3e33-42d1-9986-9a0fe231e63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:33.408142 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d31b5e-3e33-42d1-9986-9a0fe231e63a admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:33.408424 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d31b5e-3e33-42d1-9986-9a0fe231e63a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:33.408689 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d31b5e-3e33-42d1-9986-9a0fe231e63a admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:33.409362 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d31b5e-3e33-42d1-9986-9a0fe231e63a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:33.411470 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d31b5e-3e33-42d1-9986-9a0fe231e63a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:33.426149 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5fc6c72a-aabe-4d36-ba6e-9057621b8d95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9df5380a2df44407ad5d565ed4538cb1'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:33.436542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 846/1689] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:33.439696 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d31b5e-3e33-42d1-9986-9a0fe231e63a admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:33.442183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b4d31b5e-3e33-42d1-9986-9a0fe231e63a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:33.444012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5fc6c72a-aabe-4d36-ba6e-9057621b8d95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9df5380a2df44407ad5d565ed4538cb1'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:33.466213 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5fc6c72a-aabe-4d36-ba6e-9057621b8d95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9df5380a2df44407ad5d565ed4538cb1'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:33.467011 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5fc6c72a-aabe-4d36-ba6e-9057621b8d95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9df5380a2df44407ad5d565ed4538cb1'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:33.476768 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5fc6c72a-aabe-4d36-ba6e-9057621b8d95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9df5380a2df44407ad5d565ed4538cb1'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:33.488692 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 844/1690] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:12:33 2022] DELETE /identity/v3/users/9df5380a2df44407ad5d565ed4538cb1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:33.488692 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6c72a-aabe-4d36-ba6e-9057621b8d95 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:33.489644 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5fc6c72a-aabe-4d36-ba6e-9057621b8d95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:33.598816 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d31b5e-3e33-42d1-9986-9a0fe231e63a admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:33.625500 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:33.678476 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6c72a-aabe-4d36-ba6e-9057621b8d95 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:33.692141 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5969b8-9668-49be-bb41-91158a599fea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:33.693021 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5969b8-9668-49be-bb41-91158a599fea service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:33.693412 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5969b8-9668-49be-bb41-91158a599fea service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:33.694186 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5969b8-9668-49be-bb41-91158a599fea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:33.696834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2a5969b8-9668-49be-bb41-91158a599fea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:33.732948 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e27a92-bca0-46e0-97c0-e7c20bbe47e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:33.733614 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e27a92-bca0-46e0-97c0-e7c20bbe47e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:33.733943 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e27a92-bca0-46e0-97c0-e7c20bbe47e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:33.734379 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e27a92-bca0-46e0-97c0-e7c20bbe47e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:33.746204 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-50e27a92-bca0-46e0-97c0-e7c20bbe47e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:33.828836 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5969b8-9668-49be-bb41-91158a599fea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:33.831747 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5969b8-9668-49be-bb41-91158a599fea service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:33.841396 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:33.860551 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 845/1691] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:33.876167 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5969b8-9668-49be-bb41-91158a599fea service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:33.881810 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2a5969b8-9668-49be-bb41-91158a599fea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:33.920989 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5969b8-9668-49be-bb41-91158a599fea service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:33.951298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd212bb8-b830-40cf-b6b5-e261a72be644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:33.955651 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd212bb8-b830-40cf-b6b5-e261a72be644 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:33.956749 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd212bb8-b830-40cf-b6b5-e261a72be644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:33.958469 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd212bb8-b830-40cf-b6b5-e261a72be644 admin admin] PATH_INFO: `/v3/projects/7a351aed7d2a476f961dcf27a514d2ad/users/3068c197f338402ab7b91fb727b2d31c/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:33.959789 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e27a92-bca0-46e0-97c0-e7c20bbe47e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:33.961441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e27a92-bca0-46e0-97c0-e7c20bbe47e6 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:33.991989 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 847/1692] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:33.993473 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b8e4e-20f1-412c-9e66-ff39871db9e7 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:33.993914 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b8e4e-20f1-412c-9e66-ff39871db9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:33.994311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b8e4e-20f1-412c-9e66-ff39871db9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:34.023371 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd212bb8-b830-40cf-b6b5-e261a72be644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a351aed7d2a476f961dcf27a514d2ad, user_id=3068c197f338402ab7b91fb727b2d31c, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:34.027023 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd212bb8-b830-40cf-b6b5-e261a72be644 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:34.041947 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-dd9b8e4e-20f1-412c-9e66-ff39871db9e7 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:34.043545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-dd9b8e4e-20f1-412c-9e66-ff39871db9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:34.065898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 846/1693] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:12:33 2022] PUT /identity/v3/projects/7a351aed7d2a476f961dcf27a514d2ad/users/3068c197f338402ab7b91fb727b2d31c/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:34.071124 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac9169-e50c-4966-9d24-f4d3b21b5070 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:34.071475 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac9169-e50c-4966-9d24-f4d3b21b5070 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:34.071757 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac9169-e50c-4966-9d24-f4d3b21b5070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:34.139811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-4bac9169-e50c-4966-9d24-f4d3b21b5070 None None] MFA Rules not processed for user `8dd5ec91cd29468f97cb3045c12b819f`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:34.142001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4bac9169-e50c-4966-9d24-f4d3b21b5070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:34.195285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 848/1694] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:34.198812 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc269a3a-dac3-4289-b0cf-f97df3e9f17a None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:34.198812 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc269a3a-dac3-4289-b0cf-f97df3e9f17a None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:34.198812 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc269a3a-dac3-4289-b0cf-f97df3e9f17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:34.276530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-bc269a3a-dac3-4289-b0cf-f97df3e9f17a None None] MFA Rules not processed for user `3068c197f338402ab7b91fb727b2d31c`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:34.277782 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-bc269a3a-dac3-4289-b0cf-f97df3e9f17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:34.327772 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 847/1695] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:34.328815 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac9169-e50c-4966-9d24-f4d3b21b5070 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:34.437374 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac9169-e50c-4966-9d24-f4d3b21b5070 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:34.439416 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:34.444909 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a0fdd-4a11-4278-840b-260621ea4db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:34.455770 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a0fdd-4a11-4278-840b-260621ea4db7 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:34.456364 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a0fdd-4a11-4278-840b-260621ea4db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:34.456780 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a0fdd-4a11-4278-840b-260621ea4db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:34.462636 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 849/1696] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:34.464261 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae7369-24a7-4e63-bc44-a8b22228b2b7 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:34.464693 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae7369-24a7-4e63-bc44-a8b22228b2b7 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:34.465119 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae7369-24a7-4e63-bc44-a8b22228b2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:34.476605 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a0fdd-4a11-4278-840b-260621ea4db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:34.478083 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a0fdd-4a11-4278-840b-260621ea4db7 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:34.507836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-beae7369-24a7-4e63-bc44-a8b22228b2b7 None None] MFA Rules not processed for user `8dd5ec91cd29468f97cb3045c12b819f`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:34.507966 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 848/1697] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:34.509742 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-beae7369-24a7-4e63-bc44-a8b22228b2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:34.513267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a0fdd-4a11-4278-840b-260621ea4db7 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:34.525523 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 850/1698] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:34.536697 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a0fdd-4a11-4278-840b-260621ea4db7 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:34.539403 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae7369-24a7-4e63-bc44-a8b22228b2b7 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:34.541083 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-beae7369-24a7-4e63-bc44-a8b22228b2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:34.543764 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31135590-d3d5-4d67-8691-2424603fa5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:34.545126 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31135590-d3d5-4d67-8691-2424603fa5a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:34.545548 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31135590-d3d5-4d67-8691-2424603fa5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:34.545930 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31135590-d3d5-4d67-8691-2424603fa5a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:34.546838 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31135590-d3d5-4d67-8691-2424603fa5a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:34.549120 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31135590-d3d5-4d67-8691-2424603fa5a1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:34.597204 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 849/1699] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:12:34 2022] POST /identity/v3/projects => generated 365 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:34.599792 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31135590-d3d5-4d67-8691-2424603fa5a1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:34.689890 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:34.722957 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31135590-d3d5-4d67-8691-2424603fa5a1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:34.734339 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae7369-24a7-4e63-bc44-a8b22228b2b7 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:34.740654 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c3281-5047-496b-98c1-dc7727afaaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:34.743370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c3281-5047-496b-98c1-dc7727afaaf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:34.743950 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c3281-5047-496b-98c1-dc7727afaaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:34.744859 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c3281-5047-496b-98c1-dc7727afaaf4 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:34.746233 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c3281-5047-496b-98c1-dc7727afaaf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:34.749705 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c3281-5047-496b-98c1-dc7727afaaf4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:34.797224 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 850/1700] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:12:34 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:12:34.799546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c3281-5047-496b-98c1-dc7727afaaf4 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:34.836954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c3281-5047-496b-98c1-dc7727afaaf4 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:34.848411 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195342f-3ed4-4cfb-a5cb-becdf64b3b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:34.849751 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195342f-3ed4-4cfb-a5cb-becdf64b3b57 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:34.850362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195342f-3ed4-4cfb-a5cb-becdf64b3b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:34.850630 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195342f-3ed4-4cfb-a5cb-becdf64b3b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:34.852365 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195342f-3ed4-4cfb-a5cb-becdf64b3b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:34.856896 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195342f-3ed4-4cfb-a5cb-becdf64b3b57 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:34.879004 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bf18d-115a-4244-92c5-03708cfe8980 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:34.879004 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bf18d-115a-4244-92c5-03708cfe8980 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:34.879616 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 851/1701] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:34.879688 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bf18d-115a-4244-92c5-03708cfe8980 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:34.879688 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bf18d-115a-4244-92c5-03708cfe8980 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:34.882557 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195342f-3ed4-4cfb-a5cb-becdf64b3b57 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:34.895626 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195342f-3ed4-4cfb-a5cb-becdf64b3b57 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:34.904801 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d8831-e6c2-48c1-832f-02cbfb353b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:34.905883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d8831-e6c2-48c1-832f-02cbfb353b68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:34.906299 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d8831-e6c2-48c1-832f-02cbfb353b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:34.906707 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d8831-e6c2-48c1-832f-02cbfb353b68 admin admin] PATH_INFO: `/v3/projects/19adfda5bcbf4c73b81e05ee28857fe5/users/5c08826fdfd641ad9512741039f6526c/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:34.928786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d8831-e6c2-48c1-832f-02cbfb353b68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19adfda5bcbf4c73b81e05ee28857fe5, user_id=5c08826fdfd641ad9512741039f6526c, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:34.933074 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d8831-e6c2-48c1-832f-02cbfb353b68 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:34.965572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 852/1702] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:12:34 2022] PUT /identity/v3/projects/19adfda5bcbf4c73b81e05ee28857fe5/users/5c08826fdfd641ad9512741039f6526c/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:34.967543 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d8831-e6c2-48c1-832f-02cbfb353b68 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:35.007446 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bf18d-115a-4244-92c5-03708cfe8980 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:35.009313 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bf18d-115a-4244-92c5-03708cfe8980 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:35.032624 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 851/1703] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:34 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 14:12:35.157822 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d8831-e6c2-48c1-832f-02cbfb353b68 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:35.175761 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241747d-3300-4306-94b5-5d4067ff90fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:35.176743 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241747d-3300-4306-94b5-5d4067ff90fd admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:35.178319 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241747d-3300-4306-94b5-5d4067ff90fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:35.178725 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241747d-3300-4306-94b5-5d4067ff90fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:35.179548 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241747d-3300-4306-94b5-5d4067ff90fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:35.183678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bf18d-115a-4244-92c5-03708cfe8980 service nova] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:35.184440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241747d-3300-4306-94b5-5d4067ff90fd admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:35.185766 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0e5bf18d-115a-4244-92c5-03708cfe8980 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:35.198315 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 853/1704] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:35.211975 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241747d-3300-4306-94b5-5d4067ff90fd admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:35.222705 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bf18d-115a-4244-92c5-03708cfe8980 service nova] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:35.228029 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241747d-3300-4306-94b5-5d4067ff90fd admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:35.234996 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b433a0-3b09-47cd-80f7-8ebf69e88d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:35.236692 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b433a0-3b09-47cd-80f7-8ebf69e88d6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:35.237087 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b433a0-3b09-47cd-80f7-8ebf69e88d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:35.237600 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b433a0-3b09-47cd-80f7-8ebf69e88d6a admin admin] PATH_INFO: `/v3/projects/19adfda5bcbf4c73b81e05ee28857fe5/users/5c08826fdfd641ad9512741039f6526c/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:35.239174 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1359671-2e81-4ec5-a070-be8c9a092890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:35.240073 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1359671-2e81-4ec5-a070-be8c9a092890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:35.240358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b433a0-3b09-47cd-80f7-8ebf69e88d6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=19adfda5bcbf4c73b81e05ee28857fe5, user_id=5c08826fdfd641ad9512741039f6526c, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:35.240714 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1359671-2e81-4ec5-a070-be8c9a092890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:35.241217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1359671-2e81-4ec5-a070-be8c9a092890 admin admin] PATH_INFO: `/v3/projects/ae18c370a859435a8d0356dff8a8fe5a` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:35.242851 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1359671-2e81-4ec5-a070-be8c9a092890 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae18c370a859435a8d0356dff8a8fe5a)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:35.243861 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b433a0-3b09-47cd-80f7-8ebf69e88d6a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:35.247105 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1359671-2e81-4ec5-a070-be8c9a092890 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:35.288821 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 854/1705] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:12:35 2022] PUT /identity/v3/projects/19adfda5bcbf4c73b81e05ee28857fe5/users/5c08826fdfd641ad9512741039f6526c/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:35.292186 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde011c-3c75-441e-a8a5-86d5e49d4e3b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:35.292806 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde011c-3c75-441e-a8a5-86d5e49d4e3b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:35.293205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde011c-3c75-441e-a8a5-86d5e49d4e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:35.321553 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:35.348437 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-7cde011c-3c75-441e-a8a5-86d5e49d4e3b None None] MFA Rules not processed for user `5c08826fdfd641ad9512741039f6526c`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:35.350794 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7cde011c-3c75-441e-a8a5-86d5e49d4e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:35.392874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f1359671-2e81-4ec5-a070-be8c9a092890 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae18c370a859435a8d0356dff8a8fe5a', 'request_id': 'req-f1359671-2e81-4ec5-a070-be8c9a092890'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:35.402942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f1359671-2e81-4ec5-a070-be8c9a092890 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae18c370a859435a8d0356dff8a8fe5a', 'request_id': 'req-f1359671-2e81-4ec5-a070-be8c9a092890'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:35.411360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f1359671-2e81-4ec5-a070-be8c9a092890 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae18c370a859435a8d0356dff8a8fe5a', 'request_id': 'req-f1359671-2e81-4ec5-a070-be8c9a092890'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:35.428027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f1359671-2e81-4ec5-a070-be8c9a092890 admin admin] The token cache is being invalidate because project ae18c370a859435a8d0356dff8a8fe5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:12:35.428328 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f1359671-2e81-4ec5-a070-be8c9a092890 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:35.432263 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f1359671-2e81-4ec5-a070-be8c9a092890 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:35.443798 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 852/1706] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:12:35 2022] DELETE /identity/v3/projects/ae18c370a859435a8d0356dff8a8fe5a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:12:35.448578 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7a0d4-12f0-4816-9096-14494f304cab None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:35.448863 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7a0d4-12f0-4816-9096-14494f304cab None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:35.449156 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7a0d4-12f0-4816-9096-14494f304cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:35.508959 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-ada7a0d4-12f0-4816-9096-14494f304cab None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:35.512896 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ada7a0d4-12f0-4816-9096-14494f304cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:35.583879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 855/1707] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:35.586235 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde011c-3c75-441e-a8a5-86d5e49d4e3b None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:35.590630 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7cde011c-3c75-441e-a8a5-86d5e49d4e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:35.633041 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:35.716215 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 853/1708] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:12:35.717397 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7a0d4-12f0-4816-9096-14494f304cab None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:35.719029 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ada7a0d4-12f0-4816-9096-14494f304cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:35.760362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde011c-3c75-441e-a8a5-86d5e49d4e3b None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:35.774290 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6360d-c728-4e7a-ad23-b09e8f66bd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:35.774944 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6360d-c728-4e7a-ad23-b09e8f66bd83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:35.775222 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6360d-c728-4e7a-ad23-b09e8f66bd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:35.775492 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6360d-c728-4e7a-ad23-b09e8f66bd83 admin admin] PATH_INFO: `/v3/projects/0c0e5f40ba1f4d2eb44d2872617c970a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:35.777592 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6360d-c728-4e7a-ad23-b09e8f66bd83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c0e5f40ba1f4d2eb44d2872617c970a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:35.782385 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6360d-c728-4e7a-ad23-b09e8f66bd83 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:35.902969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7a0d4-12f0-4816-9096-14494f304cab None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:35.955878 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d8d6360d-c728-4e7a-ad23-b09e8f66bd83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c0e5f40ba1f4d2eb44d2872617c970a', 'request_id': 'req-d8d6360d-c728-4e7a-ad23-b09e8f66bd83'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:35.980012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d8d6360d-c728-4e7a-ad23-b09e8f66bd83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c0e5f40ba1f4d2eb44d2872617c970a', 'request_id': 'req-d8d6360d-c728-4e7a-ad23-b09e8f66bd83'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:36.005732 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d8d6360d-c728-4e7a-ad23-b09e8f66bd83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c0e5f40ba1f4d2eb44d2872617c970a', 'request_id': 'req-d8d6360d-c728-4e7a-ad23-b09e8f66bd83'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:36.047354 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d8d6360d-c728-4e7a-ad23-b09e8f66bd83 admin admin] The token cache is being invalidate because project 0c0e5f40ba1f4d2eb44d2872617c970a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:12:36.047354 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d8d6360d-c728-4e7a-ad23-b09e8f66bd83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:36.060948 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d8d6360d-c728-4e7a-ad23-b09e8f66bd83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:36.070139 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 856/1709] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:12:35 2022] DELETE /identity/v3/projects/0c0e5f40ba1f4d2eb44d2872617c970a => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:36.076812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccc66a-942c-4ee5-9235-95c47801d7d2 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:36.078739 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560cd31-5455-408b-84fa-437d77fe3619 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:36.079316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560cd31-5455-408b-84fa-437d77fe3619 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:36.079596 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560cd31-5455-408b-84fa-437d77fe3619 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:36.079901 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560cd31-5455-408b-84fa-437d77fe3619 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:36.086319 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccc66a-942c-4ee5-9235-95c47801d7d2 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:36.086963 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccc66a-942c-4ee5-9235-95c47801d7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:36.101131 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7560cd31-5455-408b-84fa-437d77fe3619 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:36.145981 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:36.187628 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a9ccc66a-942c-4ee5-9235-95c47801d7d2 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:36.188863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a9ccc66a-942c-4ee5-9235-95c47801d7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:36.241313 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560cd31-5455-408b-84fa-437d77fe3619 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:36.243470 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560cd31-5455-408b-84fa-437d77fe3619 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:36.272347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 854/1710] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:35 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:36.281463 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7a7c6-2f9f-4941-8ae6-b57165ea375d None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:36.281799 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7a7c6-2f9f-4941-8ae6-b57165ea375d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:36.282086 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7a7c6-2f9f-4941-8ae6-b57165ea375d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:36.342828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 857/1711] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:36.344579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccc66a-942c-4ee5-9235-95c47801d7d2 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:36.359056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-72b7a7c6-2f9f-4941-8ae6-b57165ea375d None None] MFA Rules not processed for user `c8289ecbf04143b1a136f876b1467c67`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:36.359959 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a9ccc66a-942c-4ee5-9235-95c47801d7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:36.360068 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-72b7a7c6-2f9f-4941-8ae6-b57165ea375d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:36.390600 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccc66a-942c-4ee5-9235-95c47801d7d2 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:36.406448 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c44c8e-9025-4b28-8fa6-ba58c1f1a06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:36.407276 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c44c8e-9025-4b28-8fa6-ba58c1f1a06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:36.407556 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c44c8e-9025-4b28-8fa6-ba58c1f1a06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:36.408024 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c44c8e-9025-4b28-8fa6-ba58c1f1a06f admin admin] PATH_INFO: `/v3/users/2224e04c851f48a6b1b0b5a570a93613` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:36.409819 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c44c8e-9025-4b28-8fa6-ba58c1f1a06f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2224e04c851f48a6b1b0b5a570a93613)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:36.412211 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c44c8e-9025-4b28-8fa6-ba58c1f1a06f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:36.509277 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 855/1712] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:36.512844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7a7c6-2f9f-4941-8ae6-b57165ea375d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:36.535393 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:36.542042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7a7c6-2f9f-4941-8ae6-b57165ea375d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:36.559132 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1b453-0d81-4f60-a449-330bd2584eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:36.560463 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1b453-0d81-4f60-a449-330bd2584eae admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:36.560750 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1b453-0d81-4f60-a449-330bd2584eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:36.561072 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1b453-0d81-4f60-a449-330bd2584eae admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:36.561805 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1b453-0d81-4f60-a449-330bd2584eae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:12:36.562113 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1b453-0d81-4f60-a449-330bd2584eae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:36.567717 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d6c44c8e-9025-4b28-8fa6-ba58c1f1a06f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2224e04c851f48a6b1b0b5a570a93613'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:36.570359 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1b453-0d81-4f60-a449-330bd2584eae admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:36.587964 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d6c44c8e-9025-4b28-8fa6-ba58c1f1a06f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2224e04c851f48a6b1b0b5a570a93613'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:36.610834 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 856/1713] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:12:36.614735 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1b453-0d81-4f60-a449-330bd2584eae admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:36.621971 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d6c44c8e-9025-4b28-8fa6-ba58c1f1a06f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2224e04c851f48a6b1b0b5a570a93613'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:36.624002 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d6c44c8e-9025-4b28-8fa6-ba58c1f1a06f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2224e04c851f48a6b1b0b5a570a93613'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:36.640576 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-dad1b453-0d81-4f60-a449-330bd2584eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:36.649872 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d6c44c8e-9025-4b28-8fa6-ba58c1f1a06f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2224e04c851f48a6b1b0b5a570a93613'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:36.676910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1b453-0d81-4f60-a449-330bd2584eae admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:36.683084 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 858/1714] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:12:36 2022] DELETE /identity/v3/users/2224e04c851f48a6b1b0b5a570a93613 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:36.688891 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c44c8e-9025-4b28-8fa6-ba58c1f1a06f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:36.696768 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d6c44c8e-9025-4b28-8fa6-ba58c1f1a06f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:36.776844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0a44c-d0c8-4e0c-944b-3326f2daaf05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:36.778010 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0a44c-d0c8-4e0c-944b-3326f2daaf05 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:36.778960 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0a44c-d0c8-4e0c-944b-3326f2daaf05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:36.778960 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0a44c-d0c8-4e0c-944b-3326f2daaf05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:36.781575 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2dc0a44c-d0c8-4e0c-944b-3326f2daaf05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:36.873391 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:36.915570 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0a44c-d0c8-4e0c-944b-3326f2daaf05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:36.920558 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0a44c-d0c8-4e0c-944b-3326f2daaf05 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:36.946234 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 857/1715] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:36.947853 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0a44c-d0c8-4e0c-944b-3326f2daaf05 service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:36.951499 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2dc0a44c-d0c8-4e0c-944b-3326f2daaf05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:36.992792 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c44c8e-9025-4b28-8fa6-ba58c1f1a06f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:37.030460 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ae2bf-6846-4f87-9441-07d28fa858c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:37.035238 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ae2bf-6846-4f87-9441-07d28fa858c2 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:37.035637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ae2bf-6846-4f87-9441-07d28fa858c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:37.035847 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ae2bf-6846-4f87-9441-07d28fa858c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:37.048422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-908ae2bf-6846-4f87-9441-07d28fa858c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:37.099358 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0a44c-d0c8-4e0c-944b-3326f2daaf05 service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:37.106455 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cfb42-3781-4ae6-a21d-64042cef8d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:37.108262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cfb42-3781-4ae6-a21d-64042cef8d21 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:37.108262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cfb42-3781-4ae6-a21d-64042cef8d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:37.108661 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cfb42-3781-4ae6-a21d-64042cef8d21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:37.109458 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cfb42-3781-4ae6-a21d-64042cef8d21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:37.114428 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cfb42-3781-4ae6-a21d-64042cef8d21 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:37.172932 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 858/1716] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:12:36 2022] POST /identity/v3/projects => generated 363 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:37.177407 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa9fe6-c5b1-4497-8460-14c22ae7bf41 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:37.178508 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa9fe6-c5b1-4497-8460-14c22ae7bf41 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:37.180116 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa9fe6-c5b1-4497-8460-14c22ae7bf41 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:37.190558 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 859/1717] 10.222.0.26 () {54 vars in 912 bytes} [Tue Sep 13 14:12:37 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:12:37.194833 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa9fe6-c5b1-4497-8460-14c22ae7bf41 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:37.200620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0baa9fe6-c5b1-4497-8460-14c22ae7bf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:37.219083 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ae2bf-6846-4f87-9441-07d28fa858c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:37.220832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ae2bf-6846-4f87-9441-07d28fa858c2 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:37.248549 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 859/1718] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:37.249477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ae2bf-6846-4f87-9441-07d28fa858c2 service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:37.273700 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ae2bf-6846-4f87-9441-07d28fa858c2 service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:37.390027 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:37.421602 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec466b-eb49-4c2a-9736-aa6036fa8210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:37.422349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec466b-eb49-4c2a-9736-aa6036fa8210 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:37.422693 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec466b-eb49-4c2a-9736-aa6036fa8210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:37.423214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec466b-eb49-4c2a-9736-aa6036fa8210 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:37.424056 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec466b-eb49-4c2a-9736-aa6036fa8210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:37.426366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec466b-eb49-4c2a-9736-aa6036fa8210 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:37.474291 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa9fe6-c5b1-4497-8460-14c22ae7bf41 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:37.475920 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 860/1719] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:12:37 2022] POST /identity/v3/users => generated 282 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:37.479881 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d561337-ad66-4418-847c-8421e3d98603 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:37.480333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d561337-ad66-4418-847c-8421e3d98603 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:37.480757 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d561337-ad66-4418-847c-8421e3d98603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:37.499503 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ef790-c2d5-4c5e-b2fe-4b43581b7a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:37.500164 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ef790-c2d5-4c5e-b2fe-4b43581b7a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:37.500438 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ef790-c2d5-4c5e-b2fe-4b43581b7a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:37.500765 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ef790-c2d5-4c5e-b2fe-4b43581b7a53 admin admin] PATH_INFO: `/v3/projects/61d067e39e2e4f8e9d54fc7afb6d1c46` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:37.502314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ef790-c2d5-4c5e-b2fe-4b43581b7a53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61d067e39e2e4f8e9d54fc7afb6d1c46)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:37.504898 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ef790-c2d5-4c5e-b2fe-4b43581b7a53 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:37.582707 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-2d561337-ad66-4418-847c-8421e3d98603 None None] MFA Rules not processed for user `cb992cf1a7a445119262b567ce345181`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:37.584536 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2d561337-ad66-4418-847c-8421e3d98603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:37.608589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5b2ef790-c2d5-4c5e-b2fe-4b43581b7a53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61d067e39e2e4f8e9d54fc7afb6d1c46', 'request_id': 'req-5b2ef790-c2d5-4c5e-b2fe-4b43581b7a53'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:37.628170 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5b2ef790-c2d5-4c5e-b2fe-4b43581b7a53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61d067e39e2e4f8e9d54fc7afb6d1c46', 'request_id': 'req-5b2ef790-c2d5-4c5e-b2fe-4b43581b7a53'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:37.640384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5b2ef790-c2d5-4c5e-b2fe-4b43581b7a53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61d067e39e2e4f8e9d54fc7afb6d1c46', 'request_id': 'req-5b2ef790-c2d5-4c5e-b2fe-4b43581b7a53'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:37.664475 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:37.664747 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 861/1720] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 13 14:12:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:37.666102 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d561337-ad66-4418-847c-8421e3d98603 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:37.685982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5b2ef790-c2d5-4c5e-b2fe-4b43581b7a53 admin admin] The token cache is being invalidate because project 61d067e39e2e4f8e9d54fc7afb6d1c46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:12:37.686413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5b2ef790-c2d5-4c5e-b2fe-4b43581b7a53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:37.689061 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5b2ef790-c2d5-4c5e-b2fe-4b43581b7a53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:37.695389 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 860/1721] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:12:37 2022] DELETE /identity/v3/projects/61d067e39e2e4f8e9d54fc7afb6d1c46 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:37.699611 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc430dd4-3def-4359-b4b5-feddb634a254 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:37.699932 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc430dd4-3def-4359-b4b5-feddb634a254 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:37.700718 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc430dd4-3def-4359-b4b5-feddb634a254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:37.786224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-fc430dd4-3def-4359-b4b5-feddb634a254 None None] MFA Rules not processed for user `d80c0ee007b24a22b08e91ef863d330b`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:37.790230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-fc430dd4-3def-4359-b4b5-feddb634a254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:37.846662 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d561337-ad66-4418-847c-8421e3d98603 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:37.853381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f07fd3-d10d-45f3-a871-6aa97cc3c829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:37.854318 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f07fd3-d10d-45f3-a871-6aa97cc3c829 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:37.854737 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f07fd3-d10d-45f3-a871-6aa97cc3c829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:37.856788 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f07fd3-d10d-45f3-a871-6aa97cc3c829 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:37.858050 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f07fd3-d10d-45f3-a871-6aa97cc3c829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:37.861383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f07fd3-d10d-45f3-a871-6aa97cc3c829 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:37.877078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 862/1722] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:37.878835 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f07fd3-d10d-45f3-a871-6aa97cc3c829 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:37.881935 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b1f07fd3-d10d-45f3-a871-6aa97cc3c829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:37.905147 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f07fd3-d10d-45f3-a871-6aa97cc3c829 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:37.914744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3950471-9982-4939-8bdf-afa54e9632d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:37.915887 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3950471-9982-4939-8bdf-afa54e9632d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:37.916576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3950471-9982-4939-8bdf-afa54e9632d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:37.917068 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3950471-9982-4939-8bdf-afa54e9632d2 admin admin] PATH_INFO: `/v3/users/6a043c6aeaf74738b9c12011ba8cd8c9` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:37.919288 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3950471-9982-4939-8bdf-afa54e9632d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a043c6aeaf74738b9c12011ba8cd8c9)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:37.922485 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3950471-9982-4939-8bdf-afa54e9632d2 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:37.980677 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 861/1723] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:37.981780 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc430dd4-3def-4359-b4b5-feddb634a254 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:37.985721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-fc430dd4-3def-4359-b4b5-feddb634a254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:37.996517 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a3950471-9982-4939-8bdf-afa54e9632d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a043c6aeaf74738b9c12011ba8cd8c9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:38.009869 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a3950471-9982-4939-8bdf-afa54e9632d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a043c6aeaf74738b9c12011ba8cd8c9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:38.013478 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc430dd4-3def-4359-b4b5-feddb634a254 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:38.022336 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454353eb-d925-45b8-be38-4f18e3c75c34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:38.022791 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:38.026560 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454353eb-d925-45b8-be38-4f18e3c75c34 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:38.030644 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454353eb-d925-45b8-be38-4f18e3c75c34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:38.030805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a3950471-9982-4939-8bdf-afa54e9632d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a043c6aeaf74738b9c12011ba8cd8c9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:38.031769 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454353eb-d925-45b8-be38-4f18e3c75c34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:38.031913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a3950471-9982-4939-8bdf-afa54e9632d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a043c6aeaf74738b9c12011ba8cd8c9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:38.036383 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-454353eb-d925-45b8-be38-4f18e3c75c34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:38.045585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a3950471-9982-4939-8bdf-afa54e9632d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a043c6aeaf74738b9c12011ba8cd8c9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:38.054100 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 863/1724] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:12:37 2022] DELETE /identity/v3/users/6a043c6aeaf74738b9c12011ba8cd8c9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:38.060440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3950471-9982-4939-8bdf-afa54e9632d2 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:38.062119 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a3950471-9982-4939-8bdf-afa54e9632d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:38.066106 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454353eb-d925-45b8-be38-4f18e3c75c34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:38.071003 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454353eb-d925-45b8-be38-4f18e3c75c34 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:38.092283 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 862/1725] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:38.094277 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454353eb-d925-45b8-be38-4f18e3c75c34 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:38.097714 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-454353eb-d925-45b8-be38-4f18e3c75c34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:38.134236 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454353eb-d925-45b8-be38-4f18e3c75c34 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:38.178697 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3950471-9982-4939-8bdf-afa54e9632d2 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:38.186036 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f82454-ec3e-4b6b-8148-32505f5342ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:38.186951 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f82454-ec3e-4b6b-8148-32505f5342ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:38.187431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f82454-ec3e-4b6b-8148-32505f5342ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:38.188380 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f82454-ec3e-4b6b-8148-32505f5342ba admin admin] PATH_INFO: `/v3/projects/4150ba4ed3cc492387b59e5c4c1194a1` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:38.190235 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f82454-ec3e-4b6b-8148-32505f5342ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=4150ba4ed3cc492387b59e5c4c1194a1)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:38.193012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f82454-ec3e-4b6b-8148-32505f5342ba admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:38.268909 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf0dfe-1439-4655-ad0c-13577afa6f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:38.270005 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf0dfe-1439-4655-ad0c-13577afa6f55 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:38.271619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf0dfe-1439-4655-ad0c-13577afa6f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:38.273003 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf0dfe-1439-4655-ad0c-13577afa6f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:38.276973 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf0dfe-1439-4655-ad0c-13577afa6f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:38.279884 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf0dfe-1439-4655-ad0c-13577afa6f55 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:38.320371 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 863/1726] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:38.329113 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eea877-9c3f-4369-919a-0bee142aba7a None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:38.334340 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eea877-9c3f-4369-919a-0bee142aba7a None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:38.334737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eea877-9c3f-4369-919a-0bee142aba7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:38.357407 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-14f82454-ec3e-4b6b-8148-32505f5342ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4150ba4ed3cc492387b59e5c4c1194a1', 'request_id': 'req-14f82454-ec3e-4b6b-8148-32505f5342ba'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:38.370782 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-14f82454-ec3e-4b6b-8148-32505f5342ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4150ba4ed3cc492387b59e5c4c1194a1', 'request_id': 'req-14f82454-ec3e-4b6b-8148-32505f5342ba'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:38.386254 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-14f82454-ec3e-4b6b-8148-32505f5342ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4150ba4ed3cc492387b59e5c4c1194a1', 'request_id': 'req-14f82454-ec3e-4b6b-8148-32505f5342ba'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:38.389625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-13eea877-9c3f-4369-919a-0bee142aba7a None None] MFA Rules not processed for user `d80c0ee007b24a22b08e91ef863d330b`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:38.390874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-13eea877-9c3f-4369-919a-0bee142aba7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:38.406541 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-14f82454-ec3e-4b6b-8148-32505f5342ba admin admin] The token cache is being invalidate because project 4150ba4ed3cc492387b59e5c4c1194a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:12:38.406831 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-14f82454-ec3e-4b6b-8148-32505f5342ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:38.408045 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-14f82454-ec3e-4b6b-8148-32505f5342ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:38.415932 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 864/1727] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:12:38 2022] DELETE /identity/v3/projects/4150ba4ed3cc492387b59e5c4c1194a1 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:38.417307 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f82454-ec3e-4b6b-8148-32505f5342ba admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:38.419983 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-14f82454-ec3e-4b6b-8148-32505f5342ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:38.540927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f82454-ec3e-4b6b-8148-32505f5342ba admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:38.557115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43b6ca-c3e9-4da9-a637-36389ab32e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:38.560418 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43b6ca-c3e9-4da9-a637-36389ab32e18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:38.560780 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43b6ca-c3e9-4da9-a637-36389ab32e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:38.561122 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43b6ca-c3e9-4da9-a637-36389ab32e18 admin admin] PATH_INFO: `/v3/projects/bfcc6d9b2c1640edaf770536f0e21b65/users/ac2ceb85af3a4f90bfd37bde26b7d555/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:38.584390 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43b6ca-c3e9-4da9-a637-36389ab32e18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfcc6d9b2c1640edaf770536f0e21b65, user_id=ac2ceb85af3a4f90bfd37bde26b7d555, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:38.587709 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43b6ca-c3e9-4da9-a637-36389ab32e18 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:38.592355 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:38.609286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 864/1728] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:38.617739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 865/1729] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:12:38 2022] PUT /identity/v3/projects/bfcc6d9b2c1640edaf770536f0e21b65/users/ac2ceb85af3a4f90bfd37bde26b7d555/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:38.618541 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f690c-b72d-4a12-804e-25f644d5cc61 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:38.619047 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f690c-b72d-4a12-804e-25f644d5cc61 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:38.619331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f690c-b72d-4a12-804e-25f644d5cc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:38.640686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807fcb8-0d59-4f8e-8d2a-616a912bf2ce None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:38.641651 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807fcb8-0d59-4f8e-8d2a-616a912bf2ce None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:38.642520 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807fcb8-0d59-4f8e-8d2a-616a912bf2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:38.655970 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-815f690c-b72d-4a12-804e-25f644d5cc61 None None] MFA Rules not processed for user `a06ffa78739345039aff49f6fb524b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:38.658117 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-815f690c-b72d-4a12-804e-25f644d5cc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:38.722425 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-f807fcb8-0d59-4f8e-8d2a-616a912bf2ce None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:38.728017 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f807fcb8-0d59-4f8e-8d2a-616a912bf2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:38.766587 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:38.795022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 866/1730] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:38.805649 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dabb34-0ad9-4442-a2c9-226e8046c7d0 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:38.806186 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dabb34-0ad9-4442-a2c9-226e8046c7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:38.806515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dabb34-0ad9-4442-a2c9-226e8046c7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:38.940313 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 865/1731] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:38.942411 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807fcb8-0d59-4f8e-8d2a-616a912bf2ce None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:38.950869 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f807fcb8-0d59-4f8e-8d2a-616a912bf2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:38.997758 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-07dabb34-0ad9-4442-a2c9-226e8046c7d0 None None] MFA Rules not processed for user `ac2ceb85af3a4f90bfd37bde26b7d555`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:38.999662 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-07dabb34-0ad9-4442-a2c9-226e8046c7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:39.209878 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807fcb8-0d59-4f8e-8d2a-616a912bf2ce None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:39.225043 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34070948-0426-4760-85fd-dffd46328c13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:39.226319 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34070948-0426-4760-85fd-dffd46328c13 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:39.226707 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34070948-0426-4760-85fd-dffd46328c13 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:39.227090 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34070948-0426-4760-85fd-dffd46328c13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:39.230685 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-34070948-0426-4760-85fd-dffd46328c13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:39.317037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 867/1732] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 518 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:39.317037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232f61c-57cf-442a-8ab3-ced34a3b971e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:39.317037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232f61c-57cf-442a-8ab3-ced34a3b971e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:39.317037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232f61c-57cf-442a-8ab3-ced34a3b971e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:39.376167 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-9232f61c-57cf-442a-8ab3-ced34a3b971e None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:39.380041 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9232f61c-57cf-442a-8ab3-ced34a3b971e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:39.427724 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 868/1733] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:39.429220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232f61c-57cf-442a-8ab3-ced34a3b971e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:39.436549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34070948-0426-4760-85fd-dffd46328c13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:39.438278 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34070948-0426-4760-85fd-dffd46328c13 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:39.461254 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232f61c-57cf-442a-8ab3-ced34a3b971e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:39.476502 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f561540-ba18-4f73-adfd-93f0504d8d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:39.477178 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f561540-ba18-4f73-adfd-93f0504d8d3a admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:39.477464 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f561540-ba18-4f73-adfd-93f0504d8d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:39.477736 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f561540-ba18-4f73-adfd-93f0504d8d3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:39.478858 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 866/1734] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:39.479762 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34070948-0426-4760-85fd-dffd46328c13 service nova] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:39.483390 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f561540-ba18-4f73-adfd-93f0504d8d3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:39.483727 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-34070948-0426-4760-85fd-dffd46328c13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:39.485437 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f561540-ba18-4f73-adfd-93f0504d8d3a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:39.523730 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34070948-0426-4760-85fd-dffd46328c13 service nova] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:39.541928 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360f28d-6000-40a2-b083-cd13ad6511d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:39.543398 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360f28d-6000-40a2-b083-cd13ad6511d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:39.544660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360f28d-6000-40a2-b083-cd13ad6511d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:39.545258 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360f28d-6000-40a2-b083-cd13ad6511d2 admin admin] PATH_INFO: `/v3/projects/c1f724adab5549428b92177e5429a829` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:39.554183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360f28d-6000-40a2-b083-cd13ad6511d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1f724adab5549428b92177e5429a829)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:39.556597 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360f28d-6000-40a2-b083-cd13ad6511d2 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:39.569576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 869/1735] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:12:39 2022] POST /identity/v3/projects => generated 365 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:39.570346 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f561540-ba18-4f73-adfd-93f0504d8d3a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:39.575713 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4f561540-ba18-4f73-adfd-93f0504d8d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:39.706090 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:39.733597 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-e360f28d-6000-40a2-b083-cd13ad6511d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1f724adab5549428b92177e5429a829', 'request_id': 'req-e360f28d-6000-40a2-b083-cd13ad6511d2'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:39.742819 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:39.747774 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-e360f28d-6000-40a2-b083-cd13ad6511d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1f724adab5549428b92177e5429a829', 'request_id': 'req-e360f28d-6000-40a2-b083-cd13ad6511d2'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:39.753412 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f561540-ba18-4f73-adfd-93f0504d8d3a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:39.771775 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-e360f28d-6000-40a2-b083-cd13ad6511d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1f724adab5549428b92177e5429a829', 'request_id': 'req-e360f28d-6000-40a2-b083-cd13ad6511d2'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:39.828010 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-e360f28d-6000-40a2-b083-cd13ad6511d2 admin admin] The token cache is being invalidate because project c1f724adab5549428b92177e5429a829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:12:39.828330 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-e360f28d-6000-40a2-b083-cd13ad6511d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:39.834700 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-e360f28d-6000-40a2-b083-cd13ad6511d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:39.837899 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 867/1736] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:12:39 2022] DELETE /identity/v3/projects/c1f724adab5549428b92177e5429a829 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:39.838540 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360f28d-6000-40a2-b083-cd13ad6511d2 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:39.842033 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e360f28d-6000-40a2-b083-cd13ad6511d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:39.890897 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46997dee-e5f1-4ad1-8916-cb5ac2c170ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311397bfe2c04569852fca0cfcdbad66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:39.896686 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46997dee-e5f1-4ad1-8916-cb5ac2c170ef service placement] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:39.897945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46997dee-e5f1-4ad1-8916-cb5ac2c170ef service placement] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:39.905603 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46997dee-e5f1-4ad1-8916-cb5ac2c170ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:39.909703 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-46997dee-e5f1-4ad1-8916-cb5ac2c170ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:39.935039 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46997dee-e5f1-4ad1-8916-cb5ac2c170ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:39.955764 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46997dee-e5f1-4ad1-8916-cb5ac2c170ef service placement] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:40.002431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 870/1737] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:40.005834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46997dee-e5f1-4ad1-8916-cb5ac2c170ef service placement] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:40.019339 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-46997dee-e5f1-4ad1-8916-cb5ac2c170ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:40.060008 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46997dee-e5f1-4ad1-8916-cb5ac2c170ef service placement] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:40.067299 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360f28d-6000-40a2-b083-cd13ad6511d2 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:40.094831 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42213e91-4a4a-4549-841a-b8c2eb656467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:40.095049 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a1a20-6289-4951-b225-03ccde69fc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:40.095476 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42213e91-4a4a-4549-841a-b8c2eb656467 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:40.095771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42213e91-4a4a-4549-841a-b8c2eb656467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:40.096026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42213e91-4a4a-4549-841a-b8c2eb656467 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:40.096654 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42213e91-4a4a-4549-841a-b8c2eb656467 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:40.098667 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42213e91-4a4a-4549-841a-b8c2eb656467 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:40.099200 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a1a20-6289-4951-b225-03ccde69fc7a admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:40.100770 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a1a20-6289-4951-b225-03ccde69fc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:40.101992 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a1a20-6289-4951-b225-03ccde69fc7a admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:40.105127 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a1a20-6289-4951-b225-03ccde69fc7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:12:40.105936 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a1a20-6289-4951-b225-03ccde69fc7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:40.111266 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a1a20-6289-4951-b225-03ccde69fc7a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:40.160414 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 871/1738] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:12:40 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:40.167281 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ebba7-29cd-4974-b1e0-27c30afb978e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:40.168100 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ebba7-29cd-4974-b1e0-27c30afb978e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:40.171961 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ebba7-29cd-4974-b1e0-27c30afb978e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:40.178659 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 868/1739] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:12:40.184262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a1a20-6289-4951-b225-03ccde69fc7a admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:40.221206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f89ebba7-29cd-4974-b1e0-27c30afb978e None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:40.222527 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f89ebba7-29cd-4974-b1e0-27c30afb978e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:40.232055 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a1a20-6289-4951-b225-03ccde69fc7a admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:40.257709 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 872/1740] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:40.258889 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ebba7-29cd-4974-b1e0-27c30afb978e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:40.269284 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85ce51-5f5b-4bc2-b30d-8fcf1be2c9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:40.270335 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85ce51-5f5b-4bc2-b30d-8fcf1be2c9ca admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:40.270771 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85ce51-5f5b-4bc2-b30d-8fcf1be2c9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:40.271209 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85ce51-5f5b-4bc2-b30d-8fcf1be2c9ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:40.272015 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85ce51-5f5b-4bc2-b30d-8fcf1be2c9ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:40.274129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85ce51-5f5b-4bc2-b30d-8fcf1be2c9ca admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:40.282670 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ebba7-29cd-4974-b1e0-27c30afb978e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:40.298702 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79179ba1-d196-41e4-b11d-e60c5600f2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:40.299330 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79179ba1-d196-41e4-b11d-e60c5600f2e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:40.299630 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79179ba1-d196-41e4-b11d-e60c5600f2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:40.299901 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79179ba1-d196-41e4-b11d-e60c5600f2e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:40.300535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79179ba1-d196-41e4-b11d-e60c5600f2e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:40.306034 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79179ba1-d196-41e4-b11d-e60c5600f2e8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:40.340071 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 869/1741] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:40.351304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6114cc-db2a-4058-97cb-5221ca54e629 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:40.351612 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6114cc-db2a-4058-97cb-5221ca54e629 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:40.351883 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6114cc-db2a-4058-97cb-5221ca54e629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:40.381075 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 873/1742] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:12:40 2022] POST /identity/v3/projects => generated 399 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:40.381975 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79179ba1-d196-41e4-b11d-e60c5600f2e8 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:40.431306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-4f6114cc-db2a-4058-97cb-5221ca54e629 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:40.432751 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4f6114cc-db2a-4058-97cb-5221ca54e629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:40.520926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79179ba1-d196-41e4-b11d-e60c5600f2e8 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:40.550062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a17ba6-9c64-4805-8900-e425d2eee1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:40.550834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a17ba6-9c64-4805-8900-e425d2eee1f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:40.551116 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a17ba6-9c64-4805-8900-e425d2eee1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:40.551515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a17ba6-9c64-4805-8900-e425d2eee1f0 admin admin] PATH_INFO: `/v3/projects/2d39c501072a4aeba158dc656c6075bb/users/9b9db2508cb2467b867da940f4b0e37a/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:40.600975 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a17ba6-9c64-4805-8900-e425d2eee1f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d39c501072a4aeba158dc656c6075bb, user_id=9b9db2508cb2467b867da940f4b0e37a, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:40.612984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a17ba6-9c64-4805-8900-e425d2eee1f0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:40.685137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 874/1743] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:12:40 2022] PUT /identity/v3/projects/2d39c501072a4aeba158dc656c6075bb/users/9b9db2508cb2467b867da940f4b0e37a/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:40.687830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 870/1744] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:40.688122 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a17ba6-9c64-4805-8900-e425d2eee1f0 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:40.693603 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6114cc-db2a-4058-97cb-5221ca54e629 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:40.739120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6114cc-db2a-4058-97cb-5221ca54e629 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:40.845717 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:40.928674 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a17ba6-9c64-4805-8900-e425d2eee1f0 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:40.941138 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355cb1c-cf70-4cd9-a974-951e31819870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:40.942100 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355cb1c-cf70-4cd9-a974-951e31819870 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:40.942714 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355cb1c-cf70-4cd9-a974-951e31819870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:40.943031 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355cb1c-cf70-4cd9-a974-951e31819870 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:40.946483 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355cb1c-cf70-4cd9-a974-951e31819870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:40.960594 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb2dac-b7a8-4365-9b1d-0dd816e5175c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:40.961824 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb2dac-b7a8-4365-9b1d-0dd816e5175c admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:40.962114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb2dac-b7a8-4365-9b1d-0dd816e5175c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:40.962378 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb2dac-b7a8-4365-9b1d-0dd816e5175c admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:40.965769 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb2dac-b7a8-4365-9b1d-0dd816e5175c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:40.965900 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355cb1c-cf70-4cd9-a974-951e31819870 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:40.967137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb2dac-b7a8-4365-9b1d-0dd816e5175c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:40.974823 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:41.025842 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 871/1745] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:41.026828 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb2dac-b7a8-4365-9b1d-0dd816e5175c admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:41.029714 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 875/1746] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:12:40 2022] POST /identity/v3/users => generated 300 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:41.036392 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355cb1c-cf70-4cd9-a974-951e31819870 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:41.046957 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5355cb1c-cf70-4cd9-a974-951e31819870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:41.069774 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb2dac-b7a8-4365-9b1d-0dd816e5175c admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:41.089283 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355cb1c-cf70-4cd9-a974-951e31819870 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:41.091108 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d93da4-9970-40d3-bb6a-1a2cd6bc4fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:41.091353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d93da4-9970-40d3-bb6a-1a2cd6bc4fbf admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:41.091654 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d93da4-9970-40d3-bb6a-1a2cd6bc4fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:41.091918 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d93da4-9970-40d3-bb6a-1a2cd6bc4fbf admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:41.092589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d93da4-9970-40d3-bb6a-1a2cd6bc4fbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:12:41.095361 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d93da4-9970-40d3-bb6a-1a2cd6bc4fbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:41.098073 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d93da4-9970-40d3-bb6a-1a2cd6bc4fbf admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:41.102891 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaee9d1-82b9-4647-a149-7c08b0a6da5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:41.103546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaee9d1-82b9-4647-a149-7c08b0a6da5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:41.103832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaee9d1-82b9-4647-a149-7c08b0a6da5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:41.104465 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaee9d1-82b9-4647-a149-7c08b0a6da5e admin admin] PATH_INFO: `/v3/users/3068c197f338402ab7b91fb727b2d31c` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:41.105300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaee9d1-82b9-4647-a149-7c08b0a6da5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3068c197f338402ab7b91fb727b2d31c)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:41.107864 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaee9d1-82b9-4647-a149-7c08b0a6da5e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:41.134722 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 872/1747] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:12:41.135680 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d93da4-9970-40d3-bb6a-1a2cd6bc4fbf admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:41.161502 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d93da4-9970-40d3-bb6a-1a2cd6bc4fbf admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:41.175642 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da3c29-775c-4eed-ad8e-e452f18567ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:41.176588 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da3c29-775c-4eed-ad8e-e452f18567ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:41.177046 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da3c29-775c-4eed-ad8e-e452f18567ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:41.177605 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da3c29-775c-4eed-ad8e-e452f18567ab admin admin] PATH_INFO: `/v3/projects/2d39c501072a4aeba158dc656c6075bb/users/9b9db2508cb2467b867da940f4b0e37a/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:41.181503 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da3c29-775c-4eed-ad8e-e452f18567ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d39c501072a4aeba158dc656c6075bb, user_id=9b9db2508cb2467b867da940f4b0e37a, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:41.188212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da3c29-775c-4eed-ad8e-e452f18567ab admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:41.209402 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-eeaee9d1-82b9-4647-a149-7c08b0a6da5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3068c197f338402ab7b91fb727b2d31c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:41.215910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 873/1748] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:12:41 2022] PUT /identity/v3/projects/2d39c501072a4aeba158dc656c6075bb/users/9b9db2508cb2467b867da940f4b0e37a/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:41.216774 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da3c29-775c-4eed-ad8e-e452f18567ab admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:41.222149 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-eeaee9d1-82b9-4647-a149-7c08b0a6da5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3068c197f338402ab7b91fb727b2d31c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:41.242143 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-eeaee9d1-82b9-4647-a149-7c08b0a6da5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3068c197f338402ab7b91fb727b2d31c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:41.242975 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-eeaee9d1-82b9-4647-a149-7c08b0a6da5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3068c197f338402ab7b91fb727b2d31c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:41.253392 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-eeaee9d1-82b9-4647-a149-7c08b0a6da5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3068c197f338402ab7b91fb727b2d31c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:41.265009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 876/1749] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:12:41 2022] DELETE /identity/v3/users/3068c197f338402ab7b91fb727b2d31c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:41.265009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e4b08-a0f1-4bea-b0f6-9baae362f4d9 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:41.265306 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e4b08-a0f1-4bea-b0f6-9baae362f4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:41.266099 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e4b08-a0f1-4bea-b0f6-9baae362f4d9 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:41.267501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 877/1750] 10.222.0.26 () {54 vars in 912 bytes} [Tue Sep 13 14:12:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:12:41.268784 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e4b08-a0f1-4bea-b0f6-9baae362f4d9 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:41.270853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-935e4b08-a0f1-4bea-b0f6-9baae362f4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:41.392420 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e4b08-a0f1-4bea-b0f6-9baae362f4d9 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:41.393242 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da3c29-775c-4eed-ad8e-e452f18567ab admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:41.401332 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac22f4-e16a-4053-8993-0758846341cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:41.402687 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac22f4-e16a-4053-8993-0758846341cf admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:41.403113 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac22f4-e16a-4053-8993-0758846341cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:41.408525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac22f4-e16a-4053-8993-0758846341cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:41.410335 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac22f4-e16a-4053-8993-0758846341cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:41.412305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac22f4-e16a-4053-8993-0758846341cf admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:41.419286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf7aa8-8943-47c3-aa02-70e902395ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:41.420008 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf7aa8-8943-47c3-aa02-70e902395ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:41.420295 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf7aa8-8943-47c3-aa02-70e902395ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:41.420565 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf7aa8-8943-47c3-aa02-70e902395ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:41.421275 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf7aa8-8943-47c3-aa02-70e902395ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:41.422995 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf7aa8-8943-47c3-aa02-70e902395ab8 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:41.455172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 874/1751] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:41.467837 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13a808-84bb-4d94-94b8-522ebc6e54b0 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:41.468140 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13a808-84bb-4d94-94b8-522ebc6e54b0 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:41.468409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13a808-84bb-4d94-94b8-522ebc6e54b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:41.501470 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 878/1752] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:12:41 2022] POST /identity/v3/projects => generated 377 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:41.513354 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8014a5c-d3fe-4e5a-849d-5d0a0774ddec None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:41.513651 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8014a5c-d3fe-4e5a-849d-5d0a0774ddec None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:41.520692 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8014a5c-d3fe-4e5a-849d-5d0a0774ddec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:41.573170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f8014a5c-d3fe-4e5a-849d-5d0a0774ddec None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:41.575916 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-1a13a808-84bb-4d94-94b8-522ebc6e54b0 None None] MFA Rules not processed for user `9b9db2508cb2467b867da940f4b0e37a`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:41.577502 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f8014a5c-d3fe-4e5a-849d-5d0a0774ddec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:41.577900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1a13a808-84bb-4d94-94b8-522ebc6e54b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:41.636412 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:41.732669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 879/1753] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:41.736628 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbddc6b0-37f2-48e0-bc0f-8b73ec47889e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:41.736918 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbddc6b0-37f2-48e0-bc0f-8b73ec47889e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:41.737216 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbddc6b0-37f2-48e0-bc0f-8b73ec47889e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:41.790934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-cbddc6b0-37f2-48e0-bc0f-8b73ec47889e None None] MFA Rules not processed for user `cb992cf1a7a445119262b567ce345181`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:41.792033 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cbddc6b0-37f2-48e0-bc0f-8b73ec47889e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:41.792697 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 875/1754] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:41.793425 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13a808-84bb-4d94-94b8-522ebc6e54b0 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:41.800711 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1a13a808-84bb-4d94-94b8-522ebc6e54b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:41.815564 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13a808-84bb-4d94-94b8-522ebc6e54b0 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:41.822424 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb31cd2-a3f1-4271-bc8c-b4e0e1fff479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:41.823001 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb31cd2-a3f1-4271-bc8c-b4e0e1fff479 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:41.823253 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb31cd2-a3f1-4271-bc8c-b4e0e1fff479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:41.823777 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb31cd2-a3f1-4271-bc8c-b4e0e1fff479 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:41.824924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb31cd2-a3f1-4271-bc8c-b4e0e1fff479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:41.827000 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb31cd2-a3f1-4271-bc8c-b4e0e1fff479 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:41.853227 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 876/1755] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:41.854278 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb31cd2-a3f1-4271-bc8c-b4e0e1fff479 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:41.874594 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb31cd2-a3f1-4271-bc8c-b4e0e1fff479 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:41.881864 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace24282-d924-4c20-9510-3f1e35bf0576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:41.882483 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace24282-d924-4c20-9510-3f1e35bf0576 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:41.882866 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace24282-d924-4c20-9510-3f1e35bf0576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:41.883013 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace24282-d924-4c20-9510-3f1e35bf0576 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:41.883749 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace24282-d924-4c20-9510-3f1e35bf0576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:41.895114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace24282-d924-4c20-9510-3f1e35bf0576 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:41.907031 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 880/1756] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 13 14:12:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:41.908704 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5738a38-c91e-4426-88ff-5b72624d729d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:41.909007 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5738a38-c91e-4426-88ff-5b72624d729d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:41.909307 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5738a38-c91e-4426-88ff-5b72624d729d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:41.962653 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 877/1757] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:12:41 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:41.962653 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c68e4b-b420-4864-ac33-bc2e1c3bb3de None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:41.962653 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c68e4b-b420-4864-ac33-bc2e1c3bb3de None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:41.963124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c68e4b-b420-4864-ac33-bc2e1c3bb3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:41.992171 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-b7c68e4b-b420-4864-ac33-bc2e1c3bb3de None None] MFA Rules not processed for user `8dd5ec91cd29468f97cb3045c12b819f`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:41.994291 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b7c68e4b-b420-4864-ac33-bc2e1c3bb3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:41.994650 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a5738a38-c91e-4426-88ff-5b72624d729d None None] MFA Rules not processed for user `c8289ecbf04143b1a136f876b1467c67`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:41.996820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a5738a38-c91e-4426-88ff-5b72624d729d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:42.034139 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:42.088086 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 881/1758] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:42.089592 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5738a38-c91e-4426-88ff-5b72624d729d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:42.095717 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a5738a38-c91e-4426-88ff-5b72624d729d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:42.109562 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 878/1759] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:42.110978 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c68e4b-b420-4864-ac33-bc2e1c3bb3de None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:42.112634 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b7c68e4b-b420-4864-ac33-bc2e1c3bb3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:42.125666 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5738a38-c91e-4426-88ff-5b72624d729d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:42.135267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a491d58-b9cc-468a-84a4-ee11a91d7571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:42.135864 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a491d58-b9cc-468a-84a4-ee11a91d7571 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:42.147775 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a491d58-b9cc-468a-84a4-ee11a91d7571 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:42.150031 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a491d58-b9cc-468a-84a4-ee11a91d7571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:42.168465 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a491d58-b9cc-468a-84a4-ee11a91d7571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:42.171135 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a491d58-b9cc-468a-84a4-ee11a91d7571 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:42.184961 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 882/1760] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:42.185904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a491d58-b9cc-468a-84a4-ee11a91d7571 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:42.199308 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a491d58-b9cc-468a-84a4-ee11a91d7571 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:42.205700 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4811ce-c9e5-4174-b923-a38b0af8fa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:42.206197 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4811ce-c9e5-4174-b923-a38b0af8fa76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:42.207732 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4811ce-c9e5-4174-b923-a38b0af8fa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:42.207732 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4811ce-c9e5-4174-b923-a38b0af8fa76 admin admin] PATH_INFO: `/v3/projects/9947d5bcd9cb40efaf57a8469278cce3/users/9e6f019c87774426bd3823227a93c1ce/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:42.219301 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c68e4b-b420-4864-ac33-bc2e1c3bb3de None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:42.233496 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4811ce-c9e5-4174-b923-a38b0af8fa76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9947d5bcd9cb40efaf57a8469278cce3, user_id=9e6f019c87774426bd3823227a93c1ce, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:42.239582 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4811ce-c9e5-4174-b923-a38b0af8fa76 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:42.244307 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4420ab-b69c-4971-a863-fe0341b88708 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:42.245114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4420ab-b69c-4971-a863-fe0341b88708 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:42.246698 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4420ab-b69c-4971-a863-fe0341b88708 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:42.247101 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4420ab-b69c-4971-a863-fe0341b88708 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:42.268415 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 883/1761] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:12:42 2022] PUT /identity/v3/projects/9947d5bcd9cb40efaf57a8469278cce3/users/9e6f019c87774426bd3823227a93c1ce/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:42.271369 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4811ce-c9e5-4174-b923-a38b0af8fa76 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:42.274436 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4420ab-b69c-4971-a863-fe0341b88708 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:42.275601 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-da4811ce-c9e5-4174-b923-a38b0af8fa76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:42.277310 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4420ab-b69c-4971-a863-fe0341b88708 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:42.308032 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 879/1762] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:42 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:42.309126 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4420ab-b69c-4971-a863-fe0341b88708 service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:42.335439 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4420ab-b69c-4971-a863-fe0341b88708 service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:42.398108 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:42.430246 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4811ce-c9e5-4174-b923-a38b0af8fa76 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:42.451801 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faea92d-ffc1-425d-8afe-1ced9c1efbc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:42.452780 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faea92d-ffc1-425d-8afe-1ced9c1efbc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:42.453343 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faea92d-ffc1-425d-8afe-1ced9c1efbc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:42.453772 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faea92d-ffc1-425d-8afe-1ced9c1efbc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:42.464764 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faea92d-ffc1-425d-8afe-1ced9c1efbc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:42.467133 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faea92d-ffc1-425d-8afe-1ced9c1efbc2 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:42.478768 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 884/1763] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:42.480772 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613327c-331b-4d2f-806d-cc74f7be35f9 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:42.481407 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613327c-331b-4d2f-806d-cc74f7be35f9 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:42.481901 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613327c-331b-4d2f-806d-cc74f7be35f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:42.486095 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b0013-756b-4cab-9a38-9d960a316ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:42.488360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b0013-756b-4cab-9a38-9d960a316ada admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:42.497648 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b0013-756b-4cab-9a38-9d960a316ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:42.498105 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b0013-756b-4cab-9a38-9d960a316ada admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:42.498995 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b0013-756b-4cab-9a38-9d960a316ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:42.501430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b0013-756b-4cab-9a38-9d960a316ada admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:42.528642 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c613327c-331b-4d2f-806d-cc74f7be35f9 None None] MFA Rules not processed for user `9e6f019c87774426bd3823227a93c1ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:42.532766 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 880/1764] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:42.533777 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b0013-756b-4cab-9a38-9d960a316ada admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:42.536603 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c613327c-331b-4d2f-806d-cc74f7be35f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:42.725487 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b0013-756b-4cab-9a38-9d960a316ada admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:42.735743 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefacc6-ec33-4131-b7bb-6aed80f72d67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:42.737623 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefacc6-ec33-4131-b7bb-6aed80f72d67 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:42.737906 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefacc6-ec33-4131-b7bb-6aed80f72d67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:42.739239 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefacc6-ec33-4131-b7bb-6aed80f72d67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:42.743088 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-bfefacc6-ec33-4131-b7bb-6aed80f72d67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:42.756998 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 885/1765] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:42 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:42.759307 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613327c-331b-4d2f-806d-cc74f7be35f9 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:42.799104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:42.854000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613327c-331b-4d2f-806d-cc74f7be35f9 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:42.863182 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4580d8c-bd1f-4bf0-876d-01f4b9b7ddf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:42.863943 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4580d8c-bd1f-4bf0-876d-01f4b9b7ddf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:42.864231 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4580d8c-bd1f-4bf0-876d-01f4b9b7ddf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:42.864563 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4580d8c-bd1f-4bf0-876d-01f4b9b7ddf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:42.865313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4580d8c-bd1f-4bf0-876d-01f4b9b7ddf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:42.866945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4580d8c-bd1f-4bf0-876d-01f4b9b7ddf5 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:42.888756 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 886/1766] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:42.892759 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4580d8c-bd1f-4bf0-876d-01f4b9b7ddf5 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:42.918695 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4580d8c-bd1f-4bf0-876d-01f4b9b7ddf5 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:42.943951 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefacc6-ec33-4131-b7bb-6aed80f72d67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:42.944596 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1410ae1-414d-42a8-bf6c-5d01e387f5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:42.945325 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1410ae1-414d-42a8-bf6c-5d01e387f5ff admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:42.945610 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1410ae1-414d-42a8-bf6c-5d01e387f5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:42.945887 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1410ae1-414d-42a8-bf6c-5d01e387f5ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:42.946538 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1410ae1-414d-42a8-bf6c-5d01e387f5ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:42.947818 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefacc6-ec33-4131-b7bb-6aed80f72d67 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:42.949569 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1410ae1-414d-42a8-bf6c-5d01e387f5ff admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:42.968169 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 881/1767] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:42.969716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefacc6-ec33-4131-b7bb-6aed80f72d67 service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:43.002003 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefacc6-ec33-4131-b7bb-6aed80f72d67 service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:43.017830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7968460-4f97-4242-9773-769dd7f25335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:43.018497 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7968460-4f97-4242-9773-769dd7f25335 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:43.018779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7968460-4f97-4242-9773-769dd7f25335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:43.019052 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7968460-4f97-4242-9773-769dd7f25335 admin admin] PATH_INFO: `/v3/projects/91f1cb2bae2a4d9b88208e55ea7e5bb1/users/d4a8cae8415642e09ae511fad2869f96/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:43.031329 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 887/1768] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:12:42 2022] POST /identity/v3/projects => generated 399 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:43.035753 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1410ae1-414d-42a8-bf6c-5d01e387f5ff admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:43.084070 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7968460-4f97-4242-9773-769dd7f25335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91f1cb2bae2a4d9b88208e55ea7e5bb1, user_id=d4a8cae8415642e09ae511fad2869f96, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:43.090542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7968460-4f97-4242-9773-769dd7f25335 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:43.159428 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 882/1769] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:12:42 2022] PUT /identity/v3/projects/91f1cb2bae2a4d9b88208e55ea7e5bb1/users/d4a8cae8415642e09ae511fad2869f96/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:43.169269 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f2ecb-8566-4d8f-a56d-8008bbf8a137 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:43.169522 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f2ecb-8566-4d8f-a56d-8008bbf8a137 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:43.169792 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f2ecb-8566-4d8f-a56d-8008bbf8a137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:43.307724 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-976f2ecb-8566-4d8f-a56d-8008bbf8a137 None None] MFA Rules not processed for user `d4a8cae8415642e09ae511fad2869f96`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:43.313764 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-976f2ecb-8566-4d8f-a56d-8008bbf8a137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:43.413621 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1410ae1-414d-42a8-bf6c-5d01e387f5ff admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:43.567178 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:43.608161 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 883/1770] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:12:43.610607 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e4171-cb93-4961-8341-8404b96c2724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:43.610760 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e4171-cb93-4961-8341-8404b96c2724 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:43.610971 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e4171-cb93-4961-8341-8404b96c2724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:43.611249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e4171-cb93-4961-8341-8404b96c2724 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:43.613198 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f2ecb-8566-4d8f-a56d-8008bbf8a137 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:43.619917 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e4171-cb93-4961-8341-8404b96c2724 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:43.629992 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e4171-cb93-4961-8341-8404b96c2724 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:43.656448 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f2ecb-8566-4d8f-a56d-8008bbf8a137 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:43.673430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f70406-8338-454b-9603-842624276cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:43.674111 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f70406-8338-454b-9603-842624276cfb admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:43.674399 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f70406-8338-454b-9603-842624276cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:43.675677 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f70406-8338-454b-9603-842624276cfb admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:43.676401 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f70406-8338-454b-9603-842624276cfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:43.683763 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f70406-8338-454b-9603-842624276cfb admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:43.702124 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 888/1771] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:12:43 2022] POST /identity/v3/users => generated 306 bytes in 664 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:43.704625 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e4171-cb93-4961-8341-8404b96c2724 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:43.746615 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e4171-cb93-4961-8341-8404b96c2724 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:43.764336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2bba6-289e-4a09-b350-11485f730cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:43.766502 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2bba6-289e-4a09-b350-11485f730cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:43.766966 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2bba6-289e-4a09-b350-11485f730cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:43.767188 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2bba6-289e-4a09-b350-11485f730cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:43.769180 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2bba6-289e-4a09-b350-11485f730cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:43.772568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2bba6-289e-4a09-b350-11485f730cf0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:43.792727 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 884/1772] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:12:43 2022] POST /identity/v3/projects => generated 377 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:43.795784 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f70406-8338-454b-9603-842624276cfb admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:43.818477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 889/1773] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:43.824647 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2bba6-289e-4a09-b350-11485f730cf0 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:43.869708 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2bba6-289e-4a09-b350-11485f730cf0 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:44.020305 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f70406-8338-454b-9603-842624276cfb admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:44.042557 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888ca25-36a9-4403-9119-e50472c0e8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:44.043201 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888ca25-36a9-4403-9119-e50472c0e8e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:44.043477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888ca25-36a9-4403-9119-e50472c0e8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:44.043805 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888ca25-36a9-4403-9119-e50472c0e8e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:44.050619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888ca25-36a9-4403-9119-e50472c0e8e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:44.059559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888ca25-36a9-4403-9119-e50472c0e8e6 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:44.086085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a030ab7-f4f2-4ce0-845c-34664f3df3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:44.089202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a030ab7-f4f2-4ce0-845c-34664f3df3d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:44.089202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a030ab7-f4f2-4ce0-845c-34664f3df3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:44.089202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a030ab7-f4f2-4ce0-845c-34664f3df3d9 admin admin] PATH_INFO: `/v3/projects/cc170dd7fcdc44f7917428f71730e304/users/c14702653dd84343949562ce5398022d/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:44.107067 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:44.141405 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a030ab7-f4f2-4ce0-845c-34664f3df3d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc170dd7fcdc44f7917428f71730e304, user_id=c14702653dd84343949562ce5398022d, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:44.154735 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a030ab7-f4f2-4ce0-845c-34664f3df3d9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:44.177058 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 885/1774] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:12:43 2022] POST /identity/v3/users => generated 295 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:44.184691 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a8bbf-d5be-4701-9d4b-cb23b0e6599c None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:44.184902 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a8bbf-d5be-4701-9d4b-cb23b0e6599c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:44.185003 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a8bbf-d5be-4701-9d4b-cb23b0e6599c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:44.195284 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 890/1775] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:12:43 2022] PUT /identity/v3/projects/cc170dd7fcdc44f7917428f71730e304/users/c14702653dd84343949562ce5398022d/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:44.196556 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a030ab7-f4f2-4ce0-845c-34664f3df3d9 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:44.433457 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-aa3a8bbf-d5be-4701-9d4b-cb23b0e6599c None None] MFA Rules not processed for user `0c41b4ecb17a43fdb05e586cce43b5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:44.441190 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-aa3a8bbf-d5be-4701-9d4b-cb23b0e6599c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:44.537425 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a030ab7-f4f2-4ce0-845c-34664f3df3d9 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:44.549122 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e7bf9-089f-45a0-a768-238c3def90f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:44.549870 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e7bf9-089f-45a0-a768-238c3def90f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:44.550153 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e7bf9-089f-45a0-a768-238c3def90f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:44.550608 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e7bf9-089f-45a0-a768-238c3def90f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:44.551194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e7bf9-089f-45a0-a768-238c3def90f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:44.572102 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e7bf9-089f-45a0-a768-238c3def90f1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:44.603182 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 891/1776] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:44.607000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e7bf9-089f-45a0-a768-238c3def90f1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:44.647995 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e7bf9-089f-45a0-a768-238c3def90f1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:44.666464 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d93ce-ec32-483e-9930-809f3cf4a9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:44.667203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d93ce-ec32-483e-9930-809f3cf4a9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:44.667593 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d93ce-ec32-483e-9930-809f3cf4a9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:44.668166 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d93ce-ec32-483e-9930-809f3cf4a9b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:44.668526 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d93ce-ec32-483e-9930-809f3cf4a9b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:44.678995 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d93ce-ec32-483e-9930-809f3cf4a9b4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:44.720145 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 886/1777] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 13 14:12:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 543 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:44.723447 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a8bbf-d5be-4701-9d4b-cb23b0e6599c None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:44.725412 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-aa3a8bbf-d5be-4701-9d4b-cb23b0e6599c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:44.735435 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 892/1778] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:44.737500 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d93ce-ec32-483e-9930-809f3cf4a9b4 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:44.772858 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d93ce-ec32-483e-9930-809f3cf4a9b4 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:44.778828 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a8bbf-d5be-4701-9d4b-cb23b0e6599c None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:44.784255 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df63528-3e89-4a20-9c8a-fc9b7b620903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:44.785179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df63528-3e89-4a20-9c8a-fc9b7b620903 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:44.785654 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df63528-3e89-4a20-9c8a-fc9b7b620903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:44.785654 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df63528-3e89-4a20-9c8a-fc9b7b620903 admin admin] PATH_INFO: `/v3/projects/539c443fffe84e2f996441c4b75423b5/users/8089dd0a65d443db9d33b9bd0c239b68/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:44.797882 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b534d4-413f-42f3-8c76-20d9f685f415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:44.798540 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b534d4-413f-42f3-8c76-20d9f685f415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:44.798822 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b534d4-413f-42f3-8c76-20d9f685f415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:44.799097 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b534d4-413f-42f3-8c76-20d9f685f415 admin admin] PATH_INFO: `/v3/projects/7a351aed7d2a476f961dcf27a514d2ad` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:44.800526 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b534d4-413f-42f3-8c76-20d9f685f415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a351aed7d2a476f961dcf27a514d2ad)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:44.802537 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b534d4-413f-42f3-8c76-20d9f685f415 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:44.805147 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df63528-3e89-4a20-9c8a-fc9b7b620903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=539c443fffe84e2f996441c4b75423b5, user_id=8089dd0a65d443db9d33b9bd0c239b68, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:44.808892 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df63528-3e89-4a20-9c8a-fc9b7b620903 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:44.837965 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 893/1779] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:12:44 2022] PUT /identity/v3/projects/539c443fffe84e2f996441c4b75423b5/users/8089dd0a65d443db9d33b9bd0c239b68/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:44.839392 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df63528-3e89-4a20-9c8a-fc9b7b620903 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:44.852519 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:44.960085 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-15b534d4-413f-42f3-8c76-20d9f685f415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a351aed7d2a476f961dcf27a514d2ad', 'request_id': 'req-15b534d4-413f-42f3-8c76-20d9f685f415'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:44.979610 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-15b534d4-413f-42f3-8c76-20d9f685f415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a351aed7d2a476f961dcf27a514d2ad', 'request_id': 'req-15b534d4-413f-42f3-8c76-20d9f685f415'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:44.987133 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-15b534d4-413f-42f3-8c76-20d9f685f415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a351aed7d2a476f961dcf27a514d2ad', 'request_id': 'req-15b534d4-413f-42f3-8c76-20d9f685f415'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:45.016319 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-15b534d4-413f-42f3-8c76-20d9f685f415 admin admin] The token cache is being invalidate because project 7a351aed7d2a476f961dcf27a514d2ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:12:45.016654 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-15b534d4-413f-42f3-8c76-20d9f685f415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:45.017498 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-15b534d4-413f-42f3-8c76-20d9f685f415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:45.020869 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 887/1780] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:12:44 2022] DELETE /identity/v3/projects/7a351aed7d2a476f961dcf27a514d2ad => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:45.023528 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b534d4-413f-42f3-8c76-20d9f685f415 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:45.026712 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-15b534d4-413f-42f3-8c76-20d9f685f415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:45.054462 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df63528-3e89-4a20-9c8a-fc9b7b620903 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:45.159131 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2be59-b47e-4a3b-88a2-89a40fddc608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:45.160488 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2be59-b47e-4a3b-88a2-89a40fddc608 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:45.160488 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2be59-b47e-4a3b-88a2-89a40fddc608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:45.161021 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2be59-b47e-4a3b-88a2-89a40fddc608 admin admin] PATH_INFO: `/v3/projects/cc170dd7fcdc44f7917428f71730e304/users/c14702653dd84343949562ce5398022d/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:45.163416 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2be59-b47e-4a3b-88a2-89a40fddc608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc170dd7fcdc44f7917428f71730e304, user_id=c14702653dd84343949562ce5398022d, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:45.166890 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2be59-b47e-4a3b-88a2-89a40fddc608 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:45.184160 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 894/1781] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:12:44 2022] PUT /identity/v3/projects/cc170dd7fcdc44f7917428f71730e304/users/c14702653dd84343949562ce5398022d/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:45.185534 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:45.186477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2be59-b47e-4a3b-88a2-89a40fddc608 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:45.191674 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-39c2be59-b47e-4a3b-88a2-89a40fddc608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:45.238283 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b534d4-413f-42f3-8c76-20d9f685f415 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:45.385594 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd51e3-39cd-4030-aec4-2445d3e371d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:45.386510 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd51e3-39cd-4030-aec4-2445d3e371d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:45.388073 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd51e3-39cd-4030-aec4-2445d3e371d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:45.388615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd51e3-39cd-4030-aec4-2445d3e371d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:45.391697 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd51e3-39cd-4030-aec4-2445d3e371d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:45.393958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd51e3-39cd-4030-aec4-2445d3e371d7 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:45.405331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2be59-b47e-4a3b-88a2-89a40fddc608 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:45.419348 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 888/1782] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:45.420446 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd51e3-39cd-4030-aec4-2445d3e371d7 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:45.426079 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7902183-04f9-4b75-98a5-32b0e8f16865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:45.426383 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-24fd51e3-39cd-4030-aec4-2445d3e371d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:45.427470 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7902183-04f9-4b75-98a5-32b0e8f16865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:45.427754 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7902183-04f9-4b75-98a5-32b0e8f16865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:45.429023 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7902183-04f9-4b75-98a5-32b0e8f16865 admin admin] PATH_INFO: `/v3/users/5c08826fdfd641ad9512741039f6526c` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:45.431934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7902183-04f9-4b75-98a5-32b0e8f16865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c08826fdfd641ad9512741039f6526c)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:45.435273 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7902183-04f9-4b75-98a5-32b0e8f16865 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:45.611648 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b7902183-04f9-4b75-98a5-32b0e8f16865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c08826fdfd641ad9512741039f6526c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:45.616149 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:45.630665 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b7902183-04f9-4b75-98a5-32b0e8f16865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c08826fdfd641ad9512741039f6526c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:45.668367 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b7902183-04f9-4b75-98a5-32b0e8f16865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c08826fdfd641ad9512741039f6526c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:45.680306 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b7902183-04f9-4b75-98a5-32b0e8f16865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c08826fdfd641ad9512741039f6526c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:45.733068 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b7902183-04f9-4b75-98a5-32b0e8f16865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c08826fdfd641ad9512741039f6526c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:45.751578 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 895/1783] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:12:45 2022] DELETE /identity/v3/users/5c08826fdfd641ad9512741039f6526c => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:45.753508 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b581b-1cad-4559-a780-263a05f644a9 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:45.754039 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b581b-1cad-4559-a780-263a05f644a9 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:45.754520 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b581b-1cad-4559-a780-263a05f644a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:45.793041 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-224b581b-1cad-4559-a780-263a05f644a9 None None] MFA Rules not processed for user `c14702653dd84343949562ce5398022d`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:45.795148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-224b581b-1cad-4559-a780-263a05f644a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:45.802725 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd51e3-39cd-4030-aec4-2445d3e371d7 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:46.057206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4768f7-dbdb-4ccc-b9f9-35e596530761 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c27e930f604bd38634ca08e56cf8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:46.057872 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4768f7-dbdb-4ccc-b9f9-35e596530761 service swift] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:46.058182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4768f7-dbdb-4ccc-b9f9-35e596530761 service swift] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:46.058494 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4768f7-dbdb-4ccc-b9f9-35e596530761 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:46.063794 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 896/1784] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:45 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:46.064734 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b581b-1cad-4559-a780-263a05f644a9 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:46.065979 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-224b581b-1cad-4559-a780-263a05f644a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:46.070683 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5f4768f7-dbdb-4ccc-b9f9-35e596530761 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:46.103160 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:46.217772 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4768f7-dbdb-4ccc-b9f9-35e596530761 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:46.219802 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4768f7-dbdb-4ccc-b9f9-35e596530761 service swift] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:46.232221 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b581b-1cad-4559-a780-263a05f644a9 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:46.241171 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 889/1785] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 13 14:12:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 821 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 14:12:46.242546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179c624-88eb-47dc-95e5-4c3660cc6faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:46.242947 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179c624-88eb-47dc-95e5-4c3660cc6faa admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:46.243097 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179c624-88eb-47dc-95e5-4c3660cc6faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:46.243409 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179c624-88eb-47dc-95e5-4c3660cc6faa admin admin] PATH_INFO: `/v3/projects/539c443fffe84e2f996441c4b75423b5/users/8089dd0a65d443db9d33b9bd0c239b68/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:46.245770 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4768f7-dbdb-4ccc-b9f9-35e596530761 service swift] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:46.248896 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179c624-88eb-47dc-95e5-4c3660cc6faa admin admin] RBAC: Authorizing `identity:create_grant(project_id=539c443fffe84e2f996441c4b75423b5, user_id=8089dd0a65d443db9d33b9bd0c239b68, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:46.249869 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5f4768f7-dbdb-4ccc-b9f9-35e596530761 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:46.251647 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179c624-88eb-47dc-95e5-4c3660cc6faa admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:46.277038 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 897/1786] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:12:46 2022] PUT /identity/v3/projects/539c443fffe84e2f996441c4b75423b5/users/8089dd0a65d443db9d33b9bd0c239b68/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:46.312391 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc6bfc-abbc-4914-be3f-1c7fc753f67e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:46.312839 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc6bfc-abbc-4914-be3f-1c7fc753f67e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:46.313408 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc6bfc-abbc-4914-be3f-1c7fc753f67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:46.433900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4768f7-dbdb-4ccc-b9f9-35e596530761 service swift] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:46.488303 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-becc6bfc-abbc-4914-be3f-1c7fc753f67e None None] MFA Rules not processed for user `8089dd0a65d443db9d33b9bd0c239b68`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:46.489827 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-becc6bfc-abbc-4914-be3f-1c7fc753f67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:46.600128 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:46.618940 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753d065-f367-4676-9229-fe46cc900e84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:46.618940 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753d065-f367-4676-9229-fe46cc900e84 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:46.618940 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753d065-f367-4676-9229-fe46cc900e84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:46.619343 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753d065-f367-4676-9229-fe46cc900e84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:46.727581 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 898/1787] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:46.735507 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc6bfc-abbc-4914-be3f-1c7fc753f67e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:46.737388 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-becc6bfc-abbc-4914-be3f-1c7fc753f67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:46.799674 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc6bfc-abbc-4914-be3f-1c7fc753f67e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:46.844832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2695d-14d5-4345-8e4a-bd9dc811c15b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:46.847792 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2695d-14d5-4345-8e4a-bd9dc811c15b service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:46.848099 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2695d-14d5-4345-8e4a-bd9dc811c15b service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:46.848379 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2695d-14d5-4345-8e4a-bd9dc811c15b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:46.855823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-41f2695d-14d5-4345-8e4a-bd9dc811c15b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:46.960284 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753d065-f367-4676-9229-fe46cc900e84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:46.966750 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753d065-f367-4676-9229-fe46cc900e84 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:47.016956 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 890/1788] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:46 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 773 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:47.092203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2695d-14d5-4345-8e4a-bd9dc811c15b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:47.092203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2695d-14d5-4345-8e4a-bd9dc811c15b service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:47.108223 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 899/1789] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 14:12:47.694737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753d065-f367-4676-9229-fe46cc900e84 service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:47.696706 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2753d065-f367-4676-9229-fe46cc900e84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:47.845147 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2695d-14d5-4345-8e4a-bd9dc811c15b service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:47.854633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2695d-14d5-4345-8e4a-bd9dc811c15b service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:47.871385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:47.872980 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d701c2-3db8-4694-a7a1-4aef1ab49f10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:47.889452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d701c2-3db8-4694-a7a1-4aef1ab49f10 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:47.889452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d701c2-3db8-4694-a7a1-4aef1ab49f10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:47.889452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d701c2-3db8-4694-a7a1-4aef1ab49f10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:47.895693 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c2d701c2-3db8-4694-a7a1-4aef1ab49f10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:48.068763 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753d065-f367-4676-9229-fe46cc900e84 service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:48.084716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8277a2-4273-449b-95dc-2859b2403c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:48.086101 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8277a2-4273-449b-95dc-2859b2403c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:48.092097 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8277a2-4273-449b-95dc-2859b2403c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:48.092983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8277a2-4273-449b-95dc-2859b2403c85 admin admin] PATH_INFO: `/v3/projects/19adfda5bcbf4c73b81e05ee28857fe5` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:48.097339 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8277a2-4273-449b-95dc-2859b2403c85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19adfda5bcbf4c73b81e05ee28857fe5)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:48.099777 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8277a2-4273-449b-95dc-2859b2403c85 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:48.155889 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d701c2-3db8-4694-a7a1-4aef1ab49f10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:48.197633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d701c2-3db8-4694-a7a1-4aef1ab49f10 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:48.240860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 900/1790] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:47 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 14:12:48.273448 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6f8277a2-4273-449b-95dc-2859b2403c85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19adfda5bcbf4c73b81e05ee28857fe5', 'request_id': 'req-6f8277a2-4273-449b-95dc-2859b2403c85'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:48.329603 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6f8277a2-4273-449b-95dc-2859b2403c85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19adfda5bcbf4c73b81e05ee28857fe5', 'request_id': 'req-6f8277a2-4273-449b-95dc-2859b2403c85'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:48.358714 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6f8277a2-4273-449b-95dc-2859b2403c85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19adfda5bcbf4c73b81e05ee28857fe5', 'request_id': 'req-6f8277a2-4273-449b-95dc-2859b2403c85'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:48.410236 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6f8277a2-4273-449b-95dc-2859b2403c85 admin admin] The token cache is being invalidate because project 19adfda5bcbf4c73b81e05ee28857fe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:12:48.410542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6f8277a2-4273-449b-95dc-2859b2403c85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:48.418322 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6f8277a2-4273-449b-95dc-2859b2403c85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:48.424011 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 891/1791] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:12:47 2022] DELETE /identity/v3/projects/19adfda5bcbf4c73b81e05ee28857fe5 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:48.429684 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79653a01-b2e1-4cce-b06a-15971280c68d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:48.429969 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79653a01-b2e1-4cce-b06a-15971280c68d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:48.430250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79653a01-b2e1-4cce-b06a-15971280c68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:48.530103 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-79653a01-b2e1-4cce-b06a-15971280c68d None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:48.531403 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-79653a01-b2e1-4cce-b06a-15971280c68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:48.761460 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 901/1792] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:48.763070 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449de7be-6f77-4a82-9c0a-7970770ac6c9 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:48.763378 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449de7be-6f77-4a82-9c0a-7970770ac6c9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:48.763675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449de7be-6f77-4a82-9c0a-7970770ac6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:48.830540 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-449de7be-6f77-4a82-9c0a-7970770ac6c9 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:48.833992 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-449de7be-6f77-4a82-9c0a-7970770ac6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:48.875614 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 892/1793] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:48.879199 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79653a01-b2e1-4cce-b06a-15971280c68d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:48.926748 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79653a01-b2e1-4cce-b06a-15971280c68d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:48.950661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e58984-bb2a-4adc-8488-e794b79acaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:48.951406 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e58984-bb2a-4adc-8488-e794b79acaf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:48.951891 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e58984-bb2a-4adc-8488-e794b79acaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:48.952024 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e58984-bb2a-4adc-8488-e794b79acaf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:48.952596 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e58984-bb2a-4adc-8488-e794b79acaf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:12:48.952949 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e58984-bb2a-4adc-8488-e794b79acaf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:48.955135 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e58984-bb2a-4adc-8488-e794b79acaf9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:48.968327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:48.988783 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 902/1794] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:12:48.993929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449de7be-6f77-4a82-9c0a-7970770ac6c9 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:49.007700 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449de7be-6f77-4a82-9c0a-7970770ac6c9 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:49.021582 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cb26a-2354-4d39-971b-fd1f837b52c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:49.022251 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cb26a-2354-4d39-971b-fd1f837b52c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:49.022571 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cb26a-2354-4d39-971b-fd1f837b52c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:49.022845 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cb26a-2354-4d39-971b-fd1f837b52c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:49.023487 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75cb26a-2354-4d39-971b-fd1f837b52c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:49.025637 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75cb26a-2354-4d39-971b-fd1f837b52c8 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:49.077444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 893/1795] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:12:48 2022] POST /identity/v3/projects => generated 391 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:12:49.081879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e58984-bb2a-4adc-8488-e794b79acaf9 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:49.096325 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e58984-bb2a-4adc-8488-e794b79acaf9 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:49.115294 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40872732-1cce-4b63-93b0-3bc98ea7dc8d None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:49.115837 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40872732-1cce-4b63-93b0-3bc98ea7dc8d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:49.116270 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40872732-1cce-4b63-93b0-3bc98ea7dc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:49.167268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-40872732-1cce-4b63-93b0-3bc98ea7dc8d None None] MFA Rules not processed for user `cb992cf1a7a445119262b567ce345181`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:49.171185 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-40872732-1cce-4b63-93b0-3bc98ea7dc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:49.356229 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f81b4b-ace2-4213-a412-2164658349d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:49.356854 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f81b4b-ace2-4213-a412-2164658349d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:49.357666 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f81b4b-ace2-4213-a412-2164658349d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:49.357666 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f81b4b-ace2-4213-a412-2164658349d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:49.366647 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f81b4b-ace2-4213-a412-2164658349d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:49.373379 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f81b4b-ace2-4213-a412-2164658349d4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:49.428571 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 894/1796] 10.222.0.27 () {58 vars in 1015 bytes} [Tue Sep 13 14:12:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:49.465065 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 903/1797] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:12:49 2022] POST /identity/v3/users => generated 296 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:49.468305 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40872732-1cce-4b63-93b0-3bc98ea7dc8d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:49.490548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40872732-1cce-4b63-93b0-3bc98ea7dc8d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:49.512460 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf12dbd-1455-44ff-bab0-b9625295122a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:49.512460 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf12dbd-1455-44ff-bab0-b9625295122a admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:49.515545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf12dbd-1455-44ff-bab0-b9625295122a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:49.515829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf12dbd-1455-44ff-bab0-b9625295122a admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:49.516670 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf12dbd-1455-44ff-bab0-b9625295122a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:49.524534 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf12dbd-1455-44ff-bab0-b9625295122a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:49.580338 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f81b4b-ace2-4213-a412-2164658349d4 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:49.589903 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 895/1798] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:49.598467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf12dbd-1455-44ff-bab0-b9625295122a admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:49.610584 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7bf12dbd-1455-44ff-bab0-b9625295122a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:49.613870 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f81b4b-ace2-4213-a412-2164658349d4 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:49.633739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474bbdf-87f8-4b87-a178-fbe38b715f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:49.634560 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474bbdf-87f8-4b87-a178-fbe38b715f3e admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:49.640722 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474bbdf-87f8-4b87-a178-fbe38b715f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:49.641319 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474bbdf-87f8-4b87-a178-fbe38b715f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:49.645189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474bbdf-87f8-4b87-a178-fbe38b715f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:49.649886 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474bbdf-87f8-4b87-a178-fbe38b715f3e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:49.696262 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 904/1799] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:49.697967 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474bbdf-87f8-4b87-a178-fbe38b715f3e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:49.702254 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d474bbdf-87f8-4b87-a178-fbe38b715f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:49.739129 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474bbdf-87f8-4b87-a178-fbe38b715f3e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:49.749369 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:49.754228 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822407a8-de5b-4bf1-9731-a49cc109892c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:49.755250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822407a8-de5b-4bf1-9731-a49cc109892c service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:49.755971 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822407a8-de5b-4bf1-9731-a49cc109892c service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:49.756572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822407a8-de5b-4bf1-9731-a49cc109892c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:49.789402 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822407a8-de5b-4bf1-9731-a49cc109892c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:49.791430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822407a8-de5b-4bf1-9731-a49cc109892c service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:49.820540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 905/1800] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:49.821853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822407a8-de5b-4bf1-9731-a49cc109892c service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:49.828298 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf12dbd-1455-44ff-bab0-b9625295122a admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:49.844190 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cb6b9-215b-4670-8154-ae30f39e847d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:49.844820 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cb6b9-215b-4670-8154-ae30f39e847d service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:49.845142 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cb6b9-215b-4670-8154-ae30f39e847d service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:49.845521 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cb6b9-215b-4670-8154-ae30f39e847d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:49.849955 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-773cb6b9-215b-4670-8154-ae30f39e847d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:49.869826 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822407a8-de5b-4bf1-9731-a49cc109892c service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:49.891208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d1c58-b040-44fe-80f4-9898638148da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:49.892000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d1c58-b040-44fe-80f4-9898638148da admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:49.892167 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d1c58-b040-44fe-80f4-9898638148da admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:49.894223 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d1c58-b040-44fe-80f4-9898638148da admin admin] PATH_INFO: `/v3/projects/e42603f06c224fd99cd65dcd663fde49/users/cffdd6b7cafa43b297a493b3bcf2db0c/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:49.935536 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d1c58-b040-44fe-80f4-9898638148da admin admin] RBAC: Authorizing `identity:create_grant(project_id=e42603f06c224fd99cd65dcd663fde49, user_id=cffdd6b7cafa43b297a493b3bcf2db0c, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:49.941080 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d1c58-b040-44fe-80f4-9898638148da admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:49.994692 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 906/1801] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:12:49 2022] PUT /identity/v3/projects/e42603f06c224fd99cd65dcd663fde49/users/cffdd6b7cafa43b297a493b3bcf2db0c/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:49.998748 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe6ea2-d18a-47d5-a278-01a498de0bd5 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:49.999266 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe6ea2-d18a-47d5-a278-01a498de0bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:50.000163 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe6ea2-d18a-47d5-a278-01a498de0bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:50.055295 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773cb6b9-215b-4670-8154-ae30f39e847d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:50.056763 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773cb6b9-215b-4670-8154-ae30f39e847d service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:50.118988 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 896/1802] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:50.123884 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-34fe6ea2-d18a-47d5-a278-01a498de0bd5 None None] MFA Rules not processed for user `cffdd6b7cafa43b297a493b3bcf2db0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:50.125815 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-34fe6ea2-d18a-47d5-a278-01a498de0bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:50.307802 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 907/1803] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:50.312770 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cb6b9-215b-4670-8154-ae30f39e847d service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:50.331901 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cb6b9-215b-4670-8154-ae30f39e847d service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:50.552040 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabb834-64ed-453f-b047-a3b17b023fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:50.552414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabb834-64ed-453f-b047-a3b17b023fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:50.552762 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabb834-64ed-453f-b047-a3b17b023fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:50.553127 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabb834-64ed-453f-b047-a3b17b023fc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:50.553970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabb834-64ed-453f-b047-a3b17b023fc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:50.555989 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabb834-64ed-453f-b047-a3b17b023fc3 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:50.676354 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 897/1804] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:12:50 2022] POST /identity/v3/projects => generated 393 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:12:50.679968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe6ea2-d18a-47d5-a278-01a498de0bd5 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:50.700294 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe6ea2-d18a-47d5-a278-01a498de0bd5 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:50.808916 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:50.951407 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661b9ab-52c2-4c4d-8d81-e69432996579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:50.951407 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661b9ab-52c2-4c4d-8d81-e69432996579 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:50.952185 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661b9ab-52c2-4c4d-8d81-e69432996579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:50.952185 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661b9ab-52c2-4c4d-8d81-e69432996579 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:50.952967 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661b9ab-52c2-4c4d-8d81-e69432996579 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:50.964774 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661b9ab-52c2-4c4d-8d81-e69432996579 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:51.036248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 908/1805] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:12:50 2022] POST /identity/v3/users => generated 303 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:12:51.040587 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabb834-64ed-453f-b047-a3b17b023fc3 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:51.067758 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabb834-64ed-453f-b047-a3b17b023fc3 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:51.089689 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb7ea0-ed0a-4b10-b6b1-6ef3ef7aa772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:51.090332 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb7ea0-ed0a-4b10-b6b1-6ef3ef7aa772 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:51.090608 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb7ea0-ed0a-4b10-b6b1-6ef3ef7aa772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:51.090877 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb7ea0-ed0a-4b10-b6b1-6ef3ef7aa772 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:51.091647 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb7ea0-ed0a-4b10-b6b1-6ef3ef7aa772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:51.104555 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb7ea0-ed0a-4b10-b6b1-6ef3ef7aa772 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:51.176568 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 898/1806] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:51.181509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661b9ab-52c2-4c4d-8d81-e69432996579 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:51.226061 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661b9ab-52c2-4c4d-8d81-e69432996579 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:51.266075 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36163c-0cd3-4716-8c48-69c120531331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:51.268086 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36163c-0cd3-4716-8c48-69c120531331 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:51.268461 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36163c-0cd3-4716-8c48-69c120531331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:51.268744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36163c-0cd3-4716-8c48-69c120531331 admin admin] PATH_INFO: `/v3/projects/5a893227b2254e80af761f15279662f0/users/0bfe064f082d40dd90cd0af83e943624/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:51.364977 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36163c-0cd3-4716-8c48-69c120531331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a893227b2254e80af761f15279662f0, user_id=0bfe064f082d40dd90cd0af83e943624, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:51.375430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36163c-0cd3-4716-8c48-69c120531331 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:51.441248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 909/1807] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:12:51 2022] PUT /identity/v3/projects/5a893227b2254e80af761f15279662f0/users/0bfe064f082d40dd90cd0af83e943624/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:12:51.445563 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb7ea0-ed0a-4b10-b6b1-6ef3ef7aa772 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:51.461809 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb7ea0-ed0a-4b10-b6b1-6ef3ef7aa772 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:51.720957 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:51.771228 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4853a95-85bc-482c-88e3-329f75c1542c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:51.771844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4853a95-85bc-482c-88e3-329f75c1542c admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:51.772235 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4853a95-85bc-482c-88e3-329f75c1542c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:51.772655 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4853a95-85bc-482c-88e3-329f75c1542c admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:51.773724 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4853a95-85bc-482c-88e3-329f75c1542c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:51.775543 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4853a95-85bc-482c-88e3-329f75c1542c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:51.808203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36163c-0cd3-4716-8c48-69c120531331 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:51.821371 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 899/1808] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:12:51.825702 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36163c-0cd3-4716-8c48-69c120531331 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:51.863648 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74aeca6-d94f-4c4f-90d5-47c0f7d98612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:51.865468 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74aeca6-d94f-4c4f-90d5-47c0f7d98612 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:51.865836 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74aeca6-d94f-4c4f-90d5-47c0f7d98612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:51.866118 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74aeca6-d94f-4c4f-90d5-47c0f7d98612 admin admin] PATH_INFO: `/v3/projects/5a893227b2254e80af761f15279662f0/users/0bfe064f082d40dd90cd0af83e943624/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:51.873978 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74aeca6-d94f-4c4f-90d5-47c0f7d98612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a893227b2254e80af761f15279662f0, user_id=0bfe064f082d40dd90cd0af83e943624, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:51.878617 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74aeca6-d94f-4c4f-90d5-47c0f7d98612 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:51.929469 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 910/1809] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:12:51 2022] PUT /identity/v3/projects/5a893227b2254e80af761f15279662f0/users/0bfe064f082d40dd90cd0af83e943624/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:51.941087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b3e78-8d61-45eb-9ef3-d6c6417cd20e None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:51.941885 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b3e78-8d61-45eb-9ef3-d6c6417cd20e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:51.942515 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b3e78-8d61-45eb-9ef3-d6c6417cd20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:52.070500 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-2a4b3e78-8d61-45eb-9ef3-d6c6417cd20e None None] MFA Rules not processed for user `0bfe064f082d40dd90cd0af83e943624`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:52.075645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2a4b3e78-8d61-45eb-9ef3-d6c6417cd20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:52.255738 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 900/1810] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:51 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:52.360223 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74aeca6-d94f-4c4f-90d5-47c0f7d98612 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:52.363777 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b74aeca6-d94f-4c4f-90d5-47c0f7d98612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:52.573854 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74aeca6-d94f-4c4f-90d5-47c0f7d98612 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:52.579762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42952d5a-46bf-49a3-afe5-e9288a837115 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:52.580700 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42952d5a-46bf-49a3-afe5-e9288a837115 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:52.581153 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42952d5a-46bf-49a3-afe5-e9288a837115 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:52.581791 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42952d5a-46bf-49a3-afe5-e9288a837115 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:52.611821 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42952d5a-46bf-49a3-afe5-e9288a837115 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:52.617512 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42952d5a-46bf-49a3-afe5-e9288a837115 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:52.631933 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 911/1811] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:52 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 14:12:52.915289 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b3e78-8d61-45eb-9ef3-d6c6417cd20e None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:52.933245 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b3e78-8d61-45eb-9ef3-d6c6417cd20e None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:52.951241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b71c9-bf97-4e2d-8276-e9e9531b3baf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:52.953870 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b71c9-bf97-4e2d-8276-e9e9531b3baf service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:52.954661 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b71c9-bf97-4e2d-8276-e9e9531b3baf service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:52.955034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b71c9-bf97-4e2d-8276-e9e9531b3baf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:53.176580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b71c9-bf97-4e2d-8276-e9e9531b3baf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:53.178132 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b71c9-bf97-4e2d-8276-e9e9531b3baf service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:53.227936 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 901/1812] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:54.960601 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42952d5a-46bf-49a3-afe5-e9288a837115 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:54.963202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-42952d5a-46bf-49a3-afe5-e9288a837115 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:55.082769 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b71c9-bf97-4e2d-8276-e9e9531b3baf service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:55.087940 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-710b71c9-bf97-4e2d-8276-e9e9531b3baf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:55.264087 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42952d5a-46bf-49a3-afe5-e9288a837115 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:55.276383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eeb7ff-6a42-4d69-9dd5-500b0f3d7dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:55.284244 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eeb7ff-6a42-4d69-9dd5-500b0f3d7dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:55.284888 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eeb7ff-6a42-4d69-9dd5-500b0f3d7dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:55.286908 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eeb7ff-6a42-4d69-9dd5-500b0f3d7dff admin admin] PATH_INFO: `/v3/users/ac2ceb85af3a4f90bfd37bde26b7d555` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:55.289211 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eeb7ff-6a42-4d69-9dd5-500b0f3d7dff admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac2ceb85af3a4f90bfd37bde26b7d555)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:55.292546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eeb7ff-6a42-4d69-9dd5-500b0f3d7dff admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:55.330562 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b71c9-bf97-4e2d-8276-e9e9531b3baf service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:55.342501 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f654eba-1125-43c9-941c-6c7f52d2f1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:55.344717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f654eba-1125-43c9-941c-6c7f52d2f1f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:55.345273 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f654eba-1125-43c9-941c-6c7f52d2f1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:55.346958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f654eba-1125-43c9-941c-6c7f52d2f1f1 admin admin] PATH_INFO: `/v3/users/9e6f019c87774426bd3823227a93c1ce` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:55.353660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f654eba-1125-43c9-941c-6c7f52d2f1f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e6f019c87774426bd3823227a93c1ce)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:55.363416 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f654eba-1125-43c9-941c-6c7f52d2f1f1 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:55.380395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:55.387353 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:55.455902 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f5eeb7ff-6a42-4d69-9dd5-500b0f3d7dff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac2ceb85af3a4f90bfd37bde26b7d555'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:55.487411 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f5eeb7ff-6a42-4d69-9dd5-500b0f3d7dff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac2ceb85af3a4f90bfd37bde26b7d555'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:55.526433 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5f654eba-1125-43c9-941c-6c7f52d2f1f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e6f019c87774426bd3823227a93c1ce'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:55.529476 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f5eeb7ff-6a42-4d69-9dd5-500b0f3d7dff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac2ceb85af3a4f90bfd37bde26b7d555'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:55.531601 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f5eeb7ff-6a42-4d69-9dd5-500b0f3d7dff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac2ceb85af3a4f90bfd37bde26b7d555'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:55.545240 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5f654eba-1125-43c9-941c-6c7f52d2f1f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e6f019c87774426bd3823227a93c1ce'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:55.566451 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f5eeb7ff-6a42-4d69-9dd5-500b0f3d7dff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac2ceb85af3a4f90bfd37bde26b7d555'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:55.596724 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 912/1813] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:12:54 2022] DELETE /identity/v3/users/ac2ceb85af3a4f90bfd37bde26b7d555 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:55.599734 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eeb7ff-6a42-4d69-9dd5-500b0f3d7dff admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:55.605027 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f5eeb7ff-6a42-4d69-9dd5-500b0f3d7dff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:55.620951 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5f654eba-1125-43c9-941c-6c7f52d2f1f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e6f019c87774426bd3823227a93c1ce'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:55.622388 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5f654eba-1125-43c9-941c-6c7f52d2f1f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e6f019c87774426bd3823227a93c1ce'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:55.640962 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5f654eba-1125-43c9-941c-6c7f52d2f1f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e6f019c87774426bd3823227a93c1ce'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:55.662434 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 902/1814] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:12:55 2022] DELETE /identity/v3/users/9e6f019c87774426bd3823227a93c1ce => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:55.662434 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e158d-a451-4515-9702-6a6afd599205 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:55.664546 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e158d-a451-4515-9702-6a6afd599205 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:55.664914 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e158d-a451-4515-9702-6a6afd599205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:55.720169 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-170e158d-a451-4515-9702-6a6afd599205 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:55.722593 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-170e158d-a451-4515-9702-6a6afd599205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:55.787686 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eeb7ff-6a42-4d69-9dd5-500b0f3d7dff admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:55.878986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 903/1815] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:55.880298 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a82c7-2c38-47ea-b1c9-c5a43ae9b9ed None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:55.880585 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a82c7-2c38-47ea-b1c9-c5a43ae9b9ed None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:55.880865 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a82c7-2c38-47ea-b1c9-c5a43ae9b9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:55.927403 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-9d8a82c7-2c38-47ea-b1c9-c5a43ae9b9ed None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:55.938791 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7114c-1934-4719-a52a-78f851d9ff77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:55.939507 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7114c-1934-4719-a52a-78f851d9ff77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:55.939803 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7114c-1934-4719-a52a-78f851d9ff77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:55.940052 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7114c-1934-4719-a52a-78f851d9ff77 admin admin] PATH_INFO: `/v3/users/d4a8cae8415642e09ae511fad2869f96` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:55.940896 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-9d8a82c7-2c38-47ea-b1c9-c5a43ae9b9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:55.944207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7114c-1934-4719-a52a-78f851d9ff77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4a8cae8415642e09ae511fad2869f96)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:55.945904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7114c-1934-4719-a52a-78f851d9ff77 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:55.966273 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 904/1816] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:55.970673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb831fa9-b5c9-4f5d-91af-0b2abd97de05 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:55.971179 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb831fa9-b5c9-4f5d-91af-0b2abd97de05 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:55.971352 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb831fa9-b5c9-4f5d-91af-0b2abd97de05 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:55.975614 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 905/1817] 10.222.0.26 () {54 vars in 921 bytes} [Tue Sep 13 14:12:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:12:55.976481 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb831fa9-b5c9-4f5d-91af-0b2abd97de05 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:55.981914 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-bb831fa9-b5c9-4f5d-91af-0b2abd97de05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:56.085784 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5ea7114c-1934-4719-a52a-78f851d9ff77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4a8cae8415642e09ae511fad2869f96'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:56.088345 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:56.112227 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5ea7114c-1934-4719-a52a-78f851d9ff77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4a8cae8415642e09ae511fad2869f96'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:56.156069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5ea7114c-1934-4719-a52a-78f851d9ff77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4a8cae8415642e09ae511fad2869f96'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:56.157207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5ea7114c-1934-4719-a52a-78f851d9ff77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4a8cae8415642e09ae511fad2869f96'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:56.202174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5ea7114c-1934-4719-a52a-78f851d9ff77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4a8cae8415642e09ae511fad2869f96'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:56.209461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb831fa9-b5c9-4f5d-91af-0b2abd97de05 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:56.226412 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56413c2-ff35-4096-bd35-e34b51a40e7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:56.228210 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56413c2-ff35-4096-bd35-e34b51a40e7a service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:56.228929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56413c2-ff35-4096-bd35-e34b51a40e7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:56.229413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56413c2-ff35-4096-bd35-e34b51a40e7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:56.241469 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 913/1818] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:12:55 2022] DELETE /identity/v3/users/d4a8cae8415642e09ae511fad2869f96 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:56.242366 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d56413c2-ff35-4096-bd35-e34b51a40e7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:56.243642 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7114c-1934-4719-a52a-78f851d9ff77 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:56.248399 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5ea7114c-1934-4719-a52a-78f851d9ff77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:56.272817 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56413c2-ff35-4096-bd35-e34b51a40e7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:56.275393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56413c2-ff35-4096-bd35-e34b51a40e7a service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:56.348100 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 906/1819] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:56.350359 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb43cc-04f0-470d-9194-27744a569e53 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:56.352136 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb43cc-04f0-470d-9194-27744a569e53 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:56.353353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb43cc-04f0-470d-9194-27744a569e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:56.377473 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7114c-1934-4719-a52a-78f851d9ff77 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:56.388617 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3056132-18fc-40ef-9e62-cfe4b8f35b60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:56.390985 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3056132-18fc-40ef-9e62-cfe4b8f35b60 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:56.391246 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3056132-18fc-40ef-9e62-cfe4b8f35b60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:56.391596 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3056132-18fc-40ef-9e62-cfe4b8f35b60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:56.397186 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f3056132-18fc-40ef-9e62-cfe4b8f35b60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:56.429218 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-adfb43cc-04f0-470d-9194-27744a569e53 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:56.430499 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-adfb43cc-04f0-470d-9194-27744a569e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:56.485225 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:56.578712 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3056132-18fc-40ef-9e62-cfe4b8f35b60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:56.581796 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3056132-18fc-40ef-9e62-cfe4b8f35b60 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:56.611823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 914/1820] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:56.613859 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901eb80-6e74-48b6-9954-8874f895035c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:56.614140 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901eb80-6e74-48b6-9954-8874f895035c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:56.616911 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901eb80-6e74-48b6-9954-8874f895035c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:56.666353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 907/1821] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:56.667331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c901eb80-6e74-48b6-9954-8874f895035c None None] MFA Rules not processed for user `1b3533d0a24e4e7bbf5c7137d3511b13`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:56.678704 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c901eb80-6e74-48b6-9954-8874f895035c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:56.889500 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 915/1822] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Sep 13 14:12:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:56.942774 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc0114-5270-4277-81b2-890652d86a19 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:56.943194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc0114-5270-4277-81b2-890652d86a19 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:56.944981 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901eb80-6e74-48b6-9954-8874f895035c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:56.945827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc0114-5270-4277-81b2-890652d86a19 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:56.957737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 908/1823] 10.222.0.26 () {54 vars in 921 bytes} [Tue Sep 13 14:12:56 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:12:56.994518 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901eb80-6e74-48b6-9954-8874f895035c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:57.022241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48235d-1cc9-4d87-b033-7099a2bd5a34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:57.026568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48235d-1cc9-4d87-b033-7099a2bd5a34 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:57.026959 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48235d-1cc9-4d87-b033-7099a2bd5a34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:57.027178 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48235d-1cc9-4d87-b033-7099a2bd5a34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:57.046684 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:57.061904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48235d-1cc9-4d87-b033-7099a2bd5a34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:57.063942 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48235d-1cc9-4d87-b033-7099a2bd5a34 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:57.088111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 916/1824] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 14:12:57.101675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cafffc-b12a-4e3d-9ab6-5d2fef4ef4fd None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:57.102132 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cafffc-b12a-4e3d-9ab6-5d2fef4ef4fd None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:57.107203 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cafffc-b12a-4e3d-9ab6-5d2fef4ef4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:57.157132 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-a4cafffc-b12a-4e3d-9ab6-5d2fef4ef4fd None None] MFA Rules not processed for user `1b3533d0a24e4e7bbf5c7137d3511b13`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:57.158519 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a4cafffc-b12a-4e3d-9ab6-5d2fef4ef4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:57.186681 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 909/1825] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Sep 13 14:12:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:12:57.210950 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48235d-1cc9-4d87-b033-7099a2bd5a34 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:57.213271 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ea48235d-1cc9-4d87-b033-7099a2bd5a34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:57.250042 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48235d-1cc9-4d87-b033-7099a2bd5a34 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:57.263566 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351378ae-0c54-4d17-9b43-8c22f28e5f6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:57.264204 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351378ae-0c54-4d17-9b43-8c22f28e5f6e service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:57.264483 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351378ae-0c54-4d17-9b43-8c22f28e5f6e service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:57.264748 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351378ae-0c54-4d17-9b43-8c22f28e5f6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:57.287674 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351378ae-0c54-4d17-9b43-8c22f28e5f6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:57.289495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351378ae-0c54-4d17-9b43-8c22f28e5f6e service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:57.317532 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 917/1826] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:57.423922 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cafffc-b12a-4e3d-9ab6-5d2fef4ef4fd None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:57.442385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cafffc-b12a-4e3d-9ab6-5d2fef4ef4fd None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:57.463748 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a258887-96b7-41f2-9cc5-3c5ca989965f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:57.464989 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a258887-96b7-41f2-9cc5-3c5ca989965f service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:57.466128 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a258887-96b7-41f2-9cc5-3c5ca989965f service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:57.466631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a258887-96b7-41f2-9cc5-3c5ca989965f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:57.491824 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a258887-96b7-41f2-9cc5-3c5ca989965f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:57.494175 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a258887-96b7-41f2-9cc5-3c5ca989965f service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:57.513276 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 910/1827] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:12:58.099913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351378ae-0c54-4d17-9b43-8c22f28e5f6e service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:58.101451 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-351378ae-0c54-4d17-9b43-8c22f28e5f6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:58.134910 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351378ae-0c54-4d17-9b43-8c22f28e5f6e service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:58.141978 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc027e-2076-42b3-9524-085ea138288f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:58.142998 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc027e-2076-42b3-9524-085ea138288f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:58.143570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc027e-2076-42b3-9524-085ea138288f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:58.153527 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc027e-2076-42b3-9524-085ea138288f admin admin] PATH_INFO: `/v3/projects/bfcc6d9b2c1640edaf770536f0e21b65` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:58.155539 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc027e-2076-42b3-9524-085ea138288f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfcc6d9b2c1640edaf770536f0e21b65)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:58.157599 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc027e-2076-42b3-9524-085ea138288f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:58.217374 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-44bc027e-2076-42b3-9524-085ea138288f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfcc6d9b2c1640edaf770536f0e21b65', 'request_id': 'req-44bc027e-2076-42b3-9524-085ea138288f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:58.225157 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-44bc027e-2076-42b3-9524-085ea138288f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfcc6d9b2c1640edaf770536f0e21b65', 'request_id': 'req-44bc027e-2076-42b3-9524-085ea138288f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:58.238015 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-44bc027e-2076-42b3-9524-085ea138288f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfcc6d9b2c1640edaf770536f0e21b65', 'request_id': 'req-44bc027e-2076-42b3-9524-085ea138288f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:58.258497 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-44bc027e-2076-42b3-9524-085ea138288f admin admin] The token cache is being invalidate because project bfcc6d9b2c1640edaf770536f0e21b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:12:58.258976 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-44bc027e-2076-42b3-9524-085ea138288f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:58.259766 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-44bc027e-2076-42b3-9524-085ea138288f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:58.262503 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 918/1828] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:12:58 2022] DELETE /identity/v3/projects/bfcc6d9b2c1640edaf770536f0e21b65 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:58.266467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a258887-96b7-41f2-9cc5-3c5ca989965f service nova] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:58.286389 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a258887-96b7-41f2-9cc5-3c5ca989965f service nova] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:58.395970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef40ae1-4664-48d2-bb08-7e1d40a8eb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:58.396986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef40ae1-4664-48d2-bb08-7e1d40a8eb41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:58.397480 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef40ae1-4664-48d2-bb08-7e1d40a8eb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:58.397994 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef40ae1-4664-48d2-bb08-7e1d40a8eb41 admin admin] PATH_INFO: `/v3/users/9b9db2508cb2467b867da940f4b0e37a` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:58.399497 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef40ae1-4664-48d2-bb08-7e1d40a8eb41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b9db2508cb2467b867da940f4b0e37a)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:58.402429 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef40ae1-4664-48d2-bb08-7e1d40a8eb41 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:58.580489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-aef40ae1-4664-48d2-bb08-7e1d40a8eb41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b9db2508cb2467b867da940f4b0e37a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:58.593666 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-aef40ae1-4664-48d2-bb08-7e1d40a8eb41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b9db2508cb2467b867da940f4b0e37a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:58.637643 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-aef40ae1-4664-48d2-bb08-7e1d40a8eb41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b9db2508cb2467b867da940f4b0e37a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:58.639096 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-aef40ae1-4664-48d2-bb08-7e1d40a8eb41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b9db2508cb2467b867da940f4b0e37a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:58.644693 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc027e-2076-42b3-9524-085ea138288f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:58.646464 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-44bc027e-2076-42b3-9524-085ea138288f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:58.658485 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-aef40ae1-4664-48d2-bb08-7e1d40a8eb41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b9db2508cb2467b867da940f4b0e37a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:58.674415 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc027e-2076-42b3-9524-085ea138288f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:58.697643 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a7172-aee1-4095-bac7-7f2ed33ba3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:58.698292 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a7172-aee1-4095-bac7-7f2ed33ba3eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:58.698570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a7172-aee1-4095-bac7-7f2ed33ba3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:58.698845 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a7172-aee1-4095-bac7-7f2ed33ba3eb admin admin] PATH_INFO: `/v3/projects/9947d5bcd9cb40efaf57a8469278cce3` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:58.701607 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a7172-aee1-4095-bac7-7f2ed33ba3eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9947d5bcd9cb40efaf57a8469278cce3)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:58.701882 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 911/1829] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:12:58 2022] DELETE /identity/v3/users/9b9db2508cb2467b867da940f4b0e37a => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:58.703653 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a7172-aee1-4095-bac7-7f2ed33ba3eb admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:58.849148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bd2a7172-aee1-4095-bac7-7f2ed33ba3eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9947d5bcd9cb40efaf57a8469278cce3', 'request_id': 'req-bd2a7172-aee1-4095-bac7-7f2ed33ba3eb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:58.868537 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bd2a7172-aee1-4095-bac7-7f2ed33ba3eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9947d5bcd9cb40efaf57a8469278cce3', 'request_id': 'req-bd2a7172-aee1-4095-bac7-7f2ed33ba3eb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:58.885290 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bd2a7172-aee1-4095-bac7-7f2ed33ba3eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9947d5bcd9cb40efaf57a8469278cce3', 'request_id': 'req-bd2a7172-aee1-4095-bac7-7f2ed33ba3eb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:58.923357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bd2a7172-aee1-4095-bac7-7f2ed33ba3eb admin admin] The token cache is being invalidate because project 9947d5bcd9cb40efaf57a8469278cce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:12:58.925199 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bd2a7172-aee1-4095-bac7-7f2ed33ba3eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:58.926368 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bd2a7172-aee1-4095-bac7-7f2ed33ba3eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:58.931471 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 919/1830] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:12:58 2022] DELETE /identity/v3/projects/9947d5bcd9cb40efaf57a8469278cce3 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:58.937108 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef40ae1-4664-48d2-bb08-7e1d40a8eb41 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:58.940906 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-aef40ae1-4664-48d2-bb08-7e1d40a8eb41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:58.984268 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a7172-aee1-4095-bac7-7f2ed33ba3eb admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:58.985927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-bd2a7172-aee1-4095-bac7-7f2ed33ba3eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:59.005034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:59.096495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:59.101022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef40ae1-4664-48d2-bb08-7e1d40a8eb41 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:59.130161 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a7172-aee1-4095-bac7-7f2ed33ba3eb admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:59.143038 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ed8df-69be-4135-a2fc-b93898724bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:59.143719 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ed8df-69be-4135-a2fc-b93898724bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:59.144092 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ed8df-69be-4135-a2fc-b93898724bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:59.144300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ed8df-69be-4135-a2fc-b93898724bb6 admin admin] PATH_INFO: `/v3/users/cffdd6b7cafa43b297a493b3bcf2db0c` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:59.145628 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ed8df-69be-4135-a2fc-b93898724bb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cffdd6b7cafa43b297a493b3bcf2db0c)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:59.147709 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ed8df-69be-4135-a2fc-b93898724bb6 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:59.252749 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7c5ed8df-69be-4135-a2fc-b93898724bb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cffdd6b7cafa43b297a493b3bcf2db0c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:59.259703 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7c5ed8df-69be-4135-a2fc-b93898724bb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cffdd6b7cafa43b297a493b3bcf2db0c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:59.287914 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7c5ed8df-69be-4135-a2fc-b93898724bb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cffdd6b7cafa43b297a493b3bcf2db0c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:59.295695 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7c5ed8df-69be-4135-a2fc-b93898724bb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cffdd6b7cafa43b297a493b3bcf2db0c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:59.308454 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7c5ed8df-69be-4135-a2fc-b93898724bb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cffdd6b7cafa43b297a493b3bcf2db0c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:59.322197 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 920/1831] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:12:58 2022] DELETE /identity/v3/users/cffdd6b7cafa43b297a493b3bcf2db0c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:12:59.327246 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5b6d5-5350-4e85-a640-893c0ddae8a1 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:59.327576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5b6d5-5350-4e85-a640-893c0ddae8a1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:59.327866 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5b6d5-5350-4e85-a640-893c0ddae8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:59.331423 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45154d-9dc5-4489-98c5-bc9c9c8833e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:59.332279 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45154d-9dc5-4489-98c5-bc9c9c8833e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:59.335572 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45154d-9dc5-4489-98c5-bc9c9c8833e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:59.337510 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45154d-9dc5-4489-98c5-bc9c9c8833e2 admin admin] PATH_INFO: `/v3/users/c14702653dd84343949562ce5398022d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:59.339994 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45154d-9dc5-4489-98c5-bc9c9c8833e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c14702653dd84343949562ce5398022d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:59.350339 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45154d-9dc5-4489-98c5-bc9c9c8833e2 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:12:59.372922 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-35c5b6d5-5350-4e85-a640-893c0ddae8a1 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:12:59.374320 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-35c5b6d5-5350-4e85-a640-893c0ddae8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:59.465131 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2a45154d-9dc5-4489-98c5-bc9c9c8833e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c14702653dd84343949562ce5398022d'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:59.505665 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 921/1832] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:12:59.517230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2a45154d-9dc5-4489-98c5-bc9c9c8833e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c14702653dd84343949562ce5398022d'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:59.538959 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2a45154d-9dc5-4489-98c5-bc9c9c8833e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c14702653dd84343949562ce5398022d'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:59.539704 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2a45154d-9dc5-4489-98c5-bc9c9c8833e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c14702653dd84343949562ce5398022d'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:59.561838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2a45154d-9dc5-4489-98c5-bc9c9c8833e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c14702653dd84343949562ce5398022d'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:12:59.578728 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5b6d5-5350-4e85-a640-893c0ddae8a1 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:12:59.580231 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-35c5b6d5-5350-4e85-a640-893c0ddae8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:59.581509 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 912/1833] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:12:58 2022] DELETE /identity/v3/users/c14702653dd84343949562ce5398022d => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:12:59.703725 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5b6d5-5350-4e85-a640-893c0ddae8a1 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:12:59.737756 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:59.811379 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c81fc6-9707-4d67-b330-8940390c885f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:12:59.812316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c81fc6-9707-4d67-b330-8940390c885f service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:12:59.812316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c81fc6-9707-4d67-b330-8940390c885f service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:12:59.812590 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c81fc6-9707-4d67-b330-8940390c885f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:12:59.823061 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c0c81fc6-9707-4d67-b330-8940390c885f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:12:59.992456 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c81fc6-9707-4d67-b330-8940390c885f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:12:59.994223 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c81fc6-9707-4d67-b330-8940390c885f service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:00.019930 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 922/1834] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:12:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 14:13:00.551758 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45154d-9dc5-4489-98c5-bc9c9c8833e2 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:00.559782 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2a45154d-9dc5-4489-98c5-bc9c9c8833e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:00.597023 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45154d-9dc5-4489-98c5-bc9c9c8833e2 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:00.604905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778fa44-c852-4fc4-b6a0-e3d8d02dec6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:00.605745 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778fa44-c852-4fc4-b6a0-e3d8d02dec6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:00.606087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778fa44-c852-4fc4-b6a0-e3d8d02dec6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:00.606507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778fa44-c852-4fc4-b6a0-e3d8d02dec6c admin admin] PATH_INFO: `/v3/projects/2d39c501072a4aeba158dc656c6075bb` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:00.607900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778fa44-c852-4fc4-b6a0-e3d8d02dec6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d39c501072a4aeba158dc656c6075bb)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:00.610548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778fa44-c852-4fc4-b6a0-e3d8d02dec6c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:00.637085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c81fc6-9707-4d67-b330-8940390c885f service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:00.638626 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c0c81fc6-9707-4d67-b330-8940390c885f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:00.650939 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c81fc6-9707-4d67-b330-8940390c885f service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:00.656884 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c012903-a363-40d2-b554-e8aba1a63c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:00.658100 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c012903-a363-40d2-b554-e8aba1a63c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:00.658100 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c012903-a363-40d2-b554-e8aba1a63c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:00.658307 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c012903-a363-40d2-b554-e8aba1a63c96 admin admin] PATH_INFO: `/v3/projects/91f1cb2bae2a4d9b88208e55ea7e5bb1` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:00.659459 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c012903-a363-40d2-b554-e8aba1a63c96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91f1cb2bae2a4d9b88208e55ea7e5bb1)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:00.661989 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c012903-a363-40d2-b554-e8aba1a63c96 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:00.676214 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:00.682543 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2778fa44-c852-4fc4-b6a0-e3d8d02dec6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d39c501072a4aeba158dc656c6075bb', 'request_id': 'req-2778fa44-c852-4fc4-b6a0-e3d8d02dec6c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:00.692225 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2778fa44-c852-4fc4-b6a0-e3d8d02dec6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d39c501072a4aeba158dc656c6075bb', 'request_id': 'req-2778fa44-c852-4fc4-b6a0-e3d8d02dec6c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:00.702072 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2778fa44-c852-4fc4-b6a0-e3d8d02dec6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d39c501072a4aeba158dc656c6075bb', 'request_id': 'req-2778fa44-c852-4fc4-b6a0-e3d8d02dec6c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:00.718471 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2778fa44-c852-4fc4-b6a0-e3d8d02dec6c admin admin] The token cache is being invalidate because project 2d39c501072a4aeba158dc656c6075bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:00.718859 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2778fa44-c852-4fc4-b6a0-e3d8d02dec6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:00.719604 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2778fa44-c852-4fc4-b6a0-e3d8d02dec6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:00.724665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 913/1835] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:00 2022] DELETE /identity/v3/projects/2d39c501072a4aeba158dc656c6075bb => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:00.734136 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f7a15-4b0f-41f2-b8de-1e6e6a553036 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:00.734425 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f7a15-4b0f-41f2-b8de-1e6e6a553036 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:00.734699 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f7a15-4b0f-41f2-b8de-1e6e6a553036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:00.740747 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9c012903-a363-40d2-b554-e8aba1a63c96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91f1cb2bae2a4d9b88208e55ea7e5bb1', 'request_id': 'req-9c012903-a363-40d2-b554-e8aba1a63c96'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:00.749460 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9c012903-a363-40d2-b554-e8aba1a63c96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91f1cb2bae2a4d9b88208e55ea7e5bb1', 'request_id': 'req-9c012903-a363-40d2-b554-e8aba1a63c96'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:00.758945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9c012903-a363-40d2-b554-e8aba1a63c96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91f1cb2bae2a4d9b88208e55ea7e5bb1', 'request_id': 'req-9c012903-a363-40d2-b554-e8aba1a63c96'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:00.761165 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-fb3f7a15-4b0f-41f2-b8de-1e6e6a553036 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:00.763242 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-fb3f7a15-4b0f-41f2-b8de-1e6e6a553036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:00.771784 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9c012903-a363-40d2-b554-e8aba1a63c96 admin admin] The token cache is being invalidate because project 91f1cb2bae2a4d9b88208e55ea7e5bb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:00.772251 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9c012903-a363-40d2-b554-e8aba1a63c96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:00.773476 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9c012903-a363-40d2-b554-e8aba1a63c96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:00.775301 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 923/1836] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:00 2022] DELETE /identity/v3/projects/91f1cb2bae2a4d9b88208e55ea7e5bb1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:13:00.779422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c012903-a363-40d2-b554-e8aba1a63c96 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:00.781255 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9c012903-a363-40d2-b554-e8aba1a63c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:00.849329 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 914/1837] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:00.850981 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affb7e7-35a9-4d01-a090-77ed2d2a5f72 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:00.851557 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affb7e7-35a9-4d01-a090-77ed2d2a5f72 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:00.851671 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affb7e7-35a9-4d01-a090-77ed2d2a5f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:00.874630 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-2affb7e7-35a9-4d01-a090-77ed2d2a5f72 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:00.875976 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2affb7e7-35a9-4d01-a090-77ed2d2a5f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:00.889640 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:00.890068 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 915/1838] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:00.890996 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affb7e7-35a9-4d01-a090-77ed2d2a5f72 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:00.898171 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c012903-a363-40d2-b554-e8aba1a63c96 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:00.900984 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affb7e7-35a9-4d01-a090-77ed2d2a5f72 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:00.906749 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0774c6-711e-4985-a641-065403bac164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:00.907454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0774c6-711e-4985-a641-065403bac164 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:00.907763 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0774c6-711e-4985-a641-065403bac164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:00.908049 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0774c6-711e-4985-a641-065403bac164 admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:00.908465 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c60e9-d026-482c-8ef2-18c439a2f4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:00.908787 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0774c6-711e-4985-a641-065403bac164 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:13:00.909089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0774c6-711e-4985-a641-065403bac164 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:00.909934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c60e9-d026-482c-8ef2-18c439a2f4f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:00.910224 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c60e9-d026-482c-8ef2-18c439a2f4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:00.910955 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c60e9-d026-482c-8ef2-18c439a2f4f0 admin admin] PATH_INFO: `/v3/users/8089dd0a65d443db9d33b9bd0c239b68` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:00.911069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0774c6-711e-4985-a641-065403bac164 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:00.912218 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c60e9-d026-482c-8ef2-18c439a2f4f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8089dd0a65d443db9d33b9bd0c239b68)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:00.916158 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c60e9-d026-482c-8ef2-18c439a2f4f0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:00.924537 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 916/1839] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:13:00.928900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0774c6-711e-4985-a641-065403bac164 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:00.945153 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0774c6-711e-4985-a641-065403bac164 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:00.950512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12907000-a963-4661-8fad-1b73e7bdb9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:00.951125 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12907000-a963-4661-8fad-1b73e7bdb9e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:00.951402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12907000-a963-4661-8fad-1b73e7bdb9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:00.951678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12907000-a963-4661-8fad-1b73e7bdb9e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:00.952367 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12907000-a963-4661-8fad-1b73e7bdb9e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:00.954322 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12907000-a963-4661-8fad-1b73e7bdb9e4 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:00.991519 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 917/1840] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:00 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:13:00.992384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12907000-a963-4661-8fad-1b73e7bdb9e4 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:01.020092 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-637c60e9-d026-482c-8ef2-18c439a2f4f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8089dd0a65d443db9d33b9bd0c239b68'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:01.029896 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-637c60e9-d026-482c-8ef2-18c439a2f4f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8089dd0a65d443db9d33b9bd0c239b68'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:01.053386 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-637c60e9-d026-482c-8ef2-18c439a2f4f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8089dd0a65d443db9d33b9bd0c239b68'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:01.054252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-637c60e9-d026-482c-8ef2-18c439a2f4f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8089dd0a65d443db9d33b9bd0c239b68'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:01.063121 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-637c60e9-d026-482c-8ef2-18c439a2f4f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8089dd0a65d443db9d33b9bd0c239b68'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:01.069941 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 924/1841] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:13:00 2022] DELETE /identity/v3/users/8089dd0a65d443db9d33b9bd0c239b68 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:13:01.088373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12907000-a963-4661-8fad-1b73e7bdb9e4 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:01.137333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c60e9-d026-482c-8ef2-18c439a2f4f0 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:01.137333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-637c60e9-d026-482c-8ef2-18c439a2f4f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:01.155160 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:01.221472 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc5b60-22eb-4612-b88f-844f7bdb746c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:01.222414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc5b60-22eb-4612-b88f-844f7bdb746c admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:01.222916 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc5b60-22eb-4612-b88f-844f7bdb746c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:01.223658 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc5b60-22eb-4612-b88f-844f7bdb746c admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:01.224702 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc5b60-22eb-4612-b88f-844f7bdb746c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:01.227117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc5b60-22eb-4612-b88f-844f7bdb746c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:01.287259 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c60e9-d026-482c-8ef2-18c439a2f4f0 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:01.289061 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 918/1842] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:00 2022] POST /identity/v3/users => generated 289 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:01.290026 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc5b60-22eb-4612-b88f-844f7bdb746c admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:01.291620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-13dc5b60-22eb-4612-b88f-844f7bdb746c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:01.298195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55656dce-1000-42e3-8602-a40d92842cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:01.299012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55656dce-1000-42e3-8602-a40d92842cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:01.299910 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55656dce-1000-42e3-8602-a40d92842cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:01.300491 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55656dce-1000-42e3-8602-a40d92842cfb admin admin] PATH_INFO: `/v3/projects/e42603f06c224fd99cd65dcd663fde49` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:01.302020 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55656dce-1000-42e3-8602-a40d92842cfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e42603f06c224fd99cd65dcd663fde49)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:01.304334 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55656dce-1000-42e3-8602-a40d92842cfb admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:01.307866 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc5b60-22eb-4612-b88f-844f7bdb746c admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:01.316687 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7e22d-1ede-4dfa-9ad9-5cce44c23e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:01.317609 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7e22d-1ede-4dfa-9ad9-5cce44c23e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:01.318083 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7e22d-1ede-4dfa-9ad9-5cce44c23e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:01.318515 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7e22d-1ede-4dfa-9ad9-5cce44c23e9f admin admin] PATH_INFO: `/v3/projects/cc170dd7fcdc44f7917428f71730e304` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:01.319875 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7e22d-1ede-4dfa-9ad9-5cce44c23e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc170dd7fcdc44f7917428f71730e304)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:01.322354 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7e22d-1ede-4dfa-9ad9-5cce44c23e9f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:01.379857 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-55656dce-1000-42e3-8602-a40d92842cfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e42603f06c224fd99cd65dcd663fde49', 'request_id': 'req-55656dce-1000-42e3-8602-a40d92842cfb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:01.387844 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-55656dce-1000-42e3-8602-a40d92842cfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e42603f06c224fd99cd65dcd663fde49', 'request_id': 'req-55656dce-1000-42e3-8602-a40d92842cfb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:01.399681 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-55656dce-1000-42e3-8602-a40d92842cfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e42603f06c224fd99cd65dcd663fde49', 'request_id': 'req-55656dce-1000-42e3-8602-a40d92842cfb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:01.416385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-8ee7e22d-1ede-4dfa-9ad9-5cce44c23e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc170dd7fcdc44f7917428f71730e304', 'request_id': 'req-8ee7e22d-1ede-4dfa-9ad9-5cce44c23e9f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:01.424671 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-55656dce-1000-42e3-8602-a40d92842cfb admin admin] The token cache is being invalidate because project e42603f06c224fd99cd65dcd663fde49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:01.424977 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-55656dce-1000-42e3-8602-a40d92842cfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:01.425888 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-55656dce-1000-42e3-8602-a40d92842cfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:01.427294 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-8ee7e22d-1ede-4dfa-9ad9-5cce44c23e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc170dd7fcdc44f7917428f71730e304', 'request_id': 'req-8ee7e22d-1ede-4dfa-9ad9-5cce44c23e9f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:01.427993 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 925/1843] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:01 2022] DELETE /identity/v3/projects/e42603f06c224fd99cd65dcd663fde49 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:01.428944 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55656dce-1000-42e3-8602-a40d92842cfb admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:01.432112 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-55656dce-1000-42e3-8602-a40d92842cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:01.437846 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-8ee7e22d-1ede-4dfa-9ad9-5cce44c23e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc170dd7fcdc44f7917428f71730e304', 'request_id': 'req-8ee7e22d-1ede-4dfa-9ad9-5cce44c23e9f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:01.448105 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:01.458103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-8ee7e22d-1ede-4dfa-9ad9-5cce44c23e9f admin admin] The token cache is being invalidate because project cc170dd7fcdc44f7917428f71730e304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:01.465580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-8ee7e22d-1ede-4dfa-9ad9-5cce44c23e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:01.466558 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-8ee7e22d-1ede-4dfa-9ad9-5cce44c23e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:01.468581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 919/1844] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:01 2022] DELETE /identity/v3/projects/cc170dd7fcdc44f7917428f71730e304 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:01.469660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7e22d-1ede-4dfa-9ad9-5cce44c23e9f admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:01.471211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8ee7e22d-1ede-4dfa-9ad9-5cce44c23e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:01.525148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55656dce-1000-42e3-8602-a40d92842cfb admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:01.576567 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7e22d-1ede-4dfa-9ad9-5cce44c23e9f admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:01.583399 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874af12-9529-44fa-87c9-81e19b7b6657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:01.584170 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874af12-9529-44fa-87c9-81e19b7b6657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:01.584571 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874af12-9529-44fa-87c9-81e19b7b6657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:01.584905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874af12-9529-44fa-87c9-81e19b7b6657 admin admin] PATH_INFO: `/v3/users/0bfe064f082d40dd90cd0af83e943624` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:01.586969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874af12-9529-44fa-87c9-81e19b7b6657 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bfe064f082d40dd90cd0af83e943624)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:01.589866 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874af12-9529-44fa-87c9-81e19b7b6657 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:01.604840 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7f1f7-b4b6-49c4-8205-e6062f2174a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:01.606142 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7f1f7-b4b6-49c4-8205-e6062f2174a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:01.606498 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7f1f7-b4b6-49c4-8205-e6062f2174a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:01.606841 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7f1f7-b4b6-49c4-8205-e6062f2174a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:01.607573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a7f1f7-b4b6-49c4-8205-e6062f2174a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:01.609564 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a7f1f7-b4b6-49c4-8205-e6062f2174a8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:01.622834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 926/1845] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:01.623832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7f1f7-b4b6-49c4-8205-e6062f2174a8 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:01.625991 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b3a7f1f7-b4b6-49c4-8205-e6062f2174a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:01.641790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7f1f7-b4b6-49c4-8205-e6062f2174a8 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:01.651093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb6a88-a4d2-43a0-a947-c1692d8e9245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:01.651364 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb6a88-a4d2-43a0-a947-c1692d8e9245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:01.651466 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb6a88-a4d2-43a0-a947-c1692d8e9245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:01.651702 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb6a88-a4d2-43a0-a947-c1692d8e9245 admin admin] PATH_INFO: `/v3/projects/539c443fffe84e2f996441c4b75423b5` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:01.653366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cb6a88-a4d2-43a0-a947-c1692d8e9245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=539c443fffe84e2f996441c4b75423b5)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:01.655650 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cb6a88-a4d2-43a0-a947-c1692d8e9245 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:01.681804 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a874af12-9529-44fa-87c9-81e19b7b6657 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bfe064f082d40dd90cd0af83e943624'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:01.688213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=80,keystone:INSERT=5,keystone:DELETE=15 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:01.692270 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a874af12-9529-44fa-87c9-81e19b7b6657 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bfe064f082d40dd90cd0af83e943624'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:01.715008 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a874af12-9529-44fa-87c9-81e19b7b6657 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bfe064f082d40dd90cd0af83e943624'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:01.715844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a874af12-9529-44fa-87c9-81e19b7b6657 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bfe064f082d40dd90cd0af83e943624'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:01.723682 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a874af12-9529-44fa-87c9-81e19b7b6657 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bfe064f082d40dd90cd0af83e943624'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:01.729937 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f3cb6a88-a4d2-43a0-a947-c1692d8e9245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '539c443fffe84e2f996441c4b75423b5', 'request_id': 'req-f3cb6a88-a4d2-43a0-a947-c1692d8e9245'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:01.732559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 920/1846] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:13:01 2022] DELETE /identity/v3/users/0bfe064f082d40dd90cd0af83e943624 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:01.733896 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100a53e-954e-4b52-95f5-1f52f5d8bcdb None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:01.734174 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100a53e-954e-4b52-95f5-1f52f5d8bcdb None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:01.734441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100a53e-954e-4b52-95f5-1f52f5d8bcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:01.740922 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f3cb6a88-a4d2-43a0-a947-c1692d8e9245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '539c443fffe84e2f996441c4b75423b5', 'request_id': 'req-f3cb6a88-a4d2-43a0-a947-c1692d8e9245'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:01.753546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f3cb6a88-a4d2-43a0-a947-c1692d8e9245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '539c443fffe84e2f996441c4b75423b5', 'request_id': 'req-f3cb6a88-a4d2-43a0-a947-c1692d8e9245'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:01.757915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-9100a53e-954e-4b52-95f5-1f52f5d8bcdb None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:01.759194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-9100a53e-954e-4b52-95f5-1f52f5d8bcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:01.773228 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f3cb6a88-a4d2-43a0-a947-c1692d8e9245 admin admin] The token cache is being invalidate because project 539c443fffe84e2f996441c4b75423b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:01.773228 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f3cb6a88-a4d2-43a0-a947-c1692d8e9245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:01.773552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f3cb6a88-a4d2-43a0-a947-c1692d8e9245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:01.775180 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 927/1847] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:01 2022] DELETE /identity/v3/projects/539c443fffe84e2f996441c4b75423b5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:01.780174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb6a88-a4d2-43a0-a947-c1692d8e9245 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:01.781784 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f3cb6a88-a4d2-43a0-a947-c1692d8e9245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:01.823229 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:01.869571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb6a88-a4d2-43a0-a947-c1692d8e9245 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:01.886401 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 921/1848] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:01.888072 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dca75e-70bf-4913-aebd-e1b7c09bd4f1 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:01.888406 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dca75e-70bf-4913-aebd-e1b7c09bd4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:01.888818 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dca75e-70bf-4913-aebd-e1b7c09bd4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:01.913841 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-42dca75e-70bf-4913-aebd-e1b7c09bd4f1 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:01.915109 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-42dca75e-70bf-4913-aebd-e1b7c09bd4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:01.923812 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 922/1849] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:01.925006 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d06ae-80fe-4224-ad2b-54cc1a0c7db9 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:01.925312 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d06ae-80fe-4224-ad2b-54cc1a0c7db9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:01.925599 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d06ae-80fe-4224-ad2b-54cc1a0c7db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:01.939707 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21cf99-6fb5-49d3-ae76-26978e73acff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:01.940335 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21cf99-6fb5-49d3-ae76-26978e73acff admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:01.940618 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21cf99-6fb5-49d3-ae76-26978e73acff admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:01.940924 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21cf99-6fb5-49d3-ae76-26978e73acff admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:01.941603 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21cf99-6fb5-49d3-ae76-26978e73acff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:01.943249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21cf99-6fb5-49d3-ae76-26978e73acff admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:01.953019 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-2e1d06ae-80fe-4224-ad2b-54cc1a0c7db9 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:01.953019 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2e1d06ae-80fe-4224-ad2b-54cc1a0c7db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:01.958528 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 928/1850] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:01.959833 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed0ef8-f846-4b4a-84c4-2204d65faa87 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:01.960117 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed0ef8-f846-4b4a-84c4-2204d65faa87 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:01.960397 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed0ef8-f846-4b4a-84c4-2204d65faa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:01.967803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 923/1851] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:01.968728 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d06ae-80fe-4224-ad2b-54cc1a0c7db9 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:01.981900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d06ae-80fe-4224-ad2b-54cc1a0c7db9 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:01.982513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b0ed0ef8-f846-4b4a-84c4-2204d65faa87 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:01.983801 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b0ed0ef8-f846-4b4a-84c4-2204d65faa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:01.988379 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72622f-e494-495a-90e8-63ae7339f111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:01.989160 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72622f-e494-495a-90e8-63ae7339f111 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:01.989519 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72622f-e494-495a-90e8-63ae7339f111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:01.989968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72622f-e494-495a-90e8-63ae7339f111 admin admin] PATH_INFO: `/v3/projects/7a6d63820e454d1ab952a22ec2b3758d/users/ec5a017d6c6445bb9b8e3c39641d30ed/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:01.992386 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 929/1852] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:01.996562 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed0ef8-f846-4b4a-84c4-2204d65faa87 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:02.009341 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed0ef8-f846-4b4a-84c4-2204d65faa87 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:02.010678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72622f-e494-495a-90e8-63ae7339f111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a6d63820e454d1ab952a22ec2b3758d, user_id=ec5a017d6c6445bb9b8e3c39641d30ed, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:02.014040 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72622f-e494-495a-90e8-63ae7339f111 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:02.014462 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864872e0-6a77-4a60-8150-7c6549d0ce7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:02.015209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864872e0-6a77-4a60-8150-7c6549d0ce7c admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:02.015493 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864872e0-6a77-4a60-8150-7c6549d0ce7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:02.015764 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864872e0-6a77-4a60-8150-7c6549d0ce7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:02.016420 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864872e0-6a77-4a60-8150-7c6549d0ce7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:13:02.016724 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864872e0-6a77-4a60-8150-7c6549d0ce7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:02.018384 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864872e0-6a77-4a60-8150-7c6549d0ce7c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:02.037884 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 930/1853] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:13:02.037884 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864872e0-6a77-4a60-8150-7c6549d0ce7c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:02.043537 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 924/1854] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:01 2022] PUT /identity/v3/projects/7a6d63820e454d1ab952a22ec2b3758d/users/ec5a017d6c6445bb9b8e3c39641d30ed/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:02.053320 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72622f-e494-495a-90e8-63ae7339f111 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:02.053455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864872e0-6a77-4a60-8150-7c6549d0ce7c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:02.148059 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9714e-ee33-46b8-be3c-67a81e97a148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:02.148676 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9714e-ee33-46b8-be3c-67a81e97a148 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:02.149034 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9714e-ee33-46b8-be3c-67a81e97a148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:02.149628 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9714e-ee33-46b8-be3c-67a81e97a148 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:02.150361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9714e-ee33-46b8-be3c-67a81e97a148 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:13:02.150648 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9714e-ee33-46b8-be3c-67a81e97a148 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:02.153282 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9714e-ee33-46b8-be3c-67a81e97a148 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:02.155965 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72622f-e494-495a-90e8-63ae7339f111 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:02.162594 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e97c48-b92b-40dd-8290-e550c6b1c73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:02.163387 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e97c48-b92b-40dd-8290-e550c6b1c73b admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:02.163738 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e97c48-b92b-40dd-8290-e550c6b1c73b admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:02.164069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e97c48-b92b-40dd-8290-e550c6b1c73b admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:02.164789 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e97c48-b92b-40dd-8290-e550c6b1c73b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:02.166747 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e97c48-b92b-40dd-8290-e550c6b1c73b admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:02.168995 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 931/1855] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:13:02.171193 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558b57e-1b90-471e-87e5-1d81bb4fd2e5 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:02.171193 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558b57e-1b90-471e-87e5-1d81bb4fd2e5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:02.171193 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558b57e-1b90-471e-87e5-1d81bb4fd2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:02.205077 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 925/1856] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:02 2022] POST /identity/v3/projects => generated 409 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:02.206001 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e97c48-b92b-40dd-8290-e550c6b1c73b admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:02.231338 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-7558b57e-1b90-471e-87e5-1d81bb4fd2e5 None None] MFA Rules not processed for user `ec5a017d6c6445bb9b8e3c39641d30ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:02.233286 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7558b57e-1b90-471e-87e5-1d81bb4fd2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:02.239743 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:02.291479 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:02.306413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e97c48-b92b-40dd-8290-e550c6b1c73b admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:02.312065 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb13ed-11b4-462b-8c24-70189185d245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:02.312631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb13ed-11b4-462b-8c24-70189185d245 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:02.312909 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb13ed-11b4-462b-8c24-70189185d245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:02.313209 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb13ed-11b4-462b-8c24-70189185d245 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:02.313848 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb13ed-11b4-462b-8c24-70189185d245 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:02.315752 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb13ed-11b4-462b-8c24-70189185d245 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:02.323545 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 932/1857] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:02.324451 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558b57e-1b90-471e-87e5-1d81bb4fd2e5 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:02.325782 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7558b57e-1b90-471e-87e5-1d81bb4fd2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:02.340872 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558b57e-1b90-471e-87e5-1d81bb4fd2e5 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:02.345773 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da93872-540d-417a-9c53-3e7de8660ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:02.346403 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da93872-540d-417a-9c53-3e7de8660ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:02.346681 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da93872-540d-417a-9c53-3e7de8660ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:02.346973 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da93872-540d-417a-9c53-3e7de8660ddb admin admin] PATH_INFO: `/v3/projects/5a893227b2254e80af761f15279662f0` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:02.352811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da93872-540d-417a-9c53-3e7de8660ddb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a893227b2254e80af761f15279662f0)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:02.353012 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 926/1858] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:02 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:02.353012 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb13ed-11b4-462b-8c24-70189185d245 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:02.353241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da93872-540d-417a-9c53-3e7de8660ddb admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:02.400428 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4da93872-540d-417a-9c53-3e7de8660ddb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a893227b2254e80af761f15279662f0', 'request_id': 'req-4da93872-540d-417a-9c53-3e7de8660ddb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:02.408295 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4da93872-540d-417a-9c53-3e7de8660ddb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a893227b2254e80af761f15279662f0', 'request_id': 'req-4da93872-540d-417a-9c53-3e7de8660ddb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:02.419507 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4da93872-540d-417a-9c53-3e7de8660ddb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a893227b2254e80af761f15279662f0', 'request_id': 'req-4da93872-540d-417a-9c53-3e7de8660ddb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:02.423872 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb13ed-11b4-462b-8c24-70189185d245 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:02.435105 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4da93872-540d-417a-9c53-3e7de8660ddb admin admin] The token cache is being invalidate because project 5a893227b2254e80af761f15279662f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:02.435723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4da93872-540d-417a-9c53-3e7de8660ddb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:02.436509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4da93872-540d-417a-9c53-3e7de8660ddb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:02.440469 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 933/1859] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:02 2022] DELETE /identity/v3/projects/5a893227b2254e80af761f15279662f0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:02.441528 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da93872-540d-417a-9c53-3e7de8660ddb admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:02.443080 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4da93872-540d-417a-9c53-3e7de8660ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:02.492264 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8f32c-e003-4861-860e-791d31053328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:02.493050 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8f32c-e003-4861-860e-791d31053328 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:02.493468 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8f32c-e003-4861-860e-791d31053328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:02.493903 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8f32c-e003-4861-860e-791d31053328 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:02.494949 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8f32c-e003-4861-860e-791d31053328 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:02.498039 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8f32c-e003-4861-860e-791d31053328 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:02.533508 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da93872-540d-417a-9c53-3e7de8660ddb admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:02.533727 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 927/1860] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:02 2022] POST /identity/v3/users => generated 305 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:02.534869 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8f32c-e003-4861-860e-791d31053328 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:02.537285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-58d8f32c-e003-4861-860e-791d31053328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:02.539697 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abef0d9-df43-46b4-8822-bf922f267e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:02.540698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abef0d9-df43-46b4-8822-bf922f267e22 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:02.541217 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abef0d9-df43-46b4-8822-bf922f267e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:02.541637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abef0d9-df43-46b4-8822-bf922f267e22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:02.542422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abef0d9-df43-46b4-8822-bf922f267e22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:02.545256 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abef0d9-df43-46b4-8822-bf922f267e22 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:02.553192 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8f32c-e003-4861-860e-791d31053328 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:02.559417 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9d43e-3537-4fcf-900d-55c56ed2800b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:02.560149 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9d43e-3537-4fcf-900d-55c56ed2800b admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:02.560527 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9d43e-3537-4fcf-900d-55c56ed2800b admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:02.560902 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9d43e-3537-4fcf-900d-55c56ed2800b admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:02.561681 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9d43e-3537-4fcf-900d-55c56ed2800b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:02.564961 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9d43e-3537-4fcf-900d-55c56ed2800b admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:02.585846 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 934/1861] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:02 2022] POST /identity/v3/projects => generated 375 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:02.587470 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7e271-5338-4525-9262-acc12ad7f007 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:02.587937 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7e271-5338-4525-9262-acc12ad7f007 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:02.588341 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7e271-5338-4525-9262-acc12ad7f007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:02.597976 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 928/1862] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:02 2022] POST /identity/v3/users => generated 290 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:02.600300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9d43e-3537-4fcf-900d-55c56ed2800b admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:02.601997 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-11a9d43e-3537-4fcf-900d-55c56ed2800b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:02.633452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-eee7e271-5338-4525-9262-acc12ad7f007 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:02.635339 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-eee7e271-5338-4525-9262-acc12ad7f007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:02.639262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9d43e-3537-4fcf-900d-55c56ed2800b admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:02.677583 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:02.705701 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:02.735220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 935/1863] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:02.736066 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2b118-759f-476d-a245-250680e3bb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:02.736576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7e271-5338-4525-9262-acc12ad7f007 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:02.737743 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2b118-759f-476d-a245-250680e3bb90 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:02.738181 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2b118-759f-476d-a245-250680e3bb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:02.738602 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2b118-759f-476d-a245-250680e3bb90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:02.739392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2b118-759f-476d-a245-250680e3bb90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:02.752131 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2b118-759f-476d-a245-250680e3bb90 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:02.752549 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7e271-5338-4525-9262-acc12ad7f007 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:02.766945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ec772-9275-4c30-af54-63d798917c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:02.767681 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ec772-9275-4c30-af54-63d798917c9e admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:02.768035 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ec772-9275-4c30-af54-63d798917c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:02.769370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ec772-9275-4c30-af54-63d798917c9e admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:02.770052 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ec772-9275-4c30-af54-63d798917c9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:02.772000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ec772-9275-4c30-af54-63d798917c9e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:02.773047 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 929/1864] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:02.774147 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2b118-759f-476d-a245-250680e3bb90 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:02.785472 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2b118-759f-476d-a245-250680e3bb90 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:02.792253 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535fe15-46b4-4565-8674-dfdafab883ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:02.793049 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535fe15-46b4-4565-8674-dfdafab883ef admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:02.793577 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535fe15-46b4-4565-8674-dfdafab883ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:02.794005 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535fe15-46b4-4565-8674-dfdafab883ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:02.794929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535fe15-46b4-4565-8674-dfdafab883ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:02.796804 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535fe15-46b4-4565-8674-dfdafab883ef admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:02.810337 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 936/1865] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:02 2022] POST /identity/v3/users => generated 294 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:02.810337 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e9a5f-fe9c-40e3-b279-deed0b082d9d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:02.810337 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e9a5f-fe9c-40e3-b279-deed0b082d9d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:02.810337 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e9a5f-fe9c-40e3-b279-deed0b082d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:02.815156 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 930/1866] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:02.816250 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535fe15-46b4-4565-8674-dfdafab883ef admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:02.828488 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535fe15-46b4-4565-8674-dfdafab883ef admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:02.835020 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf478a-eb2a-4769-ae0c-d03de78002e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:02.836436 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf478a-eb2a-4769-ae0c-d03de78002e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:02.836872 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf478a-eb2a-4769-ae0c-d03de78002e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:02.837346 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf478a-eb2a-4769-ae0c-d03de78002e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:02.838147 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf478a-eb2a-4769-ae0c-d03de78002e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:02.840642 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf478a-eb2a-4769-ae0c-d03de78002e3 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:02.841674 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-950e9a5f-fe9c-40e3-b279-deed0b082d9d None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:02.843389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-950e9a5f-fe9c-40e3-b279-deed0b082d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:02.857717 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 937/1867] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:02.859032 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e9a5f-fe9c-40e3-b279-deed0b082d9d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:02.866218 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 931/1868] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:02.867781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf478a-eb2a-4769-ae0c-d03de78002e3 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:02.870427 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e9a5f-fe9c-40e3-b279-deed0b082d9d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:02.878133 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9ab81-0859-44a0-a81d-52b213f84411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:02.879147 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9ab81-0859-44a0-a81d-52b213f84411 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:02.880317 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9ab81-0859-44a0-a81d-52b213f84411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:02.880805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9ab81-0859-44a0-a81d-52b213f84411 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:02.882294 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9ab81-0859-44a0-a81d-52b213f84411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:02.884376 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf478a-eb2a-4769-ae0c-d03de78002e3 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:02.884714 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9ab81-0859-44a0-a81d-52b213f84411 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:02.891177 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd10a8-6470-4bcf-be8a-9816c5949cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:02.891623 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd10a8-6470-4bcf-be8a-9816c5949cdf admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:02.891996 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd10a8-6470-4bcf-be8a-9816c5949cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:02.892365 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd10a8-6470-4bcf-be8a-9816c5949cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:02.893878 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd10a8-6470-4bcf-be8a-9816c5949cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:02.895751 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd10a8-6470-4bcf-be8a-9816c5949cdf admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:02.900927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 938/1869] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:02.901924 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9ab81-0859-44a0-a81d-52b213f84411 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:02.914995 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9ab81-0859-44a0-a81d-52b213f84411 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:02.919446 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 932/1870] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:02.919446 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd10a8-6470-4bcf-be8a-9816c5949cdf admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:02.931506 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd10a8-6470-4bcf-be8a-9816c5949cdf admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:02.935493 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bc6fb-134b-494a-92d0-1b4336447054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:02.936137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bc6fb-134b-494a-92d0-1b4336447054 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:02.936419 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bc6fb-134b-494a-92d0-1b4336447054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:02.936693 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bc6fb-134b-494a-92d0-1b4336447054 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:02.937928 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39bc6fb-134b-494a-92d0-1b4336447054 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:13:02.937928 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39bc6fb-134b-494a-92d0-1b4336447054 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:02.938277 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4700ff-3a19-4c43-921c-19241fa27b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:02.939482 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39bc6fb-134b-494a-92d0-1b4336447054 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:02.940061 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4700ff-3a19-4c43-921c-19241fa27b6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:02.940561 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4700ff-3a19-4c43-921c-19241fa27b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:02.941207 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4700ff-3a19-4c43-921c-19241fa27b6d admin admin] PATH_INFO: `/v3/projects/cfe8c011309d43fcb83c1b0fedc264dc/users/3ca73b6a26164c1bb55a77c63c3ae2f4/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:02.953594 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 939/1871] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:13:02.954479 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bc6fb-134b-494a-92d0-1b4336447054 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:02.962414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4700ff-3a19-4c43-921c-19241fa27b6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfe8c011309d43fcb83c1b0fedc264dc, user_id=3ca73b6a26164c1bb55a77c63c3ae2f4, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:02.966581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4700ff-3a19-4c43-921c-19241fa27b6d admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:02.966717 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bc6fb-134b-494a-92d0-1b4336447054 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:02.971973 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d436b5-c5d3-464e-9e57-3ef07252c8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:02.972538 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d436b5-c5d3-464e-9e57-3ef07252c8b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:02.972982 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d436b5-c5d3-464e-9e57-3ef07252c8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:02.973310 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d436b5-c5d3-464e-9e57-3ef07252c8b9 admin admin] PATH_INFO: `/v3/projects/62a8fc961a1f4f7496185b60e714a8e1/users/2aac365986a741e5aa1da5d1faffe01c/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:02.987177 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 933/1872] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:02 2022] PUT /identity/v3/projects/cfe8c011309d43fcb83c1b0fedc264dc/users/3ca73b6a26164c1bb55a77c63c3ae2f4/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:02.988590 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4700ff-3a19-4c43-921c-19241fa27b6d admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:03.002977 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d436b5-c5d3-464e-9e57-3ef07252c8b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a8fc961a1f4f7496185b60e714a8e1, user_id=2aac365986a741e5aa1da5d1faffe01c, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:03.006326 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d436b5-c5d3-464e-9e57-3ef07252c8b9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:03.035430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 940/1873] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:02 2022] PUT /identity/v3/projects/62a8fc961a1f4f7496185b60e714a8e1/users/2aac365986a741e5aa1da5d1faffe01c/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:03.036440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d436b5-c5d3-464e-9e57-3ef07252c8b9 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:03.076625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4700ff-3a19-4c43-921c-19241fa27b6d admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:03.119579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d436b5-c5d3-464e-9e57-3ef07252c8b9 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:03.133475 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d049a-0a34-4980-873d-affed420baa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:03.134139 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d049a-0a34-4980-873d-affed420baa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:03.134491 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d049a-0a34-4980-873d-affed420baa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:03.134978 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d049a-0a34-4980-873d-affed420baa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:03.135705 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d049a-0a34-4980-873d-affed420baa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:03.138379 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d049a-0a34-4980-873d-affed420baa1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:03.147041 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975d2e1-3b84-4405-a65f-0649b53e1056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:03.147705 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975d2e1-3b84-4405-a65f-0649b53e1056 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:03.147983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975d2e1-3b84-4405-a65f-0649b53e1056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:03.148270 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975d2e1-3b84-4405-a65f-0649b53e1056 admin admin] PATH_INFO: `/v3/projects/dd2901b1c5c640158d43cf77dfd42bfd/users/4f2ffe6fcb014774aba7c7cf523c70b4/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:03.160684 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:03.164501 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975d2e1-3b84-4405-a65f-0649b53e1056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd2901b1c5c640158d43cf77dfd42bfd, user_id=4f2ffe6fcb014774aba7c7cf523c70b4, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:03.167239 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975d2e1-3b84-4405-a65f-0649b53e1056 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:03.173787 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 941/1874] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:03 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:03.173787 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244a55c-23f2-479f-8ab2-33baa2d5cbf6 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:03.173787 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244a55c-23f2-479f-8ab2-33baa2d5cbf6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:03.173787 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244a55c-23f2-479f-8ab2-33baa2d5cbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:03.193748 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 934/1875] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:02 2022] PUT /identity/v3/projects/dd2901b1c5c640158d43cf77dfd42bfd/users/4f2ffe6fcb014774aba7c7cf523c70b4/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:03.193748 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975d2e1-3b84-4405-a65f-0649b53e1056 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:03.208939 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-9244a55c-23f2-479f-8ab2-33baa2d5cbf6 None None] MFA Rules not processed for user `3ca73b6a26164c1bb55a77c63c3ae2f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:03.210272 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9244a55c-23f2-479f-8ab2-33baa2d5cbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:03.267582 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975d2e1-3b84-4405-a65f-0649b53e1056 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:03.269543 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:03.272723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc34d4f-dc5e-48d8-8b00-fb34592e07fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:03.273405 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc34d4f-dc5e-48d8-8b00-fb34592e07fd admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:03.273688 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc34d4f-dc5e-48d8-8b00-fb34592e07fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:03.273959 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc34d4f-dc5e-48d8-8b00-fb34592e07fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:03.274614 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc34d4f-dc5e-48d8-8b00-fb34592e07fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:03.276224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc34d4f-dc5e-48d8-8b00-fb34592e07fd admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:03.289489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 935/1876] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:03.290382 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc34d4f-dc5e-48d8-8b00-fb34592e07fd admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:03.299243 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 942/1877] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:03 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:03.300863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0eaf9-3c78-4dca-b6e6-b9f7b3e12fd2 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:03.301187 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0eaf9-3c78-4dca-b6e6-b9f7b3e12fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:03.301461 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0eaf9-3c78-4dca-b6e6-b9f7b3e12fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:03.304295 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc34d4f-dc5e-48d8-8b00-fb34592e07fd admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:03.311624 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730efd93-f9c9-4dbd-b287-84c6964fe639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:03.312433 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730efd93-f9c9-4dbd-b287-84c6964fe639 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:03.313070 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730efd93-f9c9-4dbd-b287-84c6964fe639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:03.313446 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730efd93-f9c9-4dbd-b287-84c6964fe639 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:03.314153 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730efd93-f9c9-4dbd-b287-84c6964fe639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:03.317642 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730efd93-f9c9-4dbd-b287-84c6964fe639 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:03.343814 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-bcc0eaf9-3c78-4dca-b6e6-b9f7b3e12fd2 None None] MFA Rules not processed for user `4f2ffe6fcb014774aba7c7cf523c70b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:03.345176 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-bcc0eaf9-3c78-4dca-b6e6-b9f7b3e12fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:03.348647 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 936/1878] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:03 2022] POST /identity/v3/users => generated 289 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:03.348647 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730efd93-f9c9-4dbd-b287-84c6964fe639 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:03.360429 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730efd93-f9c9-4dbd-b287-84c6964fe639 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:03.365889 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5405a-be65-4d06-9024-ad774ad7d39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:03.366550 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5405a-be65-4d06-9024-ad774ad7d39e admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:03.366828 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5405a-be65-4d06-9024-ad774ad7d39e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:03.367230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5405a-be65-4d06-9024-ad774ad7d39e admin admin] PATH_INFO: `/v3/projects/62a8fc961a1f4f7496185b60e714a8e1/users/2aac365986a741e5aa1da5d1faffe01c/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:03.369455 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5405a-be65-4d06-9024-ad774ad7d39e admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a8fc961a1f4f7496185b60e714a8e1, user_id=2aac365986a741e5aa1da5d1faffe01c, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:03.372619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5405a-be65-4d06-9024-ad774ad7d39e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:03.385217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 937/1879] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:03 2022] PUT /identity/v3/projects/62a8fc961a1f4f7496185b60e714a8e1/users/2aac365986a741e5aa1da5d1faffe01c/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:03.385920 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5405a-be65-4d06-9024-ad774ad7d39e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:03.421618 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 943/1880] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:03.425182 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0eaf9-3c78-4dca-b6e6-b9f7b3e12fd2 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:03.435906 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0eaf9-3c78-4dca-b6e6-b9f7b3e12fd2 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:03.477581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5405a-be65-4d06-9024-ad774ad7d39e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:03.482891 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f450c7-70fe-472e-9495-08c4bc60ff10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:03.483491 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f450c7-70fe-472e-9495-08c4bc60ff10 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:03.483766 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f450c7-70fe-472e-9495-08c4bc60ff10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:03.484034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f450c7-70fe-472e-9495-08c4bc60ff10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:03.484659 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f450c7-70fe-472e-9495-08c4bc60ff10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:03.486578 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f450c7-70fe-472e-9495-08c4bc60ff10 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:03.497203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58307037-525a-4432-ac00-01b95f3edc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:03.497892 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58307037-525a-4432-ac00-01b95f3edc19 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:03.498246 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58307037-525a-4432-ac00-01b95f3edc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:03.498519 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58307037-525a-4432-ac00-01b95f3edc19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:03.499160 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58307037-525a-4432-ac00-01b95f3edc19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:03.500761 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58307037-525a-4432-ac00-01b95f3edc19 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:03.510703 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 944/1881] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:03.512014 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b6795-7c1f-4a59-b053-17c2e0aa2822 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:03.512290 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b6795-7c1f-4a59-b053-17c2e0aa2822 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:03.512566 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b6795-7c1f-4a59-b053-17c2e0aa2822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:03.514266 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 938/1882] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:03 2022] POST /identity/v3/projects => generated 407 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:03.514962 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f450c7-70fe-472e-9495-08c4bc60ff10 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:03.541864 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-fd0b6795-7c1f-4a59-b053-17c2e0aa2822 None None] MFA Rules not processed for user `2aac365986a741e5aa1da5d1faffe01c`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:03.543190 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fd0b6795-7c1f-4a59-b053-17c2e0aa2822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:03.564382 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:03.583080 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f450c7-70fe-472e-9495-08c4bc60ff10 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:03.587825 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734dbd0-0746-4b43-be80-b504a79f5bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:03.588432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734dbd0-0746-4b43-be80-b504a79f5bde admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:03.588713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734dbd0-0746-4b43-be80-b504a79f5bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:03.588987 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734dbd0-0746-4b43-be80-b504a79f5bde admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:03.589653 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734dbd0-0746-4b43-be80-b504a79f5bde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:03.592157 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734dbd0-0746-4b43-be80-b504a79f5bde admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:03.609593 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:03.613962 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 945/1883] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:03.615002 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b6795-7c1f-4a59-b053-17c2e0aa2822 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:03.633322 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 939/1884] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:03 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:03.633322 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734dbd0-0746-4b43-be80-b504a79f5bde admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:03.633611 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b6795-7c1f-4a59-b053-17c2e0aa2822 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:03.692670 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5db04f-6224-4fd1-95a4-16d4ab302581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:03.693238 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5db04f-6224-4fd1-95a4-16d4ab302581 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:03.693521 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5db04f-6224-4fd1-95a4-16d4ab302581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:03.693794 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5db04f-6224-4fd1-95a4-16d4ab302581 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:03.693891 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734dbd0-0746-4b43-be80-b504a79f5bde admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:03.694439 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5db04f-6224-4fd1-95a4-16d4ab302581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:03.696097 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5db04f-6224-4fd1-95a4-16d4ab302581 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:03.698509 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356803ab-4aca-46af-b00e-8677c171f01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:03.699113 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356803ab-4aca-46af-b00e-8677c171f01e admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:03.699421 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356803ab-4aca-46af-b00e-8677c171f01e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:03.699698 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356803ab-4aca-46af-b00e-8677c171f01e admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:03.700326 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356803ab-4aca-46af-b00e-8677c171f01e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:03.702259 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356803ab-4aca-46af-b00e-8677c171f01e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:03.706067 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 946/1885] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:03.706936 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5db04f-6224-4fd1-95a4-16d4ab302581 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:03.710274 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8e5db04f-6224-4fd1-95a4-16d4ab302581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:03.723854 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 940/1886] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:03 2022] POST /identity/v3/users => generated 310 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:03.724825 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356803ab-4aca-46af-b00e-8677c171f01e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:03.735062 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356803ab-4aca-46af-b00e-8677c171f01e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:03.739807 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fb836-b486-40f7-99ee-9f5fe5ca2747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:03.740394 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fb836-b486-40f7-99ee-9f5fe5ca2747 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:03.740653 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fb836-b486-40f7-99ee-9f5fe5ca2747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:03.740916 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fb836-b486-40f7-99ee-9f5fe5ca2747 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:03.741569 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fb836-b486-40f7-99ee-9f5fe5ca2747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:03.743469 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fb836-b486-40f7-99ee-9f5fe5ca2747 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:03.765947 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 941/1887] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:03 2022] POST /identity/v3/users => generated 297 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:03.767002 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fb836-b486-40f7-99ee-9f5fe5ca2747 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:03.774102 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5db04f-6224-4fd1-95a4-16d4ab302581 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:03.776571 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fb836-b486-40f7-99ee-9f5fe5ca2747 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:03.777780 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cec72-f97b-40a6-86fc-2386905ac067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:03.778386 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cec72-f97b-40a6-86fc-2386905ac067 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:03.778663 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cec72-f97b-40a6-86fc-2386905ac067 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:03.778940 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cec72-f97b-40a6-86fc-2386905ac067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:03.780941 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ea2cec72-f97b-40a6-86fc-2386905ac067 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:03.781657 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0b265-49b3-48f7-a51b-9e26c843945c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:03.782291 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0b265-49b3-48f7-a51b-9e26c843945c admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:03.782564 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0b265-49b3-48f7-a51b-9e26c843945c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:03.782831 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0b265-49b3-48f7-a51b-9e26c843945c admin admin] PATH_INFO: `/v3/projects/5839a50c6ac540db840dd10a5d0b98e7/users/df311f3d30de4ee780dbbf69e029f586/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:03.798803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0b265-49b3-48f7-a51b-9e26c843945c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5839a50c6ac540db840dd10a5d0b98e7, user_id=df311f3d30de4ee780dbbf69e029f586, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:03.802181 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0b265-49b3-48f7-a51b-9e26c843945c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:03.816481 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 942/1888] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:03 2022] PUT /identity/v3/projects/5839a50c6ac540db840dd10a5d0b98e7/users/df311f3d30de4ee780dbbf69e029f586/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:03.817517 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0b265-49b3-48f7-a51b-9e26c843945c admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:03.842812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cec72-f97b-40a6-86fc-2386905ac067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:03.844402 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cec72-f97b-40a6-86fc-2386905ac067 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:03.853706 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 947/1889] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:03.854522 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cec72-f97b-40a6-86fc-2386905ac067 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:03.865553 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cec72-f97b-40a6-86fc-2386905ac067 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:03.882915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0b265-49b3-48f7-a51b-9e26c843945c admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:03.888972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426c14a-f688-4d40-b6c5-0bd786c17d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:03.889649 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426c14a-f688-4d40-b6c5-0bd786c17d0c admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:03.889911 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426c14a-f688-4d40-b6c5-0bd786c17d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:03.890574 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426c14a-f688-4d40-b6c5-0bd786c17d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:03.891228 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426c14a-f688-4d40-b6c5-0bd786c17d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:03.893770 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426c14a-f688-4d40-b6c5-0bd786c17d0c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:03.909140 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 943/1890] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:03.909325 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b876c-3b71-4b90-929b-86244de9a621 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:03.909801 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b876c-3b71-4b90-929b-86244de9a621 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:03.910083 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b876c-3b71-4b90-929b-86244de9a621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:03.914387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:03.927328 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f17300-112c-4f94-9361-dfc0f2f5d9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:03.927954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f17300-112c-4f94-9361-dfc0f2f5d9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:03.928247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f17300-112c-4f94-9361-dfc0f2f5d9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:03.928508 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f17300-112c-4f94-9361-dfc0f2f5d9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:03.929180 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f17300-112c-4f94-9361-dfc0f2f5d9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:03.930795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f17300-112c-4f94-9361-dfc0f2f5d9a2 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:03.935300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:03.946248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 948/1891] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:03.946248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f17300-112c-4f94-9361-dfc0f2f5d9a2 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:03.946497 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-637b876c-3b71-4b90-929b-86244de9a621 None None] MFA Rules not processed for user `df311f3d30de4ee780dbbf69e029f586`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:03.946827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-637b876c-3b71-4b90-929b-86244de9a621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:03.956725 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f17300-112c-4f94-9361-dfc0f2f5d9a2 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:03.962351 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579fbc07-4058-4f78-ad95-b5f02fe8a816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:03.962947 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fbc07-4058-4f78-ad95-b5f02fe8a816 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:03.963374 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fbc07-4058-4f78-ad95-b5f02fe8a816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:03.963665 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fbc07-4058-4f78-ad95-b5f02fe8a816 admin admin] PATH_INFO: `/v3/projects/458fb7fba0364121b52ef7da60bb461b/users/b8619c8f302e4495b6b6845e09399b62/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:03.993408 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579fbc07-4058-4f78-ad95-b5f02fe8a816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=458fb7fba0364121b52ef7da60bb461b, user_id=b8619c8f302e4495b6b6845e09399b62, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:03.998387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579fbc07-4058-4f78-ad95-b5f02fe8a816 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:04.015528 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 949/1892] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:03 2022] PUT /identity/v3/projects/458fb7fba0364121b52ef7da60bb461b/users/b8619c8f302e4495b6b6845e09399b62/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:04.016528 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579fbc07-4058-4f78-ad95-b5f02fe8a816 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:04.033313 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 944/1893] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:04.033313 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b876c-3b71-4b90-929b-86244de9a621 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:04.045463 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b876c-3b71-4b90-929b-86244de9a621 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:04.106682 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579fbc07-4058-4f78-ad95-b5f02fe8a816 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:04.117197 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be431c-3386-4316-959d-db42a34835e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:04.118015 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be431c-3386-4316-959d-db42a34835e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:04.118309 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be431c-3386-4316-959d-db42a34835e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:04.118662 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be431c-3386-4316-959d-db42a34835e7 admin admin] PATH_INFO: `/v3/projects/36edf304b5b4443187e0290720d8c35b/users/55d8c89e03fb4d5da3381afc02bb2f68/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:04.124511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c2e88-bf08-46f8-9720-b2d7bd05b101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:04.125379 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c2e88-bf08-46f8-9720-b2d7bd05b101 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:04.125733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c2e88-bf08-46f8-9720-b2d7bd05b101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:04.126072 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c2e88-bf08-46f8-9720-b2d7bd05b101 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:04.126792 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c2e88-bf08-46f8-9720-b2d7bd05b101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:04.128449 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c2e88-bf08-46f8-9720-b2d7bd05b101 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:04.140371 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 945/1894] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:04.141437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c2e88-bf08-46f8-9720-b2d7bd05b101 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:04.159969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c2e88-bf08-46f8-9720-b2d7bd05b101 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:04.162335 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be431c-3386-4316-959d-db42a34835e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36edf304b5b4443187e0290720d8c35b, user_id=55d8c89e03fb4d5da3381afc02bb2f68, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:04.166892 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be431c-3386-4316-959d-db42a34835e7 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:04.173435 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649af6c3-04bf-43bc-b477-0f2bbe482606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:04.174084 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649af6c3-04bf-43bc-b477-0f2bbe482606 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:04.174438 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649af6c3-04bf-43bc-b477-0f2bbe482606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:04.174935 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649af6c3-04bf-43bc-b477-0f2bbe482606 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:04.175656 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649af6c3-04bf-43bc-b477-0f2bbe482606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:04.177814 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649af6c3-04bf-43bc-b477-0f2bbe482606 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:04.193888 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 950/1895] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:04 2022] PUT /identity/v3/projects/36edf304b5b4443187e0290720d8c35b/users/55d8c89e03fb4d5da3381afc02bb2f68/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:04.199860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be431c-3386-4316-959d-db42a34835e7 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:04.233998 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 946/1896] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:04 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:04.235296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649af6c3-04bf-43bc-b477-0f2bbe482606 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:04.300799 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be431c-3386-4316-959d-db42a34835e7 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:04.331357 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649af6c3-04bf-43bc-b477-0f2bbe482606 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:04.337927 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330bc85f-084b-4bcb-a966-c159cae49600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:04.338608 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bc85f-084b-4bcb-a966-c159cae49600 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:04.339177 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bc85f-084b-4bcb-a966-c159cae49600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:04.339177 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bc85f-084b-4bcb-a966-c159cae49600 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:04.339782 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330bc85f-084b-4bcb-a966-c159cae49600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:04.342001 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330bc85f-084b-4bcb-a966-c159cae49600 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:04.363263 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 947/1897] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:04.364604 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330bc85f-084b-4bcb-a966-c159cae49600 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:04.385478 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330bc85f-084b-4bcb-a966-c159cae49600 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:04.394968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b7fde-a01e-4ddc-97f3-425181df17fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:04.396194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b7fde-a01e-4ddc-97f3-425181df17fd admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:04.396949 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b7fde-a01e-4ddc-97f3-425181df17fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:04.397479 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b7fde-a01e-4ddc-97f3-425181df17fd admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:04.398441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b7fde-a01e-4ddc-97f3-425181df17fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:04.401255 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b7fde-a01e-4ddc-97f3-425181df17fd admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:04.404705 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:04.414106 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:04.417499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418f950-aabe-48a8-8846-493ec46fd537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:04.418690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418f950-aabe-48a8-8846-493ec46fd537 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:04.418972 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418f950-aabe-48a8-8846-493ec46fd537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:04.419641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418f950-aabe-48a8-8846-493ec46fd537 admin admin] PATH_INFO: `/v3/projects/458fb7fba0364121b52ef7da60bb461b/users/b8619c8f302e4495b6b6845e09399b62/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:04.422117 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b418f950-aabe-48a8-8846-493ec46fd537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=458fb7fba0364121b52ef7da60bb461b, user_id=b8619c8f302e4495b6b6845e09399b62, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:04.424852 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b418f950-aabe-48a8-8846-493ec46fd537 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:04.431044 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 948/1898] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:04 2022] POST /identity/v3/users => generated 289 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:04.435115 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b7fde-a01e-4ddc-97f3-425181df17fd admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:04.445162 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 951/1899] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:04 2022] PUT /identity/v3/projects/458fb7fba0364121b52ef7da60bb461b/users/b8619c8f302e4495b6b6845e09399b62/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:04.445162 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418f950-aabe-48a8-8846-493ec46fd537 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:04.448021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b7fde-a01e-4ddc-97f3-425181df17fd admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:04.539261 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d535c7c-f2f5-46f7-a336-4664767ae275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:04.540140 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d535c7c-f2f5-46f7-a336-4664767ae275 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:04.540523 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d535c7c-f2f5-46f7-a336-4664767ae275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:04.540708 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418f950-aabe-48a8-8846-493ec46fd537 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:04.541548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d535c7c-f2f5-46f7-a336-4664767ae275 admin admin] PATH_INFO: `/v3/projects/36edf304b5b4443187e0290720d8c35b/users/55d8c89e03fb4d5da3381afc02bb2f68/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:04.546549 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ead87-b165-4883-a61e-eedec3ca5173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:04.547295 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ead87-b165-4883-a61e-eedec3ca5173 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:04.547565 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ead87-b165-4883-a61e-eedec3ca5173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:04.547835 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ead87-b165-4883-a61e-eedec3ca5173 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:04.547930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d535c7c-f2f5-46f7-a336-4664767ae275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36edf304b5b4443187e0290720d8c35b, user_id=55d8c89e03fb4d5da3381afc02bb2f68, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:04.548478 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ead87-b165-4883-a61e-eedec3ca5173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:04.550285 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ead87-b165-4883-a61e-eedec3ca5173 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:04.550856 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d535c7c-f2f5-46f7-a336-4664767ae275 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:04.564072 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 952/1900] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:04.564072 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a6a8f-15bd-4722-b8b8-39c0694e0d0e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:04.564072 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a6a8f-15bd-4722-b8b8-39c0694e0d0e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:04.564072 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a6a8f-15bd-4722-b8b8-39c0694e0d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:04.569174 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 949/1901] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:04 2022] PUT /identity/v3/projects/36edf304b5b4443187e0290720d8c35b/users/55d8c89e03fb4d5da3381afc02bb2f68/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:04.570870 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d535c7c-f2f5-46f7-a336-4664767ae275 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:04.592333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d83a6a8f-15bd-4722-b8b8-39c0694e0d0e None None] MFA Rules not processed for user `b8619c8f302e4495b6b6845e09399b62`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:04.593643 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d83a6a8f-15bd-4722-b8b8-39c0694e0d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:04.655824 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d535c7c-f2f5-46f7-a336-4664767ae275 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:04.661020 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f933ab0-19e0-478e-902b-53268d599506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:04.661702 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f933ab0-19e0-478e-902b-53268d599506 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:04.661949 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f933ab0-19e0-478e-902b-53268d599506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:04.662222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f933ab0-19e0-478e-902b-53268d599506 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:04.662862 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f933ab0-19e0-478e-902b-53268d599506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:04.664576 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f933ab0-19e0-478e-902b-53268d599506 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:04.673077 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 953/1902] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:04 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:04.674395 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25382938-9c33-4c47-80dd-7ea59226ee60 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:04.674683 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25382938-9c33-4c47-80dd-7ea59226ee60 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:04.674958 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25382938-9c33-4c47-80dd-7ea59226ee60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:04.678014 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 950/1903] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:04.682043 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f933ab0-19e0-478e-902b-53268d599506 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:04.692899 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f933ab0-19e0-478e-902b-53268d599506 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:04.697481 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454ebe8-bfba-4626-ae7f-5dce0a5b39bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:04.698119 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454ebe8-bfba-4626-ae7f-5dce0a5b39bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:04.698392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454ebe8-bfba-4626-ae7f-5dce0a5b39bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:04.698657 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454ebe8-bfba-4626-ae7f-5dce0a5b39bf admin admin] PATH_INFO: `/v3/projects/a652e9a1e61748e89fa408dee9ab922a/users/6c15798d9e864487a534944dd0cccfcb/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:04.706222 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-25382938-9c33-4c47-80dd-7ea59226ee60 None None] MFA Rules not processed for user `55d8c89e03fb4d5da3381afc02bb2f68`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:04.707438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-25382938-9c33-4c47-80dd-7ea59226ee60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:04.715546 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454ebe8-bfba-4626-ae7f-5dce0a5b39bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a652e9a1e61748e89fa408dee9ab922a, user_id=6c15798d9e864487a534944dd0cccfcb, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:04.718293 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454ebe8-bfba-4626-ae7f-5dce0a5b39bf admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:04.733881 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 951/1904] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:04 2022] PUT /identity/v3/projects/a652e9a1e61748e89fa408dee9ab922a/users/6c15798d9e864487a534944dd0cccfcb/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:04.737980 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454ebe8-bfba-4626-ae7f-5dce0a5b39bf admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:04.776736 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:04.788089 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 954/1905] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:04.789373 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d75a81-8075-4a16-9cf4-4c98a85c682d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:04.789635 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d75a81-8075-4a16-9cf4-4c98a85c682d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:04.789906 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d75a81-8075-4a16-9cf4-4c98a85c682d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:04.803087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454ebe8-bfba-4626-ae7f-5dce0a5b39bf admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:04.807064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbef51-66d6-4a3f-ac03-ba12a6ee818f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:04.807666 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbef51-66d6-4a3f-ac03-ba12a6ee818f service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:04.807957 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbef51-66d6-4a3f-ac03-ba12a6ee818f service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:04.808204 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbef51-66d6-4a3f-ac03-ba12a6ee818f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:04.818151 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c9d75a81-8075-4a16-9cf4-4c98a85c682d None None] MFA Rules not processed for user `6c15798d9e864487a534944dd0cccfcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:04.819359 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c9d75a81-8075-4a16-9cf4-4c98a85c682d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:04.820880 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:04.875225 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbef51-66d6-4a3f-ac03-ba12a6ee818f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:04.877118 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbef51-66d6-4a3f-ac03-ba12a6ee818f service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:04.885791 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 955/1906] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:04.886641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d75a81-8075-4a16-9cf4-4c98a85c682d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:04.887353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 952/1907] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:04 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:04.888245 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c9d75a81-8075-4a16-9cf4-4c98a85c682d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:04.890140 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbef51-66d6-4a3f-ac03-ba12a6ee818f service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:04.900331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d75a81-8075-4a16-9cf4-4c98a85c682d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:04.904795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171af6a-b879-44f5-b7df-b2e60f376a60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:04.905495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171af6a-b879-44f5-b7df-b2e60f376a60 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:04.905791 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171af6a-b879-44f5-b7df-b2e60f376a60 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:04.905977 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171af6a-b879-44f5-b7df-b2e60f376a60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:04.977524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbef51-66d6-4a3f-ac03-ba12a6ee818f service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:04.980524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171af6a-b879-44f5-b7df-b2e60f376a60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:04.982716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171af6a-b879-44f5-b7df-b2e60f376a60 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:04.982972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd5168-6113-4a94-9601-71bd4f1055a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:04.983574 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd5168-6113-4a94-9601-71bd4f1055a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:04.983852 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd5168-6113-4a94-9601-71bd4f1055a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:04.984179 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd5168-6113-4a94-9601-71bd4f1055a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:04.984780 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd5168-6113-4a94-9601-71bd4f1055a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:04.986879 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd5168-6113-4a94-9601-71bd4f1055a5 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:04.994215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 956/1908] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:05.019815 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 953/1909] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:04 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:05.021035 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171af6a-b879-44f5-b7df-b2e60f376a60 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:05.033203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171af6a-b879-44f5-b7df-b2e60f376a60 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:05.072085 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd5168-6113-4a94-9601-71bd4f1055a5 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:05.113031 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb5f8a-2ebf-47c8-abe4-816318ec399a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:05.113669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb5f8a-2ebf-47c8-abe4-816318ec399a admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:05.113944 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb5f8a-2ebf-47c8-abe4-816318ec399a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:05.114213 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb5f8a-2ebf-47c8-abe4-816318ec399a admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:05.114834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb5f8a-2ebf-47c8-abe4-816318ec399a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:05.116745 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb5f8a-2ebf-47c8-abe4-816318ec399a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:05.148095 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 957/1910] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:05 2022] POST /identity/v3/users => generated 296 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:05.151828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb5f8a-2ebf-47c8-abe4-816318ec399a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:05.163264 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd5168-6113-4a94-9601-71bd4f1055a5 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:05.164598 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb5f8a-2ebf-47c8-abe4-816318ec399a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:05.167067 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f636e-ca8a-49f4-ba3e-7964f0c37967 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:05.167750 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f636e-ca8a-49f4-ba3e-7964f0c37967 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:05.168629 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f636e-ca8a-49f4-ba3e-7964f0c37967 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:05.169075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f636e-ca8a-49f4-ba3e-7964f0c37967 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:05.170525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc8932-5a87-40d9-af3c-32427419ab61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:05.171394 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc8932-5a87-40d9-af3c-32427419ab61 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:05.171757 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc8932-5a87-40d9-af3c-32427419ab61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:05.172215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc8932-5a87-40d9-af3c-32427419ab61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:05.172944 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc8932-5a87-40d9-af3c-32427419ab61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:05.174909 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc8932-5a87-40d9-af3c-32427419ab61 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:05.176439 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:05.189246 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 958/1911] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:05.193626 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc8932-5a87-40d9-af3c-32427419ab61 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:05.205788 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc8932-5a87-40d9-af3c-32427419ab61 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:05.211020 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f6f32-779f-42f1-aceb-24d243d6883b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:05.211782 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f6f32-779f-42f1-aceb-24d243d6883b admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:05.212135 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f6f32-779f-42f1-aceb-24d243d6883b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:05.212475 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f6f32-779f-42f1-aceb-24d243d6883b admin admin] PATH_INFO: `/v3/projects/6b5576b85d874cf4943b2fb0220673d3/users/6fe8610f3e4b49df8d8a283065f98bca/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:05.220595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:05.235591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f6f32-779f-42f1-aceb-24d243d6883b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b5576b85d874cf4943b2fb0220673d3, user_id=6fe8610f3e4b49df8d8a283065f98bca, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:05.237461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f636e-ca8a-49f4-ba3e-7964f0c37967 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:05.238920 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f6f32-779f-42f1-aceb-24d243d6883b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:05.239289 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f636e-ca8a-49f4-ba3e-7964f0c37967 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:05.250939 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 954/1912] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:05 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:05.254269 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 959/1913] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:05 2022] PUT /identity/v3/projects/6b5576b85d874cf4943b2fb0220673d3/users/6fe8610f3e4b49df8d8a283065f98bca/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:05.258383 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f636e-ca8a-49f4-ba3e-7964f0c37967 service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:05.269579 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f636e-ca8a-49f4-ba3e-7964f0c37967 service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:05.337088 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859fb16-39b4-4d1c-8be1-686e793993c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:05.337799 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859fb16-39b4-4d1c-8be1-686e793993c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:05.338141 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859fb16-39b4-4d1c-8be1-686e793993c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:05.338477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859fb16-39b4-4d1c-8be1-686e793993c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:05.339189 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859fb16-39b4-4d1c-8be1-686e793993c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:05.340937 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859fb16-39b4-4d1c-8be1-686e793993c7 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:05.354391 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 955/1914] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:05.356627 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f6f32-779f-42f1-aceb-24d243d6883b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:05.368792 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f6f32-779f-42f1-aceb-24d243d6883b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:05.375698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e4ac0-b820-46ef-a200-d7049fd16eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:05.376366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e4ac0-b820-46ef-a200-d7049fd16eff admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:05.376648 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e4ac0-b820-46ef-a200-d7049fd16eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:05.376925 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e4ac0-b820-46ef-a200-d7049fd16eff admin admin] PATH_INFO: `/v3/projects/6b5576b85d874cf4943b2fb0220673d3/users/6fe8610f3e4b49df8d8a283065f98bca/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:05.379117 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e4ac0-b820-46ef-a200-d7049fd16eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b5576b85d874cf4943b2fb0220673d3, user_id=6fe8610f3e4b49df8d8a283065f98bca, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:05.381901 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e4ac0-b820-46ef-a200-d7049fd16eff admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:05.416042 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 960/1915] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:05 2022] PUT /identity/v3/projects/6b5576b85d874cf4943b2fb0220673d3/users/6fe8610f3e4b49df8d8a283065f98bca/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:05.416591 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92496de-347b-4eac-82eb-13194be213dc None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:05.416903 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92496de-347b-4eac-82eb-13194be213dc None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:05.417206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92496de-347b-4eac-82eb-13194be213dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:05.451782 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e4ac0-b820-46ef-a200-d7049fd16eff admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:05.478742 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e92496de-347b-4eac-82eb-13194be213dc None None] MFA Rules not processed for user `6fe8610f3e4b49df8d8a283065f98bca`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:05.480213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e92496de-347b-4eac-82eb-13194be213dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:05.626808 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e4ac0-b820-46ef-a200-d7049fd16eff admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:05.644085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a427a4-fa1f-4dce-a538-e29f5a866a86 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d8c89e03fb4d5da3381afc02bb2f68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf304b5b4443187e0290720d8c35b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:05.646180 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a427a4-fa1f-4dce-a538-e29f5a866a86 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:05.646911 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a427a4-fa1f-4dce-a538-e29f5a866a86 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:05.648621 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a427a4-fa1f-4dce-a538-e29f5a866a86 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:05.651115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a427a4-fa1f-4dce-a538-e29f5a866a86 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:13:05.653556 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a427a4-fa1f-4dce-a538-e29f5a866a86 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:05.658231 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a427a4-fa1f-4dce-a538-e29f5a866a86 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:05.690358 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 956/1916] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:05.694037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 961/1917] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:13:05.695660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92496de-347b-4eac-82eb-13194be213dc None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:05.726441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a427a4-fa1f-4dce-a538-e29f5a866a86 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:05.743934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92496de-347b-4eac-82eb-13194be213dc None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:05.766907 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f1b8f-fc01-440a-9e0b-608f50484ff5 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d8c89e03fb4d5da3381afc02bb2f68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf304b5b4443187e0290720d8c35b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:05.767490 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f1b8f-fc01-440a-9e0b-608f50484ff5 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:05.767727 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f1b8f-fc01-440a-9e0b-608f50484ff5 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:05.767997 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f1b8f-fc01-440a-9e0b-608f50484ff5 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:05.768769 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f1b8f-fc01-440a-9e0b-608f50484ff5 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:05.772050 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f1b8f-fc01-440a-9e0b-608f50484ff5 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:05.819118 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 957/1918] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:05 2022] POST /identity/v3/projects => generated 353 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:05.824112 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f1b8f-fc01-440a-9e0b-608f50484ff5 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:05.836244 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a427a4-fa1f-4dce-a538-e29f5a866a86 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:05.899489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:05.903441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacb1e4-2b88-4a35-a931-aa79a52b82c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:05.904796 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacb1e4-2b88-4a35-a931-aa79a52b82c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:05.905084 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacb1e4-2b88-4a35-a931-aa79a52b82c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:05.905466 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacb1e4-2b88-4a35-a931-aa79a52b82c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:05.922236 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f1b8f-fc01-440a-9e0b-608f50484ff5 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:05.948786 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6aeef5-9e18-49db-b74a-88bc3bfb9a71 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d8c89e03fb4d5da3381afc02bb2f68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf304b5b4443187e0290720d8c35b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:05.949480 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6aeef5-9e18-49db-b74a-88bc3bfb9a71 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:05.949762 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6aeef5-9e18-49db-b74a-88bc3bfb9a71 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:05.950218 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6aeef5-9e18-49db-b74a-88bc3bfb9a71 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:05.950868 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6aeef5-9e18-49db-b74a-88bc3bfb9a71 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:13:05.951175 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6aeef5-9e18-49db-b74a-88bc3bfb9a71 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:05.951677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:05.953413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6aeef5-9e18-49db-b74a-88bc3bfb9a71 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:05.972126 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 958/1919] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:13:06.004184 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6aeef5-9e18-49db-b74a-88bc3bfb9a71 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:06.010755 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbacb1e4-2b88-4a35-a931-aa79a52b82c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:06.012786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbacb1e4-2b88-4a35-a931-aa79a52b82c4 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:06.016230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6aeef5-9e18-49db-b74a-88bc3bfb9a71 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:06.021711 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457891c-c9e8-4825-ab69-0ec0c05851d8 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d8c89e03fb4d5da3381afc02bb2f68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf304b5b4443187e0290720d8c35b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:06.022268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457891c-c9e8-4825-ab69-0ec0c05851d8 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:06.022545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457891c-c9e8-4825-ab69-0ec0c05851d8 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:06.022810 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457891c-c9e8-4825-ab69-0ec0c05851d8 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] PATH_INFO: `/v3/projects/05639a5104bf48bd948b8425578cf3aa` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:06.023768 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 962/1920] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:06.023941 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457891c-c9e8-4825-ab69-0ec0c05851d8 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] RBAC: Authorizing `identity:delete_project(project_id=05639a5104bf48bd948b8425578cf3aa)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:06.025875 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457891c-c9e8-4825-ab69-0ec0c05851d8 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:06.070485 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacb1e4-2b88-4a35-a931-aa79a52b82c4 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:06.079155 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacb1e4-2b88-4a35-a931-aa79a52b82c4 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:06.080337 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a457891c-c9e8-4825-ab69-0ec0c05851d8 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05639a5104bf48bd948b8425578cf3aa', 'request_id': 'req-a457891c-c9e8-4825-ab69-0ec0c05851d8'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:06.088429 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a457891c-c9e8-4825-ab69-0ec0c05851d8 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05639a5104bf48bd948b8425578cf3aa', 'request_id': 'req-a457891c-c9e8-4825-ab69-0ec0c05851d8'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:06.095380 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a457891c-c9e8-4825-ab69-0ec0c05851d8 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05639a5104bf48bd948b8425578cf3aa', 'request_id': 'req-a457891c-c9e8-4825-ab69-0ec0c05851d8'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:06.109890 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a457891c-c9e8-4825-ab69-0ec0c05851d8 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] The token cache is being invalidate because project 05639a5104bf48bd948b8425578cf3aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:06.110229 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a457891c-c9e8-4825-ab69-0ec0c05851d8 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:06.110987 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a457891c-c9e8-4825-ab69-0ec0c05851d8 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:06.112735 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 959/1921] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:06 2022] DELETE /identity/v3/projects/05639a5104bf48bd948b8425578cf3aa => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:06.132578 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913b9dd-8017-4f75-9b3f-4e7a4dd1ab69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:06.133231 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913b9dd-8017-4f75-9b3f-4e7a4dd1ab69 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:06.133511 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913b9dd-8017-4f75-9b3f-4e7a4dd1ab69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:06.133783 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913b9dd-8017-4f75-9b3f-4e7a4dd1ab69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:06.135528 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e913b9dd-8017-4f75-9b3f-4e7a4dd1ab69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:06.200951 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913b9dd-8017-4f75-9b3f-4e7a4dd1ab69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:06.202510 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913b9dd-8017-4f75-9b3f-4e7a4dd1ab69 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:06.211887 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 963/1922] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 14:13:06.316698 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457891c-c9e8-4825-ab69-0ec0c05851d8 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:06.318536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a457891c-c9e8-4825-ab69-0ec0c05851d8 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:06.391235 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457891c-c9e8-4825-ab69-0ec0c05851d8 tempest-VolumeQuotaClassesTest-1644219229 tempest-VolumeQuotaClassesTest-1644219229-project-admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:06.396081 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264eb9e-adbe-420e-b2bd-34bffd57fb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:06.396837 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264eb9e-adbe-420e-b2bd-34bffd57fb6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:06.397224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264eb9e-adbe-420e-b2bd-34bffd57fb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:06.397527 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264eb9e-adbe-420e-b2bd-34bffd57fb6b admin admin] PATH_INFO: `/v3/users/4f2ffe6fcb014774aba7c7cf523c70b4` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:06.398664 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a264eb9e-adbe-420e-b2bd-34bffd57fb6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f2ffe6fcb014774aba7c7cf523c70b4)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:06.400602 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a264eb9e-adbe-420e-b2bd-34bffd57fb6b admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:06.452823 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a264eb9e-adbe-420e-b2bd-34bffd57fb6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f2ffe6fcb014774aba7c7cf523c70b4'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:06.460797 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a264eb9e-adbe-420e-b2bd-34bffd57fb6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f2ffe6fcb014774aba7c7cf523c70b4'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:06.472362 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:06.474506 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a264eb9e-adbe-420e-b2bd-34bffd57fb6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f2ffe6fcb014774aba7c7cf523c70b4'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:06.475255 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a264eb9e-adbe-420e-b2bd-34bffd57fb6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f2ffe6fcb014774aba7c7cf523c70b4'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:06.484644 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a264eb9e-adbe-420e-b2bd-34bffd57fb6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f2ffe6fcb014774aba7c7cf523c70b4'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:06.491747 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 960/1923] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:13:06 2022] DELETE /identity/v3/users/4f2ffe6fcb014774aba7c7cf523c70b4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:13:06.497088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cba26-da5e-4d74-9240-2db31c82d183 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:06.497398 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cba26-da5e-4d74-9240-2db31c82d183 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:06.497755 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cba26-da5e-4d74-9240-2db31c82d183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:06.517981 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-6e4cba26-da5e-4d74-9240-2db31c82d183 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:06.519328 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6e4cba26-da5e-4d74-9240-2db31c82d183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:06.589243 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 964/1924] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:06.598111 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264eb9e-adbe-420e-b2bd-34bffd57fb6b admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:06.599514 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a264eb9e-adbe-420e-b2bd-34bffd57fb6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:06.660197 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264eb9e-adbe-420e-b2bd-34bffd57fb6b admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:06.663826 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c80fe-5d6f-4c1e-ae9c-c4fb8c36ebce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:06.664425 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c80fe-5d6f-4c1e-ae9c-c4fb8c36ebce service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:06.664703 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c80fe-5d6f-4c1e-ae9c-c4fb8c36ebce service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:06.664973 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c80fe-5d6f-4c1e-ae9c-c4fb8c36ebce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:06.674530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c80fe-5d6f-4c1e-ae9c-c4fb8c36ebce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:06.675950 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c80fe-5d6f-4c1e-ae9c-c4fb8c36ebce service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:06.687118 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 961/1925] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:06.770463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cba26-da5e-4d74-9240-2db31c82d183 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:06.772086 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6e4cba26-da5e-4d74-9240-2db31c82d183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:06.799788 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:06.865628 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cba26-da5e-4d74-9240-2db31c82d183 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:06.869345 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80010ba2-6cd1-442b-ad2a-663faf46c1c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:06.870039 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80010ba2-6cd1-442b-ad2a-663faf46c1c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:06.870211 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80010ba2-6cd1-442b-ad2a-663faf46c1c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:06.870476 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80010ba2-6cd1-442b-ad2a-663faf46c1c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:06.873805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-80010ba2-6cd1-442b-ad2a-663faf46c1c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:06.960491 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80010ba2-6cd1-442b-ad2a-663faf46c1c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:06.965443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80010ba2-6cd1-442b-ad2a-663faf46c1c5 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:06.989972 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 965/1926] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:07.171965 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c80fe-5d6f-4c1e-ae9c-c4fb8c36ebce service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:07.173604 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-456c80fe-5d6f-4c1e-ae9c-c4fb8c36ebce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:07.197232 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c80fe-5d6f-4c1e-ae9c-c4fb8c36ebce service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:07.206245 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9f08e-6ffc-4e23-b7c3-25d357781c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:07.206954 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9f08e-6ffc-4e23-b7c3-25d357781c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:07.207362 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9f08e-6ffc-4e23-b7c3-25d357781c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:07.207636 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9f08e-6ffc-4e23-b7c3-25d357781c4c admin admin] PATH_INFO: `/v3/projects/dd2901b1c5c640158d43cf77dfd42bfd` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:07.209992 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9f08e-6ffc-4e23-b7c3-25d357781c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd2901b1c5c640158d43cf77dfd42bfd)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:07.214020 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9f08e-6ffc-4e23-b7c3-25d357781c4c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:07.276534 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f0a9f08e-6ffc-4e23-b7c3-25d357781c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd2901b1c5c640158d43cf77dfd42bfd', 'request_id': 'req-f0a9f08e-6ffc-4e23-b7c3-25d357781c4c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:07.286959 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f0a9f08e-6ffc-4e23-b7c3-25d357781c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd2901b1c5c640158d43cf77dfd42bfd', 'request_id': 'req-f0a9f08e-6ffc-4e23-b7c3-25d357781c4c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:07.294195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f0a9f08e-6ffc-4e23-b7c3-25d357781c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd2901b1c5c640158d43cf77dfd42bfd', 'request_id': 'req-f0a9f08e-6ffc-4e23-b7c3-25d357781c4c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:07.309021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f0a9f08e-6ffc-4e23-b7c3-25d357781c4c admin admin] The token cache is being invalidate because project dd2901b1c5c640158d43cf77dfd42bfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:07.309706 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f0a9f08e-6ffc-4e23-b7c3-25d357781c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:07.310560 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f0a9f08e-6ffc-4e23-b7c3-25d357781c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:07.312634 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 962/1927] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:07 2022] DELETE /identity/v3/projects/dd2901b1c5c640158d43cf77dfd42bfd => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:07.316866 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80010ba2-6cd1-442b-ad2a-663faf46c1c5 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:07.339721 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80010ba2-6cd1-442b-ad2a-663faf46c1c5 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:07.463342 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ce521-4c63-4d51-baf6-8f10695f77f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:07.464718 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ce521-4c63-4d51-baf6-8f10695f77f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:07.465262 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ce521-4c63-4d51-baf6-8f10695f77f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:07.465723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ce521-4c63-4d51-baf6-8f10695f77f7 admin admin] PATH_INFO: `/v3/users/55d8c89e03fb4d5da3381afc02bb2f68` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:07.469158 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ce521-4c63-4d51-baf6-8f10695f77f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55d8c89e03fb4d5da3381afc02bb2f68)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:07.473224 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ce521-4c63-4d51-baf6-8f10695f77f7 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:07.543410 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f31ce521-4c63-4d51-baf6-8f10695f77f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55d8c89e03fb4d5da3381afc02bb2f68'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:07.554752 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f31ce521-4c63-4d51-baf6-8f10695f77f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55d8c89e03fb4d5da3381afc02bb2f68'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:07.566889 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:07.580268 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f31ce521-4c63-4d51-baf6-8f10695f77f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55d8c89e03fb4d5da3381afc02bb2f68'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:07.581183 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f31ce521-4c63-4d51-baf6-8f10695f77f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55d8c89e03fb4d5da3381afc02bb2f68'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:07.594340 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f31ce521-4c63-4d51-baf6-8f10695f77f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55d8c89e03fb4d5da3381afc02bb2f68'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:07.620244 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 966/1928] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:13:07 2022] DELETE /identity/v3/users/55d8c89e03fb4d5da3381afc02bb2f68 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:07.928072 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9f08e-6ffc-4e23-b7c3-25d357781c4c admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:07.929622 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f0a9f08e-6ffc-4e23-b7c3-25d357781c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:07.952708 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9f08e-6ffc-4e23-b7c3-25d357781c4c admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:08.082345 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e3f62-75b7-4611-8b42-9e0cbf504ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:08.083075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e3f62-75b7-4611-8b42-9e0cbf504ad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:08.083423 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e3f62-75b7-4611-8b42-9e0cbf504ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:08.083759 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e3f62-75b7-4611-8b42-9e0cbf504ad2 admin admin] PATH_INFO: `/v3/projects/36edf304b5b4443187e0290720d8c35b` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:08.084993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e3f62-75b7-4611-8b42-9e0cbf504ad2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36edf304b5b4443187e0290720d8c35b)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:08.087507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e3f62-75b7-4611-8b42-9e0cbf504ad2 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:08.104347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:08.194392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-641e3f62-75b7-4611-8b42-9e0cbf504ad2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36edf304b5b4443187e0290720d8c35b', 'request_id': 'req-641e3f62-75b7-4611-8b42-9e0cbf504ad2'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:08.218580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-641e3f62-75b7-4611-8b42-9e0cbf504ad2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36edf304b5b4443187e0290720d8c35b', 'request_id': 'req-641e3f62-75b7-4611-8b42-9e0cbf504ad2'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:08.228316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-641e3f62-75b7-4611-8b42-9e0cbf504ad2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36edf304b5b4443187e0290720d8c35b', 'request_id': 'req-641e3f62-75b7-4611-8b42-9e0cbf504ad2'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:08.255081 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-641e3f62-75b7-4611-8b42-9e0cbf504ad2 admin admin] The token cache is being invalidate because project 36edf304b5b4443187e0290720d8c35b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:08.255492 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-641e3f62-75b7-4611-8b42-9e0cbf504ad2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:08.256264 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-641e3f62-75b7-4611-8b42-9e0cbf504ad2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:08.261452 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 963/1929] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:07 2022] DELETE /identity/v3/projects/36edf304b5b4443187e0290720d8c35b => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:08.263751 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260a33e-1cf1-4788-a534-193da4b9b41d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:08.264219 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260a33e-1cf1-4788-a534-193da4b9b41d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:08.264332 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260a33e-1cf1-4788-a534-193da4b9b41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:08.287842 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a260a33e-1cf1-4788-a534-193da4b9b41d None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:08.289068 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a260a33e-1cf1-4788-a534-193da4b9b41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:08.366621 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 967/1930] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:08.375855 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba3df8-f1ef-4beb-8cdc-473edf280325 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:08.376217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba3df8-f1ef-4beb-8cdc-473edf280325 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:08.376565 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba3df8-f1ef-4beb-8cdc-473edf280325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:08.398036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e7ba3df8-f1ef-4beb-8cdc-473edf280325 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:08.399367 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e7ba3df8-f1ef-4beb-8cdc-473edf280325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:08.428197 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 964/1931] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:08.432011 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260a33e-1cf1-4788-a534-193da4b9b41d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:08.444366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260a33e-1cf1-4788-a534-193da4b9b41d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:08.451848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7f4fe-94f5-4123-9528-639933b81507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:08.452934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7f4fe-94f5-4123-9528-639933b81507 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:08.453404 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7f4fe-94f5-4123-9528-639933b81507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:08.453895 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7f4fe-94f5-4123-9528-639933b81507 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:08.455098 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7f4fe-94f5-4123-9528-639933b81507 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:13:08.455472 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7f4fe-94f5-4123-9528-639933b81507 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:08.457679 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7f4fe-94f5-4123-9528-639933b81507 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:08.471650 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 968/1932] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:13:08.476203 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba3df8-f1ef-4beb-8cdc-473edf280325 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:08.486582 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba3df8-f1ef-4beb-8cdc-473edf280325 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:08.493137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3b7a9-03bc-429e-97ee-f4c70c016afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:08.493137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3b7a9-03bc-429e-97ee-f4c70c016afa admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:08.493137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3b7a9-03bc-429e-97ee-f4c70c016afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:08.493544 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3b7a9-03bc-429e-97ee-f4c70c016afa admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:08.494088 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3b7a9-03bc-429e-97ee-f4c70c016afa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:08.497143 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3b7a9-03bc-429e-97ee-f4c70c016afa admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:08.535537 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 965/1933] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:08 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:13:08.539629 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7f4fe-94f5-4123-9528-639933b81507 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:08.560485 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7f4fe-94f5-4123-9528-639933b81507 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:08.662090 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70671df2-981d-4195-97d7-e39bb1cdd6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:08.662797 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70671df2-981d-4195-97d7-e39bb1cdd6b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:08.663148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70671df2-981d-4195-97d7-e39bb1cdd6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:08.663486 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70671df2-981d-4195-97d7-e39bb1cdd6b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:08.664183 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70671df2-981d-4195-97d7-e39bb1cdd6b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:08.666265 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70671df2-981d-4195-97d7-e39bb1cdd6b2 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:08.694044 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 969/1934] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:08 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:08.698633 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3b7a9-03bc-429e-97ee-f4c70c016afa admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:08.722811 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3b7a9-03bc-429e-97ee-f4c70c016afa admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:08.730670 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad91e4-da5a-4eec-ad8f-d0c4b7b257af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:08.731995 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad91e4-da5a-4eec-ad8f-d0c4b7b257af admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:08.732170 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad91e4-da5a-4eec-ad8f-d0c4b7b257af admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:08.732702 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad91e4-da5a-4eec-ad8f-d0c4b7b257af admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:08.733606 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad91e4-da5a-4eec-ad8f-d0c4b7b257af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:08.735442 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad91e4-da5a-4eec-ad8f-d0c4b7b257af admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:08.747250 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 966/1935] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:08.751340 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70671df2-981d-4195-97d7-e39bb1cdd6b2 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:08.761475 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70671df2-981d-4195-97d7-e39bb1cdd6b2 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:08.766653 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abe05e-dca5-4112-bb45-cd8c34b5cad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:08.767256 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abe05e-dca5-4112-bb45-cd8c34b5cad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:08.767534 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abe05e-dca5-4112-bb45-cd8c34b5cad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:08.767803 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abe05e-dca5-4112-bb45-cd8c34b5cad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:08.768445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abe05e-dca5-4112-bb45-cd8c34b5cad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:08.770145 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abe05e-dca5-4112-bb45-cd8c34b5cad8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:08.782564 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 970/1936] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:08.786784 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad91e4-da5a-4eec-ad8f-d0c4b7b257af admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:08.797799 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad91e4-da5a-4eec-ad8f-d0c4b7b257af admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:08.803049 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bab62-ce84-4e4f-acf2-47f727a29207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:08.803853 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bab62-ce84-4e4f-acf2-47f727a29207 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:08.804138 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bab62-ce84-4e4f-acf2-47f727a29207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:08.804415 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bab62-ce84-4e4f-acf2-47f727a29207 admin admin] PATH_INFO: `/v3/projects/1583fce8ce0849b68b997fd2a3bce2be/users/aa789671903f4df881155468680b5a31/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:08.823208 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42bab62-ce84-4e4f-acf2-47f727a29207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1583fce8ce0849b68b997fd2a3bce2be, user_id=aa789671903f4df881155468680b5a31, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:08.826715 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42bab62-ce84-4e4f-acf2-47f727a29207 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:08.843090 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 967/1937] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:08 2022] PUT /identity/v3/projects/1583fce8ce0849b68b997fd2a3bce2be/users/aa789671903f4df881155468680b5a31/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:08.848105 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fead147-dead-45cd-a17a-c211c0a6ae67 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:08.848398 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fead147-dead-45cd-a17a-c211c0a6ae67 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:08.848675 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fead147-dead-45cd-a17a-c211c0a6ae67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:08.867968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-7fead147-dead-45cd-a17a-c211c0a6ae67 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:08.869358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7fead147-dead-45cd-a17a-c211c0a6ae67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:08.920715 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:08.938891 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 971/1938] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:08.949147 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bab62-ce84-4e4f-acf2-47f727a29207 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:08.951035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c42bab62-ce84-4e4f-acf2-47f727a29207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:09.010121 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bab62-ce84-4e4f-acf2-47f727a29207 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:09.014499 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bcbd34-379e-4fe2-b97e-7e9aae98c493 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:09.015155 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcbd34-379e-4fe2-b97e-7e9aae98c493 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:09.015434 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcbd34-379e-4fe2-b97e-7e9aae98c493 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:09.015697 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcbd34-379e-4fe2-b97e-7e9aae98c493 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:09.027281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bcbd34-379e-4fe2-b97e-7e9aae98c493 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:09.030341 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bcbd34-379e-4fe2-b97e-7e9aae98c493 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:09.042287 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 968/1939] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:09.295950 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fead147-dead-45cd-a17a-c211c0a6ae67 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:09.298085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7fead147-dead-45cd-a17a-c211c0a6ae67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:09.312149 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fead147-dead-45cd-a17a-c211c0a6ae67 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:09.320531 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf656f0-0e91-452c-b1e1-1d8032244828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:09.321808 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf656f0-0e91-452c-b1e1-1d8032244828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:09.322229 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf656f0-0e91-452c-b1e1-1d8032244828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:09.322767 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf656f0-0e91-452c-b1e1-1d8032244828 admin admin] PATH_INFO: `/v3/users/df311f3d30de4ee780dbbf69e029f586` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:09.324804 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf656f0-0e91-452c-b1e1-1d8032244828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df311f3d30de4ee780dbbf69e029f586)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:09.327026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf656f0-0e91-452c-b1e1-1d8032244828 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:09.403163 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-6cf656f0-0e91-452c-b1e1-1d8032244828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df311f3d30de4ee780dbbf69e029f586'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:09.413313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-6cf656f0-0e91-452c-b1e1-1d8032244828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df311f3d30de4ee780dbbf69e029f586'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:09.430972 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-6cf656f0-0e91-452c-b1e1-1d8032244828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df311f3d30de4ee780dbbf69e029f586'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:09.432250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-6cf656f0-0e91-452c-b1e1-1d8032244828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df311f3d30de4ee780dbbf69e029f586'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:09.455001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-6cf656f0-0e91-452c-b1e1-1d8032244828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df311f3d30de4ee780dbbf69e029f586'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:09.464836 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 972/1940] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:13:09 2022] DELETE /identity/v3/users/df311f3d30de4ee780dbbf69e029f586 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:09.467144 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9ab26-85cb-42b4-a168-946832ace88e None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:09.467774 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9ab26-85cb-42b4-a168-946832ace88e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:09.468102 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9ab26-85cb-42b4-a168-946832ace88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:09.514454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-94a9ab26-85cb-42b4-a168-946832ace88e None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:09.515792 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-94a9ab26-85cb-42b4-a168-946832ace88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:09.559533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:09.596446 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 969/1941] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:09.609261 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf656f0-0e91-452c-b1e1-1d8032244828 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:09.610979 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6cf656f0-0e91-452c-b1e1-1d8032244828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:09.682378 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf656f0-0e91-452c-b1e1-1d8032244828 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:09.686714 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97c43f-196f-43e7-8d32-c36676e1bff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:09.687136 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97c43f-196f-43e7-8d32-c36676e1bff9 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:09.687469 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97c43f-196f-43e7-8d32-c36676e1bff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:09.687894 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97c43f-196f-43e7-8d32-c36676e1bff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:09.698244 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97c43f-196f-43e7-8d32-c36676e1bff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:09.700438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97c43f-196f-43e7-8d32-c36676e1bff9 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:09.710982 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 973/1942] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:10.231296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9ab26-85cb-42b4-a168-946832ace88e None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:10.232927 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-94a9ab26-85cb-42b4-a168-946832ace88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:10.246587 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb14bd-d88c-4cc1-996e-1f0763985099 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:10.247017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb14bd-d88c-4cc1-996e-1f0763985099 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:10.247548 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb14bd-d88c-4cc1-996e-1f0763985099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:10.261797 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9ab26-85cb-42b4-a168-946832ace88e None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:10.268818 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9cfdc-d7b9-432e-b398-23ff54de8f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:10.269473 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9cfdc-d7b9-432e-b398-23ff54de8f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:10.269748 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9cfdc-d7b9-432e-b398-23ff54de8f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:10.270454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9cfdc-d7b9-432e-b398-23ff54de8f67 admin admin] PATH_INFO: `/v3/projects/5839a50c6ac540db840dd10a5d0b98e7` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:10.272420 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9cfdc-d7b9-432e-b398-23ff54de8f67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5839a50c6ac540db840dd10a5d0b98e7)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:10.274426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9cfdc-d7b9-432e-b398-23ff54de8f67 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:10.294626 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-20bb14bd-d88c-4cc1-996e-1f0763985099 None None] MFA Rules not processed for user `aa789671903f4df881155468680b5a31`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:10.296016 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-20bb14bd-d88c-4cc1-996e-1f0763985099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:10.343337 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2ab9cfdc-d7b9-432e-b398-23ff54de8f67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5839a50c6ac540db840dd10a5d0b98e7', 'request_id': 'req-2ab9cfdc-d7b9-432e-b398-23ff54de8f67'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:10.353862 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2ab9cfdc-d7b9-432e-b398-23ff54de8f67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5839a50c6ac540db840dd10a5d0b98e7', 'request_id': 'req-2ab9cfdc-d7b9-432e-b398-23ff54de8f67'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:10.362686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2ab9cfdc-d7b9-432e-b398-23ff54de8f67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5839a50c6ac540db840dd10a5d0b98e7', 'request_id': 'req-2ab9cfdc-d7b9-432e-b398-23ff54de8f67'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:10.364629 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:10.378594 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2ab9cfdc-d7b9-432e-b398-23ff54de8f67 admin admin] The token cache is being invalidate because project 5839a50c6ac540db840dd10a5d0b98e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:10.379161 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2ab9cfdc-d7b9-432e-b398-23ff54de8f67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:10.383540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 974/1943] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:13:10.383651 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2ab9cfdc-d7b9-432e-b398-23ff54de8f67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:10.383651 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 970/1944] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:10 2022] DELETE /identity/v3/projects/5839a50c6ac540db840dd10a5d0b98e7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:10.384185 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb14bd-d88c-4cc1-996e-1f0763985099 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:10.384989 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9cfdc-d7b9-432e-b398-23ff54de8f67 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:10.386362 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2ab9cfdc-d7b9-432e-b398-23ff54de8f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:10.387358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-20bb14bd-d88c-4cc1-996e-1f0763985099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:10.404693 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb14bd-d88c-4cc1-996e-1f0763985099 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:10.460532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9cfdc-d7b9-432e-b398-23ff54de8f67 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:10.465646 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a8718-fdba-4091-896b-93f22b96d0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:10.466312 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a8718-fdba-4091-896b-93f22b96d0e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:10.466584 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a8718-fdba-4091-896b-93f22b96d0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:10.467521 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a8718-fdba-4091-896b-93f22b96d0e6 admin admin] PATH_INFO: `/v3/users/6c15798d9e864487a534944dd0cccfcb` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:10.468789 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a8718-fdba-4091-896b-93f22b96d0e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c15798d9e864487a534944dd0cccfcb)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:10.470996 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a8718-fdba-4091-896b-93f22b96d0e6 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:10.476060 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198b56d-b6e1-49b1-9503-0097af1a03e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:10.476662 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198b56d-b6e1-49b1-9503-0097af1a03e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:10.476941 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198b56d-b6e1-49b1-9503-0097af1a03e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:10.477244 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198b56d-b6e1-49b1-9503-0097af1a03e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:10.478657 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198b56d-b6e1-49b1-9503-0097af1a03e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:10.479998 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198b56d-b6e1-49b1-9503-0097af1a03e2 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:10.514727 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 975/1945] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:10 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:10.520869 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198b56d-b6e1-49b1-9503-0097af1a03e2 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:10.523355 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d198b56d-b6e1-49b1-9503-0097af1a03e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:10.541263 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c74a8718-fdba-4091-896b-93f22b96d0e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c15798d9e864487a534944dd0cccfcb'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:10.552160 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c74a8718-fdba-4091-896b-93f22b96d0e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c15798d9e864487a534944dd0cccfcb'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:10.565217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:10.575913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c74a8718-fdba-4091-896b-93f22b96d0e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c15798d9e864487a534944dd0cccfcb'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:10.577329 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c74a8718-fdba-4091-896b-93f22b96d0e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c15798d9e864487a534944dd0cccfcb'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:10.595222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c74a8718-fdba-4091-896b-93f22b96d0e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c15798d9e864487a534944dd0cccfcb'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:10.605236 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 971/1946] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:13:10 2022] DELETE /identity/v3/users/6c15798d9e864487a534944dd0cccfcb => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:10.607073 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74508e8-eb1d-4dc1-b7ab-88d632a117e9 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:10.607359 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74508e8-eb1d-4dc1-b7ab-88d632a117e9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:10.607778 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74508e8-eb1d-4dc1-b7ab-88d632a117e9 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:10.625656 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 972/1947] 10.222.0.26 () {54 vars in 921 bytes} [Tue Sep 13 14:13:10 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:13:10.638106 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198b56d-b6e1-49b1-9503-0097af1a03e2 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:10.655436 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f36403-326c-44b6-9858-12a8f18df91f None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:10.656195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f36403-326c-44b6-9858-12a8f18df91f None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:10.656481 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f36403-326c-44b6-9858-12a8f18df91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:10.703041 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-62f36403-326c-44b6-9858-12a8f18df91f None None] MFA Rules not processed for user `1b3533d0a24e4e7bbf5c7137d3511b13`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:10.704945 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-62f36403-326c-44b6-9858-12a8f18df91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:10.727684 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8e9be-66b0-46fd-81aa-8367044fd947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:10.728475 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8e9be-66b0-46fd-81aa-8367044fd947 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:10.728786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8e9be-66b0-46fd-81aa-8367044fd947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:10.729060 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8e9be-66b0-46fd-81aa-8367044fd947 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:10.729719 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8e9be-66b0-46fd-81aa-8367044fd947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:10.733645 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8e9be-66b0-46fd-81aa-8367044fd947 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:10.773646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 976/1948] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:10 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:10.778938 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8e9be-66b0-46fd-81aa-8367044fd947 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:10.783374 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c9b8e9be-66b0-46fd-81aa-8367044fd947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:10.800821 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8e9be-66b0-46fd-81aa-8367044fd947 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:10.807834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e6dab-370b-48e4-8284-6d83dfbd80f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:10.809409 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e6dab-370b-48e4-8284-6d83dfbd80f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:10.809764 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e6dab-370b-48e4-8284-6d83dfbd80f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:10.810035 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e6dab-370b-48e4-8284-6d83dfbd80f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:10.810848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e6dab-370b-48e4-8284-6d83dfbd80f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:10.813547 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e6dab-370b-48e4-8284-6d83dfbd80f6 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:10.828529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 977/1949] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:13:10.833225 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e6dab-370b-48e4-8284-6d83dfbd80f6 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:10.842908 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:10.845828 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 973/1950] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Sep 13 14:13:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:10.848390 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e6dab-370b-48e4-8284-6d83dfbd80f6 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:10.855102 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a632823-f3e9-4ccf-a20c-c7d25821b173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:10.855897 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a632823-f3e9-4ccf-a20c-c7d25821b173 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:10.856239 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a632823-f3e9-4ccf-a20c-c7d25821b173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:10.856804 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a632823-f3e9-4ccf-a20c-c7d25821b173 admin admin] PATH_INFO: `/v3/projects/79400cd9e4534bf78138939552915974/users/c87a8e33965a4d7e80d599af6e0a8e18/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:10.862249 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f36403-326c-44b6-9858-12a8f18df91f None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:10.863768 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-62f36403-326c-44b6-9858-12a8f18df91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:10.878656 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f36403-326c-44b6-9858-12a8f18df91f None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:10.885071 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a01f8-a607-470e-8a94-c340bd2a427a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:10.885252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a632823-f3e9-4ccf-a20c-c7d25821b173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79400cd9e4534bf78138939552915974, user_id=c87a8e33965a4d7e80d599af6e0a8e18, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:10.885754 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a01f8-a607-470e-8a94-c340bd2a427a service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:10.886033 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a01f8-a607-470e-8a94-c340bd2a427a service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:10.886304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a01f8-a607-470e-8a94-c340bd2a427a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:10.888227 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a632823-f3e9-4ccf-a20c-c7d25821b173 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:10.897750 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a01f8-a607-470e-8a94-c340bd2a427a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:10.899713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a01f8-a607-470e-8a94-c340bd2a427a service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:10.904057 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 978/1951] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:10 2022] PUT /identity/v3/projects/79400cd9e4534bf78138939552915974/users/c87a8e33965a4d7e80d599af6e0a8e18/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:10.908536 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a632823-f3e9-4ccf-a20c-c7d25821b173 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:10.913059 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 974/1952] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:10.984723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a632823-f3e9-4ccf-a20c-c7d25821b173 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:10.990126 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238db0e-a059-478f-932e-19dfcae5bc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:10.990859 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238db0e-a059-478f-932e-19dfcae5bc49 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:10.991182 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238db0e-a059-478f-932e-19dfcae5bc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:10.991392 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238db0e-a059-478f-932e-19dfcae5bc49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:10.992026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238db0e-a059-478f-932e-19dfcae5bc49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:10.993668 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238db0e-a059-478f-932e-19dfcae5bc49 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:11.007738 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 979/1953] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:11.009751 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a01f8-a607-470e-8a94-c340bd2a427a service nova] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:11.037657 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a01f8-a607-470e-8a94-c340bd2a427a service nova] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:11.047465 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107f612-3184-49e3-a283-4724fd0bff83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:11.051049 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107f612-3184-49e3-a283-4724fd0bff83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:11.051199 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107f612-3184-49e3-a283-4724fd0bff83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:11.051533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107f612-3184-49e3-a283-4724fd0bff83 admin admin] PATH_INFO: `/v3/projects/79400cd9e4534bf78138939552915974/users/c87a8e33965a4d7e80d599af6e0a8e18/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:11.054968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107f612-3184-49e3-a283-4724fd0bff83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79400cd9e4534bf78138939552915974, user_id=c87a8e33965a4d7e80d599af6e0a8e18, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:11.061121 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107f612-3184-49e3-a283-4724fd0bff83 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:11.083585 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 975/1954] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:11 2022] PUT /identity/v3/projects/79400cd9e4534bf78138939552915974/users/c87a8e33965a4d7e80d599af6e0a8e18/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:11.192080 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238db0e-a059-478f-932e-19dfcae5bc49 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:11.194585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4238db0e-a059-478f-932e-19dfcae5bc49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:11.213616 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238db0e-a059-478f-932e-19dfcae5bc49 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:11.243958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107f612-3184-49e3-a283-4724fd0bff83 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:11.247007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-9107f612-3184-49e3-a283-4724fd0bff83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:11.289884 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd82cd4-1b6c-4a91-b73c-8310c375957c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:11.290530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd82cd4-1b6c-4a91-b73c-8310c375957c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:11.290810 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd82cd4-1b6c-4a91-b73c-8310c375957c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:11.291097 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd82cd4-1b6c-4a91-b73c-8310c375957c admin admin] PATH_INFO: `/v3/projects/a652e9a1e61748e89fa408dee9ab922a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:11.292236 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd82cd4-1b6c-4a91-b73c-8310c375957c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a652e9a1e61748e89fa408dee9ab922a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:11.294798 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd82cd4-1b6c-4a91-b73c-8310c375957c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:11.366746 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4fd82cd4-1b6c-4a91-b73c-8310c375957c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a652e9a1e61748e89fa408dee9ab922a', 'request_id': 'req-4fd82cd4-1b6c-4a91-b73c-8310c375957c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:11.377216 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4fd82cd4-1b6c-4a91-b73c-8310c375957c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a652e9a1e61748e89fa408dee9ab922a', 'request_id': 'req-4fd82cd4-1b6c-4a91-b73c-8310c375957c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:11.409009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4fd82cd4-1b6c-4a91-b73c-8310c375957c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a652e9a1e61748e89fa408dee9ab922a', 'request_id': 'req-4fd82cd4-1b6c-4a91-b73c-8310c375957c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:11.433118 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107f612-3184-49e3-a283-4724fd0bff83 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:11.433590 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4fd82cd4-1b6c-4a91-b73c-8310c375957c admin admin] The token cache is being invalidate because project a652e9a1e61748e89fa408dee9ab922a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:11.433888 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4fd82cd4-1b6c-4a91-b73c-8310c375957c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:11.434681 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4fd82cd4-1b6c-4a91-b73c-8310c375957c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:11.441710 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 980/1955] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:11 2022] DELETE /identity/v3/projects/a652e9a1e61748e89fa408dee9ab922a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:11.443528 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd82cd4-1b6c-4a91-b73c-8310c375957c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:11.445898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4fd82cd4-1b6c-4a91-b73c-8310c375957c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:11.465044 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:11.524944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:11.536883 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b6d93-2812-4dd5-8b46-bab02c1489b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:11.537786 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b6d93-2812-4dd5-8b46-bab02c1489b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:11.539282 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b6d93-2812-4dd5-8b46-bab02c1489b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:11.539675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b6d93-2812-4dd5-8b46-bab02c1489b5 admin admin] PATH_INFO: `/v3/users/3ca73b6a26164c1bb55a77c63c3ae2f4` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:11.541594 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b6d93-2812-4dd5-8b46-bab02c1489b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ca73b6a26164c1bb55a77c63c3ae2f4)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:11.545344 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b6d93-2812-4dd5-8b46-bab02c1489b5 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:11.569400 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd82cd4-1b6c-4a91-b73c-8310c375957c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:11.586003 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206d004-44bc-4a09-a7fa-780c417ffac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:11.587085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206d004-44bc-4a09-a7fa-780c417ffac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:11.587756 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206d004-44bc-4a09-a7fa-780c417ffac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:11.588799 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206d004-44bc-4a09-a7fa-780c417ffac1 admin admin] PATH_INFO: `/v3/users/6fe8610f3e4b49df8d8a283065f98bca` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:11.592419 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206d004-44bc-4a09-a7fa-780c417ffac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fe8610f3e4b49df8d8a283065f98bca)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:11.597419 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206d004-44bc-4a09-a7fa-780c417ffac1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:11.624736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-925b6d93-2812-4dd5-8b46-bab02c1489b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ca73b6a26164c1bb55a77c63c3ae2f4'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:11.636930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-925b6d93-2812-4dd5-8b46-bab02c1489b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ca73b6a26164c1bb55a77c63c3ae2f4'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:11.661415 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-925b6d93-2812-4dd5-8b46-bab02c1489b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ca73b6a26164c1bb55a77c63c3ae2f4'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:11.662950 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-925b6d93-2812-4dd5-8b46-bab02c1489b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ca73b6a26164c1bb55a77c63c3ae2f4'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:11.690206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-925b6d93-2812-4dd5-8b46-bab02c1489b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ca73b6a26164c1bb55a77c63c3ae2f4'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:11.702425 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 976/1956] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:13:11 2022] DELETE /identity/v3/users/3ca73b6a26164c1bb55a77c63c3ae2f4 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:13:11.704706 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eeb9bf-89d2-4774-b1a1-15c15f452a20 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:11.705382 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eeb9bf-89d2-4774-b1a1-15c15f452a20 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:11.705833 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9206d004-44bc-4a09-a7fa-780c417ffac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fe8610f3e4b49df8d8a283065f98bca'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:11.706211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eeb9bf-89d2-4774-b1a1-15c15f452a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:11.725941 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9206d004-44bc-4a09-a7fa-780c417ffac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fe8610f3e4b49df8d8a283065f98bca'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:11.730450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-a1eeb9bf-89d2-4774-b1a1-15c15f452a20 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:11.732295 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a1eeb9bf-89d2-4774-b1a1-15c15f452a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:11.750173 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9206d004-44bc-4a09-a7fa-780c417ffac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fe8610f3e4b49df8d8a283065f98bca'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:11.769677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9206d004-44bc-4a09-a7fa-780c417ffac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fe8610f3e4b49df8d8a283065f98bca'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:11.791499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9206d004-44bc-4a09-a7fa-780c417ffac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fe8610f3e4b49df8d8a283065f98bca'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:11.811438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 981/1957] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:13:11 2022] DELETE /identity/v3/users/6fe8610f3e4b49df8d8a283065f98bca => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:11.834214 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 977/1958] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:11.920462 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206d004-44bc-4a09-a7fa-780c417ffac1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:11.923034 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9206d004-44bc-4a09-a7fa-780c417ffac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:11.995816 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206d004-44bc-4a09-a7fa-780c417ffac1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:12.007449 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc2662-6137-4f16-903b-ff6506b3e2b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:12.007449 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc2662-6137-4f16-903b-ff6506b3e2b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:12.007449 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc2662-6137-4f16-903b-ff6506b3e2b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:12.007449 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc2662-6137-4f16-903b-ff6506b3e2b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:12.053954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:12.085051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc2662-6137-4f16-903b-ff6506b3e2b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:12.086567 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc2662-6137-4f16-903b-ff6506b3e2b2 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:12.098074 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 982/1959] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:13.175573 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eeb9bf-89d2-4774-b1a1-15c15f452a20 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:13.180457 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a1eeb9bf-89d2-4774-b1a1-15c15f452a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:13.190948 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdebd22-cbf8-4f57-bd68-096e6d15c0f1 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:13.191442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdebd22-cbf8-4f57-bd68-096e6d15c0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:13.191517 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdebd22-cbf8-4f57-bd68-096e6d15c0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:13.207360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eeb9bf-89d2-4774-b1a1-15c15f452a20 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:13.214354 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6dcb6-37aa-48d8-bda3-07446e886dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:13.218430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6dcb6-37aa-48d8-bda3-07446e886dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:13.218430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6dcb6-37aa-48d8-bda3-07446e886dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:13.218430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6dcb6-37aa-48d8-bda3-07446e886dc7 admin admin] PATH_INFO: `/v3/projects/cfe8c011309d43fcb83c1b0fedc264dc` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:13.219467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6dcb6-37aa-48d8-bda3-07446e886dc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfe8c011309d43fcb83c1b0fedc264dc)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:13.221934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6dcb6-37aa-48d8-bda3-07446e886dc7 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:13.262389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5cdebd22-cbf8-4f57-bd68-096e6d15c0f1 None None] MFA Rules not processed for user `c87a8e33965a4d7e80d599af6e0a8e18`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:13.264962 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5cdebd22-cbf8-4f57-bd68-096e6d15c0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:13.288482 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5ab6dcb6-37aa-48d8-bda3-07446e886dc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfe8c011309d43fcb83c1b0fedc264dc', 'request_id': 'req-5ab6dcb6-37aa-48d8-bda3-07446e886dc7'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:13.298254 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5ab6dcb6-37aa-48d8-bda3-07446e886dc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfe8c011309d43fcb83c1b0fedc264dc', 'request_id': 'req-5ab6dcb6-37aa-48d8-bda3-07446e886dc7'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:13.307555 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5ab6dcb6-37aa-48d8-bda3-07446e886dc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfe8c011309d43fcb83c1b0fedc264dc', 'request_id': 'req-5ab6dcb6-37aa-48d8-bda3-07446e886dc7'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:13.318400 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:13.325507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5ab6dcb6-37aa-48d8-bda3-07446e886dc7 admin admin] The token cache is being invalidate because project cfe8c011309d43fcb83c1b0fedc264dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:13.326378 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5ab6dcb6-37aa-48d8-bda3-07446e886dc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:13.326828 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5ab6dcb6-37aa-48d8-bda3-07446e886dc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:13.328807 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 978/1960] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:13 2022] DELETE /identity/v3/projects/cfe8c011309d43fcb83c1b0fedc264dc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:13.329764 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6dcb6-37aa-48d8-bda3-07446e886dc7 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:13.332526 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5ab6dcb6-37aa-48d8-bda3-07446e886dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:13.406464 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 983/1961] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:13:13.407568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdebd22-cbf8-4f57-bd68-096e6d15c0f1 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:13.430634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5cdebd22-cbf8-4f57-bd68-096e6d15c0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:13.452390 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6dcb6-37aa-48d8-bda3-07446e886dc7 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:13.460660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e835f6-1d00-4884-81fc-723520e39f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:13.461384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e835f6-1d00-4884-81fc-723520e39f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:13.461668 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e835f6-1d00-4884-81fc-723520e39f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:13.461920 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e835f6-1d00-4884-81fc-723520e39f9b admin admin] PATH_INFO: `/v3/projects/6b5576b85d874cf4943b2fb0220673d3` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:13.463263 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e835f6-1d00-4884-81fc-723520e39f9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b5576b85d874cf4943b2fb0220673d3)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:13.470947 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e835f6-1d00-4884-81fc-723520e39f9b admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:13.538771 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-17e835f6-1d00-4884-81fc-723520e39f9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b5576b85d874cf4943b2fb0220673d3', 'request_id': 'req-17e835f6-1d00-4884-81fc-723520e39f9b'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:13.540443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdebd22-cbf8-4f57-bd68-096e6d15c0f1 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:13.550325 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-17e835f6-1d00-4884-81fc-723520e39f9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b5576b85d874cf4943b2fb0220673d3', 'request_id': 'req-17e835f6-1d00-4884-81fc-723520e39f9b'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:13.557406 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-17e835f6-1d00-4884-81fc-723520e39f9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b5576b85d874cf4943b2fb0220673d3', 'request_id': 'req-17e835f6-1d00-4884-81fc-723520e39f9b'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:13.572036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-17e835f6-1d00-4884-81fc-723520e39f9b admin admin] The token cache is being invalidate because project 6b5576b85d874cf4943b2fb0220673d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:13.572354 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-17e835f6-1d00-4884-81fc-723520e39f9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:13.573577 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-17e835f6-1d00-4884-81fc-723520e39f9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:13.577415 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 979/1962] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:13 2022] DELETE /identity/v3/projects/6b5576b85d874cf4943b2fb0220673d3 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:13.583183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adfe18-b0df-47f3-a2b9-9b7f7076d7db None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:13.583538 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adfe18-b0df-47f3-a2b9-9b7f7076d7db None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:13.583869 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adfe18-b0df-47f3-a2b9-9b7f7076d7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:13.604539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-a4adfe18-b0df-47f3-a2b9-9b7f7076d7db None None] MFA Rules not processed for user `aa789671903f4df881155468680b5a31`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:13.605883 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a4adfe18-b0df-47f3-a2b9-9b7f7076d7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:13.618855 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70b145-f0be-414f-94b3-943cbe731b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:13.619841 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70b145-f0be-414f-94b3-943cbe731b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:13.620330 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70b145-f0be-414f-94b3-943cbe731b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:13.620799 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70b145-f0be-414f-94b3-943cbe731b08 admin admin] PATH_INFO: `/v3/users/b8619c8f302e4495b6b6845e09399b62` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:13.622299 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e70b145-f0be-414f-94b3-943cbe731b08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8619c8f302e4495b6b6845e09399b62)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:13.624493 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e70b145-f0be-414f-94b3-943cbe731b08 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:13.636418 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:13.679485 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0e70b145-f0be-414f-94b3-943cbe731b08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8619c8f302e4495b6b6845e09399b62'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:13.691561 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 980/1963] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:13.691779 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0e70b145-f0be-414f-94b3-943cbe731b08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8619c8f302e4495b6b6845e09399b62'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:13.691878 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960c1cd-3813-4b7c-a824-462726946b51 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:13.691878 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960c1cd-3813-4b7c-a824-462726946b51 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:13.691878 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960c1cd-3813-4b7c-a824-462726946b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:13.705319 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0e70b145-f0be-414f-94b3-943cbe731b08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8619c8f302e4495b6b6845e09399b62'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:13.706314 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0e70b145-f0be-414f-94b3-943cbe731b08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8619c8f302e4495b6b6845e09399b62'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:13.710032 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-f960c1cd-3813-4b7c-a824-462726946b51 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:13.711304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f960c1cd-3813-4b7c-a824-462726946b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:13.713968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0e70b145-f0be-414f-94b3-943cbe731b08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8619c8f302e4495b6b6845e09399b62'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:13.721040 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 984/1964] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:13:13 2022] DELETE /identity/v3/users/b8619c8f302e4495b6b6845e09399b62 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:13.721675 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70b145-f0be-414f-94b3-943cbe731b08 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:13.729150 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0e70b145-f0be-414f-94b3-943cbe731b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:13.729395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 981/1965] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:13.738562 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f0cb8-44b5-4ec6-9559-ac22a75ed2dd None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:13.738845 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f0cb8-44b5-4ec6-9559-ac22a75ed2dd None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:13.739121 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f0cb8-44b5-4ec6-9559-ac22a75ed2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:13.772944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-7b8f0cb8-44b5-4ec6-9559-ac22a75ed2dd None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:13.775103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7b8f0cb8-44b5-4ec6-9559-ac22a75ed2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:13.807641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:13.832430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70b145-f0be-414f-94b3-943cbe731b08 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:13.838640 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7f3f6-1964-4024-bd86-3b8babf7983f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:13.839358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7f3f6-1964-4024-bd86-3b8babf7983f service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:13.840239 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7f3f6-1964-4024-bd86-3b8babf7983f service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:13.840569 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7f3f6-1964-4024-bd86-3b8babf7983f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:13.842663 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-75e7f3f6-1964-4024-bd86-3b8babf7983f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:13.859777 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 982/1966] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:13.863768 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f0cb8-44b5-4ec6-9559-ac22a75ed2dd None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:13.874946 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f0cb8-44b5-4ec6-9559-ac22a75ed2dd None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:13.884098 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac02043-2917-47d5-b6d0-4efae0d0883b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:13.884801 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac02043-2917-47d5-b6d0-4efae0d0883b admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:13.885179 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac02043-2917-47d5-b6d0-4efae0d0883b admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:13.885986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac02043-2917-47d5-b6d0-4efae0d0883b admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:13.886189 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac02043-2917-47d5-b6d0-4efae0d0883b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:13:13.886500 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac02043-2917-47d5-b6d0-4efae0d0883b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:13.888117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac02043-2917-47d5-b6d0-4efae0d0883b admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:13.902915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 983/1967] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:13:13.907969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac02043-2917-47d5-b6d0-4efae0d0883b admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:13.909180 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7f3f6-1964-4024-bd86-3b8babf7983f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:13.910782 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7f3f6-1964-4024-bd86-3b8babf7983f service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:13.918591 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac02043-2917-47d5-b6d0-4efae0d0883b admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:13.921401 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 985/1968] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:13.923640 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51d090-ded9-4f6a-9295-97c6ae8a894a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:13.924240 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51d090-ded9-4f6a-9295-97c6ae8a894a admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:13.924519 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51d090-ded9-4f6a-9295-97c6ae8a894a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:13.924790 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51d090-ded9-4f6a-9295-97c6ae8a894a admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:13.925456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c51d090-ded9-4f6a-9295-97c6ae8a894a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:13.927357 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c51d090-ded9-4f6a-9295-97c6ae8a894a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:13.961675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 984/1969] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:13 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:13:13.966165 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7f3f6-1964-4024-bd86-3b8babf7983f service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:13.983402 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7f3f6-1964-4024-bd86-3b8babf7983f service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:14.019035 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:14.058852 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51d090-ded9-4f6a-9295-97c6ae8a894a admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:14.060742 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-3c51d090-ded9-4f6a-9295-97c6ae8a894a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:14.113585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e0823-3782-41a3-ba05-321a80af17e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:14.114420 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e0823-3782-41a3-ba05-321a80af17e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:14.114632 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e0823-3782-41a3-ba05-321a80af17e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:14.114724 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e0823-3782-41a3-ba05-321a80af17e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:14.115364 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e0823-3782-41a3-ba05-321a80af17e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:14.117676 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e0823-3782-41a3-ba05-321a80af17e1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:14.165019 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 986/1970] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:13 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:13:14.169360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e0823-3782-41a3-ba05-321a80af17e1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:14.194059 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e0823-3782-41a3-ba05-321a80af17e1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:14.194696 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51d090-ded9-4f6a-9295-97c6ae8a894a admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:14.199792 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2401e-2057-4899-8bfc-f29a3e674528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:14.200429 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2401e-2057-4899-8bfc-f29a3e674528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:14.200705 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2401e-2057-4899-8bfc-f29a3e674528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:14.201008 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2401e-2057-4899-8bfc-f29a3e674528 admin admin] PATH_INFO: `/v3/projects/458fb7fba0364121b52ef7da60bb461b` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:14.202352 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2401e-2057-4899-8bfc-f29a3e674528 admin admin] RBAC: Authorizing `identity:delete_project(project_id=458fb7fba0364121b52ef7da60bb461b)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:14.204505 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2401e-2057-4899-8bfc-f29a3e674528 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:14.207736 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa6e2a-04da-4d3b-b848-12e4d0085ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:14.208687 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa6e2a-04da-4d3b-b848-12e4d0085ebe admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:14.209323 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa6e2a-04da-4d3b-b848-12e4d0085ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:14.209912 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa6e2a-04da-4d3b-b848-12e4d0085ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:14.210900 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa6e2a-04da-4d3b-b848-12e4d0085ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:14.213734 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa6e2a-04da-4d3b-b848-12e4d0085ebe admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:14.225056 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 987/1971] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:13:14.229486 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa6e2a-04da-4d3b-b848-12e4d0085ebe admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:14.251234 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa6e2a-04da-4d3b-b848-12e4d0085ebe admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:14.258133 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86e7f9-d8b2-4930-82c1-28c9c9056195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:14.258757 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86e7f9-d8b2-4930-82c1-28c9c9056195 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:14.259087 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86e7f9-d8b2-4930-82c1-28c9c9056195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:14.259357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86e7f9-d8b2-4930-82c1-28c9c9056195 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:14.260226 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86e7f9-d8b2-4930-82c1-28c9c9056195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:14.267104 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86e7f9-d8b2-4930-82c1-28c9c9056195 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:14.295032 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 988/1972] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:14.298429 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b1a2401e-2057-4899-8bfc-f29a3e674528 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '458fb7fba0364121b52ef7da60bb461b', 'request_id': 'req-b1a2401e-2057-4899-8bfc-f29a3e674528'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:14.300874 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86e7f9-d8b2-4930-82c1-28c9c9056195 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:14.313168 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86e7f9-d8b2-4930-82c1-28c9c9056195 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:14.325426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b1a2401e-2057-4899-8bfc-f29a3e674528 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '458fb7fba0364121b52ef7da60bb461b', 'request_id': 'req-b1a2401e-2057-4899-8bfc-f29a3e674528'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:14.332546 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b1a2401e-2057-4899-8bfc-f29a3e674528 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '458fb7fba0364121b52ef7da60bb461b', 'request_id': 'req-b1a2401e-2057-4899-8bfc-f29a3e674528'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:14.351047 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b1a2401e-2057-4899-8bfc-f29a3e674528 admin admin] The token cache is being invalidate because project 458fb7fba0364121b52ef7da60bb461b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:14.351341 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b1a2401e-2057-4899-8bfc-f29a3e674528 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:14.352119 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b1a2401e-2057-4899-8bfc-f29a3e674528 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:14.353985 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 985/1973] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:14 2022] DELETE /identity/v3/projects/458fb7fba0364121b52ef7da60bb461b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:14.359710 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e8550-b083-43d5-84eb-1008ba75efdd None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:14.360161 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e8550-b083-43d5-84eb-1008ba75efdd None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:14.360602 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e8550-b083-43d5-84eb-1008ba75efdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:14.393227 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-dc5e8550-b083-43d5-84eb-1008ba75efdd None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:14.395061 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-dc5e8550-b083-43d5-84eb-1008ba75efdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:14.403327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59863bfd-a8d4-4e7b-9297-1c71c89eb040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:14.404005 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59863bfd-a8d4-4e7b-9297-1c71c89eb040 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:14.404543 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59863bfd-a8d4-4e7b-9297-1c71c89eb040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:14.404817 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59863bfd-a8d4-4e7b-9297-1c71c89eb040 admin admin] PATH_INFO: `/v3/projects/3fe447122c2b4dea9fb104f12f5543cd/users/e29d391b2662435ba870f27df675ece6/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:14.421393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:14.442752 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59863bfd-a8d4-4e7b-9297-1c71c89eb040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fe447122c2b4dea9fb104f12f5543cd, user_id=e29d391b2662435ba870f27df675ece6, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:14.445541 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59863bfd-a8d4-4e7b-9297-1c71c89eb040 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:14.471867 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 989/1974] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:14 2022] PUT /identity/v3/projects/3fe447122c2b4dea9fb104f12f5543cd/users/e29d391b2662435ba870f27df675ece6/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:14.484669 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 986/1975] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:14.485925 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9b55a-1339-4dc5-8d2f-4e79babfb686 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:14.486213 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9b55a-1339-4dc5-8d2f-4e79babfb686 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:14.486488 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9b55a-1339-4dc5-8d2f-4e79babfb686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:14.505120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b2cfe-f7c1-453c-a2cf-07db371b51de None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:14.505120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b2cfe-f7c1-453c-a2cf-07db371b51de None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:14.505120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b2cfe-f7c1-453c-a2cf-07db371b51de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:14.535558 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-b02b2cfe-f7c1-453c-a2cf-07db371b51de None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:14.537505 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b02b2cfe-f7c1-453c-a2cf-07db371b51de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:14.539185 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-0ba9b55a-1339-4dc5-8d2f-4e79babfb686 None None] MFA Rules not processed for user `e29d391b2662435ba870f27df675ece6`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:14.540350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0ba9b55a-1339-4dc5-8d2f-4e79babfb686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:14.649524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 987/1976] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:14.655897 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b2cfe-f7c1-453c-a2cf-07db371b51de None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:14.661743 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 990/1977] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:13:14.666296 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9b55a-1339-4dc5-8d2f-4e79babfb686 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:14.667956 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0ba9b55a-1339-4dc5-8d2f-4e79babfb686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:14.669044 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b2cfe-f7c1-453c-a2cf-07db371b51de None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:14.674957 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b319d4-d99a-464f-aa03-c36074bd1281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:14.675751 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b319d4-d99a-464f-aa03-c36074bd1281 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:14.676052 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b319d4-d99a-464f-aa03-c36074bd1281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:14.676321 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b319d4-d99a-464f-aa03-c36074bd1281 admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:14.677021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b319d4-d99a-464f-aa03-c36074bd1281 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:13:14.677367 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b319d4-d99a-464f-aa03-c36074bd1281 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:14.679334 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b319d4-d99a-464f-aa03-c36074bd1281 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:14.684977 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:14.701176 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 988/1978] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:13:14.707825 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b319d4-d99a-464f-aa03-c36074bd1281 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:14.712498 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9b55a-1339-4dc5-8d2f-4e79babfb686 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:14.727471 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f477f-a396-4561-a4a2-6eb36f813237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:14.727676 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b319d4-d99a-464f-aa03-c36074bd1281 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:14.728046 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f477f-a396-4561-a4a2-6eb36f813237 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:14.728314 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f477f-a396-4561-a4a2-6eb36f813237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:14.728589 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f477f-a396-4561-a4a2-6eb36f813237 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:14.731441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f477f-a396-4561-a4a2-6eb36f813237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:14.735433 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f477f-a396-4561-a4a2-6eb36f813237 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:14.736191 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f0dd4-297f-4673-9730-ad5614e94c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:14.737001 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f0dd4-297f-4673-9730-ad5614e94c3a admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:14.738749 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f0dd4-297f-4673-9730-ad5614e94c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:14.739029 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f0dd4-297f-4673-9730-ad5614e94c3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:14.739819 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f0dd4-297f-4673-9730-ad5614e94c3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:14.743013 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f0dd4-297f-4673-9730-ad5614e94c3a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:14.817154 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 991/1980] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:14 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:13:14.817154 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f477f-a396-4561-a4a2-6eb36f813237 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:14.817917 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 989/1980] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:14 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:14.819024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f0dd4-297f-4673-9730-ad5614e94c3a admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:14.955802 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f477f-a396-4561-a4a2-6eb36f813237 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:14.957632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f0dd4-297f-4673-9730-ad5614e94c3a admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:14.967437 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882e769-ca9f-4df5-a231-573cb51db672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:14.968081 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882e769-ca9f-4df5-a231-573cb51db672 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:14.969056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2914b3b-d93c-4021-9353-558a878a511b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:14.969796 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2914b3b-d93c-4021-9353-558a878a511b admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:14.970083 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2914b3b-d93c-4021-9353-558a878a511b admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:14.970259 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2914b3b-d93c-4021-9353-558a878a511b admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:14.971363 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882e769-ca9f-4df5-a231-573cb51db672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:14.971638 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882e769-ca9f-4df5-a231-573cb51db672 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:14.972332 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a882e769-ca9f-4df5-a231-573cb51db672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:14.973341 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2914b3b-d93c-4021-9353-558a878a511b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:14.976641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a882e769-ca9f-4df5-a231-573cb51db672 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:14.977588 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2914b3b-d93c-4021-9353-558a878a511b admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:15.018934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 990/1981] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:14 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:15.023160 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2914b3b-d93c-4021-9353-558a878a511b admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:15.027819 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 992/1982] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:14 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:15.031726 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882e769-ca9f-4df5-a231-573cb51db672 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:15.037657 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2914b3b-d93c-4021-9353-558a878a511b admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:15.042598 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20ccb8-2fa3-4bcd-a4b0-91e89d5a4b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:15.043316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20ccb8-2fa3-4bcd-a4b0-91e89d5a4b38 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:15.043668 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20ccb8-2fa3-4bcd-a4b0-91e89d5a4b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:15.043998 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20ccb8-2fa3-4bcd-a4b0-91e89d5a4b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:15.044715 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20ccb8-2fa3-4bcd-a4b0-91e89d5a4b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:15.046496 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20ccb8-2fa3-4bcd-a4b0-91e89d5a4b38 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:15.061134 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 991/1983] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:13:15.063740 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20ccb8-2fa3-4bcd-a4b0-91e89d5a4b38 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:15.065967 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882e769-ca9f-4df5-a231-573cb51db672 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:15.072710 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea34c8-57e5-4a0a-8358-c27f20213b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:15.073691 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea34c8-57e5-4a0a-8358-c27f20213b06 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:15.075891 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea34c8-57e5-4a0a-8358-c27f20213b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:15.076437 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea34c8-57e5-4a0a-8358-c27f20213b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:15.077020 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea34c8-57e5-4a0a-8358-c27f20213b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:15.078216 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20ccb8-2fa3-4bcd-a4b0-91e89d5a4b38 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:15.078977 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea34c8-57e5-4a0a-8358-c27f20213b06 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:15.083694 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652aa014-5072-41fd-ae63-83e12d20078e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:15.084345 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652aa014-5072-41fd-ae63-83e12d20078e admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:15.084756 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652aa014-5072-41fd-ae63-83e12d20078e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:15.085031 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652aa014-5072-41fd-ae63-83e12d20078e admin admin] PATH_INFO: `/v3/projects/20460461ac8a48b199d66f7d9fb75b25/users/3767578f1fe64c76850826f1e4ef5951/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:15.087798 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:15.097139 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 993/1984] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:15.099164 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea34c8-57e5-4a0a-8358-c27f20213b06 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:15.116335 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652aa014-5072-41fd-ae63-83e12d20078e admin admin] RBAC: Authorizing `identity:create_grant(project_id=20460461ac8a48b199d66f7d9fb75b25, user_id=3767578f1fe64c76850826f1e4ef5951, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:15.116559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea34c8-57e5-4a0a-8358-c27f20213b06 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:15.119158 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652aa014-5072-41fd-ae63-83e12d20078e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:15.124195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f202ed1-8f8a-4778-a94f-ed08d9b34f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:15.124825 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f202ed1-8f8a-4778-a94f-ed08d9b34f63 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:15.125124 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f202ed1-8f8a-4778-a94f-ed08d9b34f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:15.125399 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f202ed1-8f8a-4778-a94f-ed08d9b34f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:15.126069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f202ed1-8f8a-4778-a94f-ed08d9b34f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:15.128042 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f202ed1-8f8a-4778-a94f-ed08d9b34f63 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:15.135682 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 992/1985] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:15 2022] PUT /identity/v3/projects/20460461ac8a48b199d66f7d9fb75b25/users/3767578f1fe64c76850826f1e4ef5951/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:15.140776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652aa014-5072-41fd-ae63-83e12d20078e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:15.148492 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 994/1986] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:13:15.152833 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f202ed1-8f8a-4778-a94f-ed08d9b34f63 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:15.163360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f202ed1-8f8a-4778-a94f-ed08d9b34f63 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:15.225176 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652aa014-5072-41fd-ae63-83e12d20078e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:15.230147 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cdf2b-96fe-4fee-b941-4b7f3525ad87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:15.230296 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed1c03-de82-4018-9829-1695fdf1be5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:15.230850 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cdf2b-96fe-4fee-b941-4b7f3525ad87 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:15.231204 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cdf2b-96fe-4fee-b941-4b7f3525ad87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:15.231314 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed1c03-de82-4018-9829-1695fdf1be5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:15.231599 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cdf2b-96fe-4fee-b941-4b7f3525ad87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:15.231705 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed1c03-de82-4018-9829-1695fdf1be5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:15.232148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed1c03-de82-4018-9829-1695fdf1be5d admin admin] PATH_INFO: `/v3/projects/d0bb8564182e43338c5a9ca626f25718/users/b74aec9f3e574f1f8d07dbf92667ea02/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:15.232464 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058cdf2b-96fe-4fee-b941-4b7f3525ad87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:15.234194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058cdf2b-96fe-4fee-b941-4b7f3525ad87 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:15.248799 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 993/1987] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:15.249674 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed1c03-de82-4018-9829-1695fdf1be5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0bb8564182e43338c5a9ca626f25718, user_id=b74aec9f3e574f1f8d07dbf92667ea02, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:15.249931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cdf2b-96fe-4fee-b941-4b7f3525ad87 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:15.252553 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed1c03-de82-4018-9829-1695fdf1be5d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:15.263396 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cdf2b-96fe-4fee-b941-4b7f3525ad87 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:15.268613 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 995/1988] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:15 2022] PUT /identity/v3/projects/d0bb8564182e43338c5a9ca626f25718/users/b74aec9f3e574f1f8d07dbf92667ea02/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:15.278559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f039d0-51e6-4d1b-91d9-4b2b0eecddc7 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:15.278833 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f039d0-51e6-4d1b-91d9-4b2b0eecddc7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:15.279433 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f039d0-51e6-4d1b-91d9-4b2b0eecddc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:15.313266 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-23f039d0-51e6-4d1b-91d9-4b2b0eecddc7 None None] MFA Rules not processed for user `b74aec9f3e574f1f8d07dbf92667ea02`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:15.314625 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-23f039d0-51e6-4d1b-91d9-4b2b0eecddc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:15.348543 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:15.354795 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2529fd-91ad-42e7-95b3-21375ae61eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:15.357032 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2529fd-91ad-42e7-95b3-21375ae61eb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:15.357537 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2529fd-91ad-42e7-95b3-21375ae61eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:15.358119 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2529fd-91ad-42e7-95b3-21375ae61eb9 admin admin] PATH_INFO: `/v3/projects/20460461ac8a48b199d66f7d9fb75b25/users/3767578f1fe64c76850826f1e4ef5951/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:15.361226 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2529fd-91ad-42e7-95b3-21375ae61eb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20460461ac8a48b199d66f7d9fb75b25, user_id=3767578f1fe64c76850826f1e4ef5951, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:15.364203 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2529fd-91ad-42e7-95b3-21375ae61eb9 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:15.385281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 994/1989] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:15 2022] PUT /identity/v3/projects/20460461ac8a48b199d66f7d9fb75b25/users/3767578f1fe64c76850826f1e4ef5951/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:13:15.387593 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86fa06-d3e2-4219-9fe4-8100277a9d49 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:15.387944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86fa06-d3e2-4219-9fe4-8100277a9d49 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:15.388362 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86fa06-d3e2-4219-9fe4-8100277a9d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:15.441999 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 996/1990] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:15.447120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-cb86fa06-d3e2-4219-9fe4-8100277a9d49 None None] MFA Rules not processed for user `3767578f1fe64c76850826f1e4ef5951`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:15.448765 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-cb86fa06-d3e2-4219-9fe4-8100277a9d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:15.462738 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f039d0-51e6-4d1b-91d9-4b2b0eecddc7 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:15.464449 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-23f039d0-51e6-4d1b-91d9-4b2b0eecddc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:15.560555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f039d0-51e6-4d1b-91d9-4b2b0eecddc7 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:15.571663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:15.586103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 995/1991] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:15.642456 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037a518-f4a8-413c-a0b8-fd1095a3d063 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:15.643174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037a518-f4a8-413c-a0b8-fd1095a3d063 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:15.643425 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037a518-f4a8-413c-a0b8-fd1095a3d063 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:15.643696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037a518-f4a8-413c-a0b8-fd1095a3d063 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:15.702303 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86fa06-d3e2-4219-9fe4-8100277a9d49 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:15.704440 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-cb86fa06-d3e2-4219-9fe4-8100277a9d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:15.726672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86fa06-d3e2-4219-9fe4-8100277a9d49 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:15.732193 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720a4c9-3ce3-4dc7-b850-11dffa830bfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:15.733132 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720a4c9-3ce3-4dc7-b850-11dffa830bfa service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:15.733487 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720a4c9-3ce3-4dc7-b850-11dffa830bfa service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:15.733874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720a4c9-3ce3-4dc7-b850-11dffa830bfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:15.742941 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037a518-f4a8-413c-a0b8-fd1095a3d063 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:15.746846 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037a518-f4a8-413c-a0b8-fd1095a3d063 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:15.765295 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 997/1992] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:15.782003 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037a518-f4a8-413c-a0b8-fd1095a3d063 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:15.806028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720a4c9-3ce3-4dc7-b850-11dffa830bfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:15.807467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720a4c9-3ce3-4dc7-b850-11dffa830bfa service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:15.820852 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 996/1993] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:15.836570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:15.901111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037a518-f4a8-413c-a0b8-fd1095a3d063 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:15.906469 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edad44-67e7-4ca8-bf41-90166ff34a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:15.907453 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edad44-67e7-4ca8-bf41-90166ff34a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:15.907854 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edad44-67e7-4ca8-bf41-90166ff34a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:15.908167 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edad44-67e7-4ca8-bf41-90166ff34a47 admin admin] PATH_INFO: `/v3/users/b74aec9f3e574f1f8d07dbf92667ea02` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:15.909494 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3edad44-67e7-4ca8-bf41-90166ff34a47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b74aec9f3e574f1f8d07dbf92667ea02)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:15.912421 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3edad44-67e7-4ca8-bf41-90166ff34a47 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:15.991176 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f3edad44-67e7-4ca8-bf41-90166ff34a47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b74aec9f3e574f1f8d07dbf92667ea02'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:16.003587 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f3edad44-67e7-4ca8-bf41-90166ff34a47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b74aec9f3e574f1f8d07dbf92667ea02'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:16.033633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f3edad44-67e7-4ca8-bf41-90166ff34a47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b74aec9f3e574f1f8d07dbf92667ea02'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:16.034956 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f3edad44-67e7-4ca8-bf41-90166ff34a47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b74aec9f3e574f1f8d07dbf92667ea02'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:16.046200 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f3edad44-67e7-4ca8-bf41-90166ff34a47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b74aec9f3e574f1f8d07dbf92667ea02'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:16.054298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 998/1994] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:13:15 2022] DELETE /identity/v3/users/b74aec9f3e574f1f8d07dbf92667ea02 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:13:16.059260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0425c7-bc2d-44ca-8c71-0b35210a4b60 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:16.059604 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0425c7-bc2d-44ca-8c71-0b35210a4b60 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:16.059949 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0425c7-bc2d-44ca-8c71-0b35210a4b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:16.079976 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-6d0425c7-bc2d-44ca-8c71-0b35210a4b60 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:16.081230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-6d0425c7-bc2d-44ca-8c71-0b35210a4b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:16.166554 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 997/1995] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:16.180657 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edad44-67e7-4ca8-bf41-90166ff34a47 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:16.182370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f3edad44-67e7-4ca8-bf41-90166ff34a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:16.279033 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edad44-67e7-4ca8-bf41-90166ff34a47 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:16.283030 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45099e6c-c49d-4ee4-b07f-41ed2962f134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:16.283647 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45099e6c-c49d-4ee4-b07f-41ed2962f134 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:16.283925 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45099e6c-c49d-4ee4-b07f-41ed2962f134 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:16.284196 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45099e6c-c49d-4ee4-b07f-41ed2962f134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:16.294061 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45099e6c-c49d-4ee4-b07f-41ed2962f134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:16.295557 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45099e6c-c49d-4ee4-b07f-41ed2962f134 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:16.305795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 999/1996] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 14:13:16.674183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0425c7-bc2d-44ca-8c71-0b35210a4b60 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:16.676249 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-6d0425c7-bc2d-44ca-8c71-0b35210a4b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:16.701062 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0425c7-bc2d-44ca-8c71-0b35210a4b60 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:16.708788 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a55b74-6d1c-4fd1-949b-7a521d8220b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:16.709765 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a55b74-6d1c-4fd1-949b-7a521d8220b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:16.710430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a55b74-6d1c-4fd1-949b-7a521d8220b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:16.710543 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a55b74-6d1c-4fd1-949b-7a521d8220b6 admin admin] PATH_INFO: `/v3/projects/d0bb8564182e43338c5a9ca626f25718` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:16.711633 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a55b74-6d1c-4fd1-949b-7a521d8220b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0bb8564182e43338c5a9ca626f25718)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:16.713632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a55b74-6d1c-4fd1-949b-7a521d8220b6 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:16.782001 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-88a55b74-6d1c-4fd1-949b-7a521d8220b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0bb8564182e43338c5a9ca626f25718', 'request_id': 'req-88a55b74-6d1c-4fd1-949b-7a521d8220b6'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:16.792134 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-88a55b74-6d1c-4fd1-949b-7a521d8220b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0bb8564182e43338c5a9ca626f25718', 'request_id': 'req-88a55b74-6d1c-4fd1-949b-7a521d8220b6'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:16.800713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-88a55b74-6d1c-4fd1-949b-7a521d8220b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0bb8564182e43338c5a9ca626f25718', 'request_id': 'req-88a55b74-6d1c-4fd1-949b-7a521d8220b6'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:16.826571 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-88a55b74-6d1c-4fd1-949b-7a521d8220b6 admin admin] The token cache is being invalidate because project d0bb8564182e43338c5a9ca626f25718 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:16.826889 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-88a55b74-6d1c-4fd1-949b-7a521d8220b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:16.827585 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-88a55b74-6d1c-4fd1-949b-7a521d8220b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:16.829146 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 998/1997] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:16 2022] DELETE /identity/v3/projects/d0bb8564182e43338c5a9ca626f25718 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:16.834036 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd8c98-c01b-4f6a-b77b-e39b061ffcdd None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:16.834323 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd8c98-c01b-4f6a-b77b-e39b061ffcdd None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:16.834596 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd8c98-c01b-4f6a-b77b-e39b061ffcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:16.861418 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-45cd8c98-c01b-4f6a-b77b-e39b061ffcdd None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:16.863237 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-45cd8c98-c01b-4f6a-b77b-e39b061ffcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:16.925846 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:16.942270 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1000/1998] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:16.948982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e53723-0efa-4623-8539-3ed648d0027e None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:16.949679 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e53723-0efa-4623-8539-3ed648d0027e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:16.950012 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e53723-0efa-4623-8539-3ed648d0027e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:16.971513 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-17e53723-0efa-4623-8539-3ed648d0027e None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:16.972697 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-17e53723-0efa-4623-8539-3ed648d0027e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:16.981383 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 999/1999] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:16.985519 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd8c98-c01b-4f6a-b77b-e39b061ffcdd None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:16.996746 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd8c98-c01b-4f6a-b77b-e39b061ffcdd None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:17.002565 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf4d41-6536-4b1d-ae43-527d456b4f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:17.003231 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf4d41-6536-4b1d-ae43-527d456b4f11 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:17.003502 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf4d41-6536-4b1d-ae43-527d456b4f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:17.003828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf4d41-6536-4b1d-ae43-527d456b4f11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:17.004563 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf4d41-6536-4b1d-ae43-527d456b4f11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:13:17.004932 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf4d41-6536-4b1d-ae43-527d456b4f11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:17.006517 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf4d41-6536-4b1d-ae43-527d456b4f11 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:17.020471 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1001/2000] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:13:17.024592 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e53723-0efa-4623-8539-3ed648d0027e None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:17.034020 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e53723-0efa-4623-8539-3ed648d0027e None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:17.038999 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe881dfc-95c2-4e18-b2e6-ce01f8a54b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:17.039588 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe881dfc-95c2-4e18-b2e6-ce01f8a54b22 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:17.039863 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe881dfc-95c2-4e18-b2e6-ce01f8a54b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:17.040128 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe881dfc-95c2-4e18-b2e6-ce01f8a54b22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:17.040745 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe881dfc-95c2-4e18-b2e6-ce01f8a54b22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:17.042831 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe881dfc-95c2-4e18-b2e6-ce01f8a54b22 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:17.054832 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:17.081162 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1000/2001] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:17 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:17.085489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf4d41-6536-4b1d-ae43-527d456b4f11 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:17.100317 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf4d41-6536-4b1d-ae43-527d456b4f11 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:17.171898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56085814-3a95-4030-ab69-08c885aa1a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:17.172530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56085814-3a95-4030-ab69-08c885aa1a7c admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:17.172826 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56085814-3a95-4030-ab69-08c885aa1a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:17.173062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56085814-3a95-4030-ab69-08c885aa1a7c admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:17.173718 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56085814-3a95-4030-ab69-08c885aa1a7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:17.175641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56085814-3a95-4030-ab69-08c885aa1a7c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:17.210454 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1002/2002] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:17 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:13:17.215460 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe881dfc-95c2-4e18-b2e6-ce01f8a54b22 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:17.226006 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe881dfc-95c2-4e18-b2e6-ce01f8a54b22 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:17.231312 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8cfcf7-555e-4425-9e29-830ec38f9132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:17.231924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8cfcf7-555e-4425-9e29-830ec38f9132 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:17.232200 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8cfcf7-555e-4425-9e29-830ec38f9132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:17.232497 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8cfcf7-555e-4425-9e29-830ec38f9132 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:17.234327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8cfcf7-555e-4425-9e29-830ec38f9132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:17.235724 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8cfcf7-555e-4425-9e29-830ec38f9132 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:17.249450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1001/2003] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:17.250436 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56085814-3a95-4030-ab69-08c885aa1a7c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:17.260600 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56085814-3a95-4030-ab69-08c885aa1a7c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:17.269402 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74258bec-63d3-4e8b-bd30-3b189bc703cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:17.270019 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74258bec-63d3-4e8b-bd30-3b189bc703cb admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:17.270297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74258bec-63d3-4e8b-bd30-3b189bc703cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:17.270563 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74258bec-63d3-4e8b-bd30-3b189bc703cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:17.271355 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74258bec-63d3-4e8b-bd30-3b189bc703cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:17.272883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74258bec-63d3-4e8b-bd30-3b189bc703cb admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:17.286516 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1003/2004] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:17.290821 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8cfcf7-555e-4425-9e29-830ec38f9132 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:17.301773 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8cfcf7-555e-4425-9e29-830ec38f9132 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:17.306623 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b39102-a3a9-4aff-a15c-4e4857b71084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:17.307429 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b39102-a3a9-4aff-a15c-4e4857b71084 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:17.307710 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b39102-a3a9-4aff-a15c-4e4857b71084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:17.308054 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b39102-a3a9-4aff-a15c-4e4857b71084 admin admin] PATH_INFO: `/v3/projects/8faf72a40e1a4b03add45381e91b7120/users/c2a8ac88f5984bf299c6ac62ea99030f/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:17.325923 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b39102-a3a9-4aff-a15c-4e4857b71084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8faf72a40e1a4b03add45381e91b7120, user_id=c2a8ac88f5984bf299c6ac62ea99030f, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:17.328828 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b39102-a3a9-4aff-a15c-4e4857b71084 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:17.357133 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1002/2005] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:17 2022] PUT /identity/v3/projects/8faf72a40e1a4b03add45381e91b7120/users/c2a8ac88f5984bf299c6ac62ea99030f/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:17.362920 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da9020-cfa3-49e5-be27-af852345dd70 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:17.363755 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da9020-cfa3-49e5-be27-af852345dd70 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:17.364007 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da9020-cfa3-49e5-be27-af852345dd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:17.396160 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-31da9020-cfa3-49e5-be27-af852345dd70 None None] MFA Rules not processed for user `c2a8ac88f5984bf299c6ac62ea99030f`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:17.397437 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-31da9020-cfa3-49e5-be27-af852345dd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:17.473313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1004/2006] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:17.485244 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b39102-a3a9-4aff-a15c-4e4857b71084 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:17.487020 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-94b39102-a3a9-4aff-a15c-4e4857b71084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:17.555962 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b39102-a3a9-4aff-a15c-4e4857b71084 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:17.560154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33384c-0f2c-4ada-b327-02402746078c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:17.560762 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33384c-0f2c-4ada-b327-02402746078c service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:17.561042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33384c-0f2c-4ada-b327-02402746078c service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:17.561347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33384c-0f2c-4ada-b327-02402746078c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:17.569748 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33384c-0f2c-4ada-b327-02402746078c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:17.571168 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33384c-0f2c-4ada-b327-02402746078c service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:17.580699 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1003/2007] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:18.563730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da9020-cfa3-49e5-be27-af852345dd70 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:18.565344 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-31da9020-cfa3-49e5-be27-af852345dd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:18.664816 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:18.682307 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da9020-cfa3-49e5-be27-af852345dd70 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:18.688529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c09d00-de5b-47b3-b4fb-feef702f9877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:18.689339 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c09d00-de5b-47b3-b4fb-feef702f9877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:18.689730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c09d00-de5b-47b3-b4fb-feef702f9877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:18.690105 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c09d00-de5b-47b3-b4fb-feef702f9877 admin admin] PATH_INFO: `/v3/users/e29d391b2662435ba870f27df675ece6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:18.691451 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c09d00-de5b-47b3-b4fb-feef702f9877 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e29d391b2662435ba870f27df675ece6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:18.693545 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c09d00-de5b-47b3-b4fb-feef702f9877 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:18.754046 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-02c09d00-de5b-47b3-b4fb-feef702f9877 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e29d391b2662435ba870f27df675ece6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:18.763996 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-02c09d00-de5b-47b3-b4fb-feef702f9877 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e29d391b2662435ba870f27df675ece6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:18.781567 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-02c09d00-de5b-47b3-b4fb-feef702f9877 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e29d391b2662435ba870f27df675ece6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:18.782485 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-02c09d00-de5b-47b3-b4fb-feef702f9877 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e29d391b2662435ba870f27df675ece6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:18.791040 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-02c09d00-de5b-47b3-b4fb-feef702f9877 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e29d391b2662435ba870f27df675ece6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:18.798821 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1005/2008] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:13:18 2022] DELETE /identity/v3/users/e29d391b2662435ba870f27df675ece6 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:18.803189 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a84c15-96b8-43ce-ab62-dccb7eb92ace None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:18.803742 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a84c15-96b8-43ce-ab62-dccb7eb92ace None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:18.803835 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a84c15-96b8-43ce-ab62-dccb7eb92ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:18.826167 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-30a84c15-96b8-43ce-ab62-dccb7eb92ace None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:18.827563 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-30a84c15-96b8-43ce-ab62-dccb7eb92ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:18.922348 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1004/2009] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:18.932120 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c09d00-de5b-47b3-b4fb-feef702f9877 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:18.934339 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-02c09d00-de5b-47b3-b4fb-feef702f9877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:19.026405 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c09d00-de5b-47b3-b4fb-feef702f9877 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:19.031517 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb51ad9-211d-4061-83af-cbd6161ff4ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:19.032288 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb51ad9-211d-4061-83af-cbd6161ff4ca service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:19.032920 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb51ad9-211d-4061-83af-cbd6161ff4ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:19.033237 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb51ad9-211d-4061-83af-cbd6161ff4ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:19.046149 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb51ad9-211d-4061-83af-cbd6161ff4ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:19.047602 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb51ad9-211d-4061-83af-cbd6161ff4ca service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:19.061422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1006/2010] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:19.510076 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a84c15-96b8-43ce-ab62-dccb7eb92ace None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:19.512250 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-30a84c15-96b8-43ce-ab62-dccb7eb92ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:19.534794 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a84c15-96b8-43ce-ab62-dccb7eb92ace None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:19.550135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bdc6e-99d5-462e-bf17-63a19857a095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:19.551300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bdc6e-99d5-462e-bf17-63a19857a095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:19.551656 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bdc6e-99d5-462e-bf17-63a19857a095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:19.551997 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bdc6e-99d5-462e-bf17-63a19857a095 admin admin] PATH_INFO: `/v3/projects/3fe447122c2b4dea9fb104f12f5543cd` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:19.553428 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4bdc6e-99d5-462e-bf17-63a19857a095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fe447122c2b4dea9fb104f12f5543cd)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:19.555495 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4bdc6e-99d5-462e-bf17-63a19857a095 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:19.654660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-4b4bdc6e-99d5-462e-bf17-63a19857a095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fe447122c2b4dea9fb104f12f5543cd', 'request_id': 'req-4b4bdc6e-99d5-462e-bf17-63a19857a095'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:19.659583 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:19.665958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-4b4bdc6e-99d5-462e-bf17-63a19857a095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fe447122c2b4dea9fb104f12f5543cd', 'request_id': 'req-4b4bdc6e-99d5-462e-bf17-63a19857a095'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:19.674906 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-4b4bdc6e-99d5-462e-bf17-63a19857a095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fe447122c2b4dea9fb104f12f5543cd', 'request_id': 'req-4b4bdc6e-99d5-462e-bf17-63a19857a095'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:19.692321 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-4b4bdc6e-99d5-462e-bf17-63a19857a095 admin admin] The token cache is being invalidate because project 3fe447122c2b4dea9fb104f12f5543cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:19.692778 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-4b4bdc6e-99d5-462e-bf17-63a19857a095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:19.693476 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-4b4bdc6e-99d5-462e-bf17-63a19857a095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:19.695242 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1005/2011] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:19 2022] DELETE /identity/v3/projects/3fe447122c2b4dea9fb104f12f5543cd => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:19.699234 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb51ad9-211d-4061-83af-cbd6161ff4ca service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:19.709565 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb51ad9-211d-4061-83af-cbd6161ff4ca service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:19.796650 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4350a1-4e42-4bd3-b564-7499f06cbc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:19.797792 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4350a1-4e42-4bd3-b564-7499f06cbc99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:19.798087 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4350a1-4e42-4bd3-b564-7499f06cbc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:19.798362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4350a1-4e42-4bd3-b564-7499f06cbc99 admin admin] PATH_INFO: `/v3/users/3767578f1fe64c76850826f1e4ef5951` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:19.799701 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4350a1-4e42-4bd3-b564-7499f06cbc99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3767578f1fe64c76850826f1e4ef5951)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:19.803240 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4350a1-4e42-4bd3-b564-7499f06cbc99 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:19.821961 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:19.881767 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8f4350a1-4e42-4bd3-b564-7499f06cbc99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3767578f1fe64c76850826f1e4ef5951'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:19.896647 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8f4350a1-4e42-4bd3-b564-7499f06cbc99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3767578f1fe64c76850826f1e4ef5951'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:19.914041 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8f4350a1-4e42-4bd3-b564-7499f06cbc99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3767578f1fe64c76850826f1e4ef5951'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:19.914785 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8f4350a1-4e42-4bd3-b564-7499f06cbc99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3767578f1fe64c76850826f1e4ef5951'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:19.924406 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8f4350a1-4e42-4bd3-b564-7499f06cbc99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3767578f1fe64c76850826f1e4ef5951'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:19.935326 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1007/2012] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:13:19 2022] DELETE /identity/v3/users/3767578f1fe64c76850826f1e4ef5951 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:20.628565 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bdc6e-99d5-462e-bf17-63a19857a095 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:20.638566 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4b4bdc6e-99d5-462e-bf17-63a19857a095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:20.674018 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bdc6e-99d5-462e-bf17-63a19857a095 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:20.766419 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4350a1-4e42-4bd3-b564-7499f06cbc99 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:20.768681 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8f4350a1-4e42-4bd3-b564-7499f06cbc99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:20.834831 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965f752-8333-40e3-bf04-999fe1f08f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:20.835788 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965f752-8333-40e3-bf04-999fe1f08f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:20.836351 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965f752-8333-40e3-bf04-999fe1f08f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:20.837002 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965f752-8333-40e3-bf04-999fe1f08f9a admin admin] PATH_INFO: `/v3/projects/20460461ac8a48b199d66f7d9fb75b25` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:20.839302 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965f752-8333-40e3-bf04-999fe1f08f9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=20460461ac8a48b199d66f7d9fb75b25)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:20.843387 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965f752-8333-40e3-bf04-999fe1f08f9a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:20.863362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4350a1-4e42-4bd3-b564-7499f06cbc99 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:20.870732 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa619fba-2b61-45be-861f-1edb9e66b420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:20.871841 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa619fba-2b61-45be-861f-1edb9e66b420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:20.872305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa619fba-2b61-45be-861f-1edb9e66b420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:20.872904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa619fba-2b61-45be-861f-1edb9e66b420 admin admin] PATH_INFO: `/v3/users/ec5a017d6c6445bb9b8e3c39641d30ed` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:20.874507 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa619fba-2b61-45be-861f-1edb9e66b420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec5a017d6c6445bb9b8e3c39641d30ed)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:20.876745 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa619fba-2b61-45be-861f-1edb9e66b420 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:20.988041 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-0965f752-8333-40e3-bf04-999fe1f08f9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20460461ac8a48b199d66f7d9fb75b25', 'request_id': 'req-0965f752-8333-40e3-bf04-999fe1f08f9a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:21.000755 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-aa619fba-2b61-45be-861f-1edb9e66b420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec5a017d6c6445bb9b8e3c39641d30ed'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:21.014883 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-0965f752-8333-40e3-bf04-999fe1f08f9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20460461ac8a48b199d66f7d9fb75b25', 'request_id': 'req-0965f752-8333-40e3-bf04-999fe1f08f9a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:21.033411 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-0965f752-8333-40e3-bf04-999fe1f08f9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20460461ac8a48b199d66f7d9fb75b25', 'request_id': 'req-0965f752-8333-40e3-bf04-999fe1f08f9a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:21.035103 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-aa619fba-2b61-45be-861f-1edb9e66b420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec5a017d6c6445bb9b8e3c39641d30ed'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:21.070008 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-0965f752-8333-40e3-bf04-999fe1f08f9a admin admin] The token cache is being invalidate because project 20460461ac8a48b199d66f7d9fb75b25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:21.070305 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-0965f752-8333-40e3-bf04-999fe1f08f9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:21.071064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-0965f752-8333-40e3-bf04-999fe1f08f9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:21.077782 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-aa619fba-2b61-45be-861f-1edb9e66b420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec5a017d6c6445bb9b8e3c39641d30ed'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:21.078678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1006/2013] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:20 2022] DELETE /identity/v3/projects/20460461ac8a48b199d66f7d9fb75b25 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:21.078792 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-aa619fba-2b61-45be-861f-1edb9e66b420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec5a017d6c6445bb9b8e3c39641d30ed'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:21.081289 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cd498-5a20-452b-9868-7631da4a403d None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:21.081573 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cd498-5a20-452b-9868-7631da4a403d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:21.081849 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cd498-5a20-452b-9868-7631da4a403d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:21.108124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-b38cd498-5a20-452b-9868-7631da4a403d None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:21.109670 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b38cd498-5a20-452b-9868-7631da4a403d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:21.111301 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-aa619fba-2b61-45be-861f-1edb9e66b420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec5a017d6c6445bb9b8e3c39641d30ed'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:21.129333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1008/2014] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:13:20 2022] DELETE /identity/v3/users/ec5a017d6c6445bb9b8e3c39641d30ed => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:13:21.140661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9977170-240d-41c8-85be-dd3ebde5e428 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:21.140955 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9977170-240d-41c8-85be-dd3ebde5e428 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:21.142332 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9977170-240d-41c8-85be-dd3ebde5e428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:21.173050 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d9977170-240d-41c8-85be-dd3ebde5e428 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:21.174490 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d9977170-240d-41c8-85be-dd3ebde5e428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:21.182285 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:21.233030 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1007/2015] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:21.240761 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff648dd-3c71-46e6-b194-4dad49c069bc None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:21.241075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff648dd-3c71-46e6-b194-4dad49c069bc None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:21.241355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff648dd-3c71-46e6-b194-4dad49c069bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:21.271057 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1009/2016] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:21.271230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-cff648dd-3c71-46e6-b194-4dad49c069bc None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:21.272616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-cff648dd-3c71-46e6-b194-4dad49c069bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:21.278020 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9977170-240d-41c8-85be-dd3ebde5e428 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:21.281712 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1008/2017] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:13:21.282021 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d9977170-240d-41c8-85be-dd3ebde5e428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:21.285805 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff648dd-3c71-46e6-b194-4dad49c069bc None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:21.296005 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff648dd-3c71-46e6-b194-4dad49c069bc None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:21.302557 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34dff9e-725d-4b91-8bfd-9859575243e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:21.303171 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34dff9e-725d-4b91-8bfd-9859575243e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:21.303448 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34dff9e-725d-4b91-8bfd-9859575243e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:21.303713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34dff9e-725d-4b91-8bfd-9859575243e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:21.304360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34dff9e-725d-4b91-8bfd-9859575243e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:13:21.304655 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34dff9e-725d-4b91-8bfd-9859575243e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:21.306274 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34dff9e-725d-4b91-8bfd-9859575243e8 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:21.308637 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:21.326796 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1009/2018] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:13:21.331423 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34dff9e-725d-4b91-8bfd-9859575243e8 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:21.349528 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34dff9e-725d-4b91-8bfd-9859575243e8 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:21.357607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a901d-88a3-4bc2-9d94-79d775cb3108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:21.358495 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a901d-88a3-4bc2-9d94-79d775cb3108 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:21.358938 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a901d-88a3-4bc2-9d94-79d775cb3108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:21.359215 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a901d-88a3-4bc2-9d94-79d775cb3108 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:21.360101 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a901d-88a3-4bc2-9d94-79d775cb3108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:21.363988 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a901d-88a3-4bc2-9d94-79d775cb3108 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:21.364790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9977170-240d-41c8-85be-dd3ebde5e428 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:21.369423 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a650d0a-0030-4913-bbd9-a0c84b2100c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:21.370637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a650d0a-0030-4913-bbd9-a0c84b2100c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:21.371185 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a650d0a-0030-4913-bbd9-a0c84b2100c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:21.371538 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a650d0a-0030-4913-bbd9-a0c84b2100c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:21.384598 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a650d0a-0030-4913-bbd9-a0c84b2100c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:21.386221 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a650d0a-0030-4913-bbd9-a0c84b2100c9 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:21.398017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1010/2019] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:21.414186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1010/2020] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:21 2022] POST /identity/v3/projects => generated 385 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:21.417173 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a650d0a-0030-4913-bbd9-a0c84b2100c9 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:21.430922 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a650d0a-0030-4913-bbd9-a0c84b2100c9 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:21.520027 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba39664-d7e7-4dbd-8c9f-22616d5bdacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:21.520802 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba39664-d7e7-4dbd-8c9f-22616d5bdacc admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:21.521207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba39664-d7e7-4dbd-8c9f-22616d5bdacc admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:21.521662 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba39664-d7e7-4dbd-8c9f-22616d5bdacc admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:21.522585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba39664-d7e7-4dbd-8c9f-22616d5bdacc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:21.524888 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba39664-d7e7-4dbd-8c9f-22616d5bdacc admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:21.559453 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1011/2021] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:21 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:21.563577 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a901d-88a3-4bc2-9d94-79d775cb3108 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:21.576673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a901d-88a3-4bc2-9d94-79d775cb3108 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:21.583254 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2370f46-e157-4266-a9ab-9293009a3c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:21.584689 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2370f46-e157-4266-a9ab-9293009a3c16 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:21.585195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2370f46-e157-4266-a9ab-9293009a3c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:21.586425 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2370f46-e157-4266-a9ab-9293009a3c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:21.587549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2370f46-e157-4266-a9ab-9293009a3c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:21.591155 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2370f46-e157-4266-a9ab-9293009a3c16 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:21.611079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1011/2022] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:13:21.611879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba39664-d7e7-4dbd-8c9f-22616d5bdacc admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:21.648065 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba39664-d7e7-4dbd-8c9f-22616d5bdacc admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:21.662966 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee1e77-4eed-4e79-afb9-32704c1c066e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:21.664366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee1e77-4eed-4e79-afb9-32704c1c066e admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:21.664841 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee1e77-4eed-4e79-afb9-32704c1c066e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:21.665854 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee1e77-4eed-4e79-afb9-32704c1c066e admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:21.667825 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee1e77-4eed-4e79-afb9-32704c1c066e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:21.671004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee1e77-4eed-4e79-afb9-32704c1c066e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:21.683877 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1012/2023] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:21.687286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2370f46-e157-4266-a9ab-9293009a3c16 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:21.701622 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2370f46-e157-4266-a9ab-9293009a3c16 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:21.707764 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98045e5-58fd-4533-b9b3-6b0aa7935192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:21.708612 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98045e5-58fd-4533-b9b3-6b0aa7935192 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:21.709285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98045e5-58fd-4533-b9b3-6b0aa7935192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:21.709285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98045e5-58fd-4533-b9b3-6b0aa7935192 admin admin] PATH_INFO: `/v3/projects/11bb85917d5e473ca2cfa78754a45909/users/c5b050f9492440b0a5ba9861e10e34e5/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:21.725242 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98045e5-58fd-4533-b9b3-6b0aa7935192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11bb85917d5e473ca2cfa78754a45909, user_id=c5b050f9492440b0a5ba9861e10e34e5, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:21.727900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98045e5-58fd-4533-b9b3-6b0aa7935192 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:21.743351 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1012/2024] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:21 2022] PUT /identity/v3/projects/11bb85917d5e473ca2cfa78754a45909/users/c5b050f9492440b0a5ba9861e10e34e5/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:21.754558 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d907f7-3c05-4848-803f-e466f970657b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:21.754841 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d907f7-3c05-4848-803f-e466f970657b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:21.755114 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d907f7-3c05-4848-803f-e466f970657b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:21.802530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e5d907f7-3c05-4848-803f-e466f970657b None None] MFA Rules not processed for user `c5b050f9492440b0a5ba9861e10e34e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:21.803942 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e5d907f7-3c05-4848-803f-e466f970657b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:21.817958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98045e5-58fd-4533-b9b3-6b0aa7935192 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:21.820109 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a98045e5-58fd-4533-b9b3-6b0aa7935192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:21.851059 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:21.909068 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1013/2025] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:21.923280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d907f7-3c05-4848-803f-e466f970657b None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:21.927340 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e5d907f7-3c05-4848-803f-e466f970657b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:21.932965 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98045e5-58fd-4533-b9b3-6b0aa7935192 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:21.939431 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80af239-690b-40c6-ac3c-65a741fef29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:21.940079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80af239-690b-40c6-ac3c-65a741fef29c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:21.940363 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80af239-690b-40c6-ac3c-65a741fef29c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:21.940636 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80af239-690b-40c6-ac3c-65a741fef29c admin admin] PATH_INFO: `/v3/projects/7a6d63820e454d1ab952a22ec2b3758d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:21.941836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80af239-690b-40c6-ac3c-65a741fef29c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a6d63820e454d1ab952a22ec2b3758d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:21.944168 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80af239-690b-40c6-ac3c-65a741fef29c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:22.015799 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b80af239-690b-40c6-ac3c-65a741fef29c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a6d63820e454d1ab952a22ec2b3758d', 'request_id': 'req-b80af239-690b-40c6-ac3c-65a741fef29c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:22.017235 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d907f7-3c05-4848-803f-e466f970657b None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:22.025408 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b80af239-690b-40c6-ac3c-65a741fef29c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a6d63820e454d1ab952a22ec2b3758d', 'request_id': 'req-b80af239-690b-40c6-ac3c-65a741fef29c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:22.033661 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b80af239-690b-40c6-ac3c-65a741fef29c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a6d63820e454d1ab952a22ec2b3758d', 'request_id': 'req-b80af239-690b-40c6-ac3c-65a741fef29c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:22.050876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b80af239-690b-40c6-ac3c-65a741fef29c admin admin] The token cache is being invalidate because project 7a6d63820e454d1ab952a22ec2b3758d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:22.051184 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b80af239-690b-40c6-ac3c-65a741fef29c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:22.051904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b80af239-690b-40c6-ac3c-65a741fef29c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:22.054032 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1013/2026] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:21 2022] DELETE /identity/v3/projects/7a6d63820e454d1ab952a22ec2b3758d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:13:22.057910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80af239-690b-40c6-ac3c-65a741fef29c admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:22.060402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b80af239-690b-40c6-ac3c-65a741fef29c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:22.092352 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c18f7-ffc4-49ce-aae4-cfc863918446 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:22.092758 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c18f7-ffc4-49ce-aae4-cfc863918446 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:22.093237 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c18f7-ffc4-49ce-aae4-cfc863918446 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:22.093528 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c18f7-ffc4-49ce-aae4-cfc863918446 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:22.096247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d06c18f7-ffc4-49ce-aae4-cfc863918446 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:22.114200 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:22.169182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80af239-690b-40c6-ac3c-65a741fef29c admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:22.180468 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe802d6-f25f-440d-ab67-fcd6d55f819a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:22.181174 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe802d6-f25f-440d-ab67-fcd6d55f819a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:22.181464 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe802d6-f25f-440d-ab67-fcd6d55f819a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:22.181727 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe802d6-f25f-440d-ab67-fcd6d55f819a admin admin] PATH_INFO: `/v3/users/2aac365986a741e5aa1da5d1faffe01c` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:22.183663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe802d6-f25f-440d-ab67-fcd6d55f819a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aac365986a741e5aa1da5d1faffe01c)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:22.185554 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe802d6-f25f-440d-ab67-fcd6d55f819a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:22.232498 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c18f7-ffc4-49ce-aae4-cfc863918446 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:22.234323 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c18f7-ffc4-49ce-aae4-cfc863918446 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:22.246958 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1014/2027] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:22.249702 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-abe802d6-f25f-440d-ab67-fcd6d55f819a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aac365986a741e5aa1da5d1faffe01c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:22.259069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-abe802d6-f25f-440d-ab67-fcd6d55f819a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aac365986a741e5aa1da5d1faffe01c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:22.273836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-abe802d6-f25f-440d-ab67-fcd6d55f819a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aac365986a741e5aa1da5d1faffe01c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:22.274730 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-abe802d6-f25f-440d-ab67-fcd6d55f819a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aac365986a741e5aa1da5d1faffe01c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:22.283141 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-abe802d6-f25f-440d-ab67-fcd6d55f819a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aac365986a741e5aa1da5d1faffe01c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:22.289705 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1014/2028] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:13:22 2022] DELETE /identity/v3/users/2aac365986a741e5aa1da5d1faffe01c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:22.975356 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c18f7-ffc4-49ce-aae4-cfc863918446 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:22.998807 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c18f7-ffc4-49ce-aae4-cfc863918446 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:23.037260 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:23.068277 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a858ff-e380-49cd-9bda-604c7af491ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:23.069137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a858ff-e380-49cd-9bda-604c7af491ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:23.069327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a858ff-e380-49cd-9bda-604c7af491ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:23.069593 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a858ff-e380-49cd-9bda-604c7af491ff admin admin] PATH_INFO: `/v3/projects/62a8fc961a1f4f7496185b60e714a8e1` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:23.070736 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a858ff-e380-49cd-9bda-604c7af491ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=62a8fc961a1f4f7496185b60e714a8e1)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:23.072671 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a858ff-e380-49cd-9bda-604c7af491ff admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:23.140958 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d9a858ff-e380-49cd-9bda-604c7af491ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62a8fc961a1f4f7496185b60e714a8e1', 'request_id': 'req-d9a858ff-e380-49cd-9bda-604c7af491ff'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:23.148919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d9a858ff-e380-49cd-9bda-604c7af491ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62a8fc961a1f4f7496185b60e714a8e1', 'request_id': 'req-d9a858ff-e380-49cd-9bda-604c7af491ff'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:23.163108 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d9a858ff-e380-49cd-9bda-604c7af491ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62a8fc961a1f4f7496185b60e714a8e1', 'request_id': 'req-d9a858ff-e380-49cd-9bda-604c7af491ff'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:23.177908 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d9a858ff-e380-49cd-9bda-604c7af491ff admin admin] The token cache is being invalidate because project 62a8fc961a1f4f7496185b60e714a8e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:23.178268 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d9a858ff-e380-49cd-9bda-604c7af491ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:23.178850 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d9a858ff-e380-49cd-9bda-604c7af491ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:23.183844 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1015/2029] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:22 2022] DELETE /identity/v3/projects/62a8fc961a1f4f7496185b60e714a8e1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:23.186529 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d0399-3b78-4a14-9000-45e46a195efa None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:23.186980 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d0399-3b78-4a14-9000-45e46a195efa None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:23.186980 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d0399-3b78-4a14-9000-45e46a195efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:23.212435 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-a49d0399-3b78-4a14-9000-45e46a195efa None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:23.215459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a49d0399-3b78-4a14-9000-45e46a195efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:23.289083 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1015/2030] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:23.298410 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aab4fe-c8de-4b06-8330-0a8b129ce273 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:23.298822 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aab4fe-c8de-4b06-8330-0a8b129ce273 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:23.299192 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aab4fe-c8de-4b06-8330-0a8b129ce273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:23.323418 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-33aab4fe-c8de-4b06-8330-0a8b129ce273 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:23.325580 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-33aab4fe-c8de-4b06-8330-0a8b129ce273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:23.340305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1016/2031] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:13:23.341605 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d0399-3b78-4a14-9000-45e46a195efa None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:23.352539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d0399-3b78-4a14-9000-45e46a195efa None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:23.359184 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e542d9d-84e9-4f67-b7c4-a9068bbf4171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:23.359805 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e542d9d-84e9-4f67-b7c4-a9068bbf4171 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:23.360271 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e542d9d-84e9-4f67-b7c4-a9068bbf4171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:23.360548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e542d9d-84e9-4f67-b7c4-a9068bbf4171 admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:23.361258 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e542d9d-84e9-4f67-b7c4-a9068bbf4171 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:13:23.361586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e542d9d-84e9-4f67-b7c4-a9068bbf4171 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:23.363300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e542d9d-84e9-4f67-b7c4-a9068bbf4171 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:23.381177 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1016/2032] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:13:23.385447 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aab4fe-c8de-4b06-8330-0a8b129ce273 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:23.403978 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aab4fe-c8de-4b06-8330-0a8b129ce273 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:23.421337 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e049470-e428-40f6-b11c-1e3c52d1299b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:23.422401 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e049470-e428-40f6-b11c-1e3c52d1299b admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:23.422994 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e049470-e428-40f6-b11c-1e3c52d1299b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:23.423527 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e049470-e428-40f6-b11c-1e3c52d1299b admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:23.425295 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e049470-e428-40f6-b11c-1e3c52d1299b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:23.429480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e049470-e428-40f6-b11c-1e3c52d1299b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:23.476988 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1017/2033] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:23 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:23.481553 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e542d9d-84e9-4f67-b7c4-a9068bbf4171 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:23.498422 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e542d9d-84e9-4f67-b7c4-a9068bbf4171 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:23.543758 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:23.578561 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6f26b-3b8b-48a4-863a-b6a6035783e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:23.579461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6f26b-3b8b-48a4-863a-b6a6035783e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:23.579959 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6f26b-3b8b-48a4-863a-b6a6035783e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:23.580410 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6f26b-3b8b-48a4-863a-b6a6035783e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:23.581248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6f26b-3b8b-48a4-863a-b6a6035783e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:23.583751 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6f26b-3b8b-48a4-863a-b6a6035783e4 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:23.615139 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1017/2034] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:23 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:13:23.618315 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e049470-e428-40f6-b11c-1e3c52d1299b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:23.638856 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e049470-e428-40f6-b11c-1e3c52d1299b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:23.645335 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a9060-d02e-4e36-896e-7bfa58998e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:23.645950 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a9060-d02e-4e36-896e-7bfa58998e5f admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:23.646229 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a9060-d02e-4e36-896e-7bfa58998e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:23.646502 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a9060-d02e-4e36-896e-7bfa58998e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:23.647153 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a9060-d02e-4e36-896e-7bfa58998e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:23.648762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a9060-d02e-4e36-896e-7bfa58998e5f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:23.664321 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6f26b-3b8b-48a4-863a-b6a6035783e4 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:23.670465 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1018/2035] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:23.675315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6f26b-3b8b-48a4-863a-b6a6035783e4 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:23.680271 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2191df7-2afa-49bb-80f3-ca29016141a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:23.680883 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2191df7-2afa-49bb-80f3-ca29016141a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:23.681193 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2191df7-2afa-49bb-80f3-ca29016141a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:23.681468 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2191df7-2afa-49bb-80f3-ca29016141a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:23.682120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2191df7-2afa-49bb-80f3-ca29016141a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:23.683825 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2191df7-2afa-49bb-80f3-ca29016141a8 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:23.697246 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1018/2036] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:23.701009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a9060-d02e-4e36-896e-7bfa58998e5f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:23.725361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a9060-d02e-4e36-896e-7bfa58998e5f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:23.732603 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c821838-5f1d-4f86-94bf-549c403f19a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:23.733639 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c821838-5f1d-4f86-94bf-549c403f19a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:23.734268 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c821838-5f1d-4f86-94bf-549c403f19a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:23.734832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c821838-5f1d-4f86-94bf-549c403f19a9 admin admin] PATH_INFO: `/v3/projects/2f86a49c51224e3b9a51844c2fde558b/users/ead17194c69147f1b5ceaaab680119de/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:23.744882 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2191df7-2afa-49bb-80f3-ca29016141a8 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:23.747741 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f2191df7-2afa-49bb-80f3-ca29016141a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:23.756931 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c821838-5f1d-4f86-94bf-549c403f19a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f86a49c51224e3b9a51844c2fde558b, user_id=ead17194c69147f1b5ceaaab680119de, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:23.760035 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c821838-5f1d-4f86-94bf-549c403f19a9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:23.771153 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2191df7-2afa-49bb-80f3-ca29016141a8 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:23.776577 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41753fa-37dc-4d0c-8b59-6a6e58274b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:23.782321 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41753fa-37dc-4d0c-8b59-6a6e58274b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:23.783131 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41753fa-37dc-4d0c-8b59-6a6e58274b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:23.783931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41753fa-37dc-4d0c-8b59-6a6e58274b0d admin admin] PATH_INFO: `/v3/users/c2a8ac88f5984bf299c6ac62ea99030f` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:23.785282 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1019/2037] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:23 2022] PUT /identity/v3/projects/2f86a49c51224e3b9a51844c2fde558b/users/ead17194c69147f1b5ceaaab680119de/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:23.795467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41753fa-37dc-4d0c-8b59-6a6e58274b0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2a8ac88f5984bf299c6ac62ea99030f)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:23.796829 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb6293-a120-4cd8-80fa-927cad73236f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:23.797140 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb6293-a120-4cd8-80fa-927cad73236f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:23.797486 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb6293-a120-4cd8-80fa-927cad73236f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:23.797699 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41753fa-37dc-4d0c-8b59-6a6e58274b0d admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:23.847757 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-15cb6293-a120-4cd8-80fa-927cad73236f None None] MFA Rules not processed for user `ead17194c69147f1b5ceaaab680119de`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:23.849464 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-15cb6293-a120-4cd8-80fa-927cad73236f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:23.888819 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a41753fa-37dc-4d0c-8b59-6a6e58274b0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2a8ac88f5984bf299c6ac62ea99030f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:23.915831 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a41753fa-37dc-4d0c-8b59-6a6e58274b0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2a8ac88f5984bf299c6ac62ea99030f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:23.934469 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a41753fa-37dc-4d0c-8b59-6a6e58274b0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2a8ac88f5984bf299c6ac62ea99030f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:23.935330 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a41753fa-37dc-4d0c-8b59-6a6e58274b0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2a8ac88f5984bf299c6ac62ea99030f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:23.945893 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a41753fa-37dc-4d0c-8b59-6a6e58274b0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2a8ac88f5984bf299c6ac62ea99030f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:23.958872 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1019/2038] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:13:23 2022] DELETE /identity/v3/users/c2a8ac88f5984bf299c6ac62ea99030f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:13:23.960363 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bacb1d-f502-4842-ab8c-0177ff49b45e None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:23.960652 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bacb1d-f502-4842-ab8c-0177ff49b45e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:23.960928 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bacb1d-f502-4842-ab8c-0177ff49b45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:23.977193 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:23.986320 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-f7bacb1d-f502-4842-ab8c-0177ff49b45e None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:23.987902 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f7bacb1d-f502-4842-ab8c-0177ff49b45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:24.011970 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1020/2039] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:24.016946 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb6293-a120-4cd8-80fa-927cad73236f None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:24.019806 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-15cb6293-a120-4cd8-80fa-927cad73236f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:24.108553 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1020/2040] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:24.132396 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bacb1d-f502-4842-ab8c-0177ff49b45e None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:24.133928 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f7bacb1d-f502-4842-ab8c-0177ff49b45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:24.170245 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:24.172003 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb6293-a120-4cd8-80fa-927cad73236f None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:24.180462 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97ded5-b83b-4a08-a3f0-48b16898f6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:24.182529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97ded5-b83b-4a08-a3f0-48b16898f6ff admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:24.183193 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97ded5-b83b-4a08-a3f0-48b16898f6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:24.183661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97ded5-b83b-4a08-a3f0-48b16898f6ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:24.184541 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a97ded5-b83b-4a08-a3f0-48b16898f6ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:24.187167 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a97ded5-b83b-4a08-a3f0-48b16898f6ff admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:24.215804 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bacb1d-f502-4842-ab8c-0177ff49b45e None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:24.221564 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3215e6c-afaf-4823-a353-3fb234156849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:24.222448 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3215e6c-afaf-4823-a353-3fb234156849 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:24.222625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3215e6c-afaf-4823-a353-3fb234156849 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:24.222894 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3215e6c-afaf-4823-a353-3fb234156849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:24.226840 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1021/2041] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:24 2022] POST /identity/v3/projects => generated 385 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:13:24.233930 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97ded5-b83b-4a08-a3f0-48b16898f6ff admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:24.235626 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3215e6c-afaf-4823-a353-3fb234156849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:24.243483 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3215e6c-afaf-4823-a353-3fb234156849 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:24.257703 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1021/2042] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 14:13:24.324270 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97ded5-b83b-4a08-a3f0-48b16898f6ff admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:24.330249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c0e1a-85c6-42d9-841b-e0a19e82df46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:24.331428 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c0e1a-85c6-42d9-841b-e0a19e82df46 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:24.331428 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c0e1a-85c6-42d9-841b-e0a19e82df46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:24.331639 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c0e1a-85c6-42d9-841b-e0a19e82df46 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:24.338947 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c0e1a-85c6-42d9-841b-e0a19e82df46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:24.341736 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c0e1a-85c6-42d9-841b-e0a19e82df46 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:24.368823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1022/2043] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:24 2022] POST /identity/v3/users => generated 299 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:24.374417 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3215e6c-afaf-4823-a353-3fb234156849 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:24.386873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3215e6c-afaf-4823-a353-3fb234156849 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:24.393736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c01d1-d942-4f55-a4a6-c885f0aac0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:24.394596 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c01d1-d942-4f55-a4a6-c885f0aac0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:24.395919 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c01d1-d942-4f55-a4a6-c885f0aac0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:24.396617 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c01d1-d942-4f55-a4a6-c885f0aac0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:24.398239 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c01d1-d942-4f55-a4a6-c885f0aac0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:24.401247 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c01d1-d942-4f55-a4a6-c885f0aac0d3 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:24.418742 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1022/2044] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:24.424723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c0e1a-85c6-42d9-841b-e0a19e82df46 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:24.442372 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c0e1a-85c6-42d9-841b-e0a19e82df46 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:24.448367 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2983dfd-e1f6-46cc-b7cf-22b2d26f1c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:24.449973 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2983dfd-e1f6-46cc-b7cf-22b2d26f1c1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:24.450890 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2983dfd-e1f6-46cc-b7cf-22b2d26f1c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:24.450890 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2983dfd-e1f6-46cc-b7cf-22b2d26f1c1b admin admin] PATH_INFO: `/v3/projects/9bfa089e215a4c498732d4e15dafd8bc/users/4dc74c8d34a34ae1b8ae12ab0c3ba960/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:24.472896 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2983dfd-e1f6-46cc-b7cf-22b2d26f1c1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bfa089e215a4c498732d4e15dafd8bc, user_id=4dc74c8d34a34ae1b8ae12ab0c3ba960, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:24.477329 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2983dfd-e1f6-46cc-b7cf-22b2d26f1c1b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:24.500378 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1023/2045] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:24 2022] PUT /identity/v3/projects/9bfa089e215a4c498732d4e15dafd8bc/users/4dc74c8d34a34ae1b8ae12ab0c3ba960/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:13:24.504305 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c01d1-d942-4f55-a4a6-c885f0aac0d3 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:24.515913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c01d1-d942-4f55-a4a6-c885f0aac0d3 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:24.577089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d361f-fc65-4b60-9cc0-7a46b4d4b1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:24.577734 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d361f-fc65-4b60-9cc0-7a46b4d4b1ac admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:24.578076 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d361f-fc65-4b60-9cc0-7a46b4d4b1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:24.578417 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d361f-fc65-4b60-9cc0-7a46b4d4b1ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:24.579135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d361f-fc65-4b60-9cc0-7a46b4d4b1ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:24.580876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d361f-fc65-4b60-9cc0-7a46b4d4b1ac admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:24.597373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1023/2046] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:24.601968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2983dfd-e1f6-46cc-b7cf-22b2d26f1c1b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:24.628928 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2983dfd-e1f6-46cc-b7cf-22b2d26f1c1b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:24.633844 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ffc42-28e8-4d42-bc9a-1b33849c7bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:24.634525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ffc42-28e8-4d42-bc9a-1b33849c7bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:24.634807 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ffc42-28e8-4d42-bc9a-1b33849c7bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:24.635076 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ffc42-28e8-4d42-bc9a-1b33849c7bfe admin admin] PATH_INFO: `/v3/projects/9bfa089e215a4c498732d4e15dafd8bc/users/4dc74c8d34a34ae1b8ae12ab0c3ba960/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:24.638453 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ffc42-28e8-4d42-bc9a-1b33849c7bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bfa089e215a4c498732d4e15dafd8bc, user_id=4dc74c8d34a34ae1b8ae12ab0c3ba960, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:24.641335 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ffc42-28e8-4d42-bc9a-1b33849c7bfe admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:24.664069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1024/2047] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:24 2022] PUT /identity/v3/projects/9bfa089e215a4c498732d4e15dafd8bc/users/4dc74c8d34a34ae1b8ae12ab0c3ba960/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:24.665287 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67533c2-c214-42c6-920a-251dcd64932e None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:24.665634 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67533c2-c214-42c6-920a-251dcd64932e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:24.665938 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67533c2-c214-42c6-920a-251dcd64932e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:24.697575 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-c67533c2-c214-42c6-920a-251dcd64932e None None] MFA Rules not processed for user `4dc74c8d34a34ae1b8ae12ab0c3ba960`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:24.699281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c67533c2-c214-42c6-920a-251dcd64932e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:24.804475 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1024/2048] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:13:24.816361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ffc42-28e8-4d42-bc9a-1b33849c7bfe admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:24.818969 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-442ffc42-28e8-4d42-bc9a-1b33849c7bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:24.854647 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:24.938192 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ffc42-28e8-4d42-bc9a-1b33849c7bfe admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:24.942568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca41c1-61a0-45ef-a077-8e7500f0bae3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:24.943649 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca41c1-61a0-45ef-a077-8e7500f0bae3 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:24.943974 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca41c1-61a0-45ef-a077-8e7500f0bae3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:24.944313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca41c1-61a0-45ef-a077-8e7500f0bae3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:24.958650 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca41c1-61a0-45ef-a077-8e7500f0bae3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:24.960264 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca41c1-61a0-45ef-a077-8e7500f0bae3 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:24.970908 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1025/2049] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:24 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:25.057667 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67533c2-c214-42c6-920a-251dcd64932e None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:25.101791 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:25.128722 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67533c2-c214-42c6-920a-251dcd64932e None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:25.133512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79dcd4-bf33-4965-add5-2e86f86ec41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:25.134262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79dcd4-bf33-4965-add5-2e86f86ec41e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:25.134543 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79dcd4-bf33-4965-add5-2e86f86ec41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:25.134819 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79dcd4-bf33-4965-add5-2e86f86ec41e admin admin] PATH_INFO: `/v3/users/ead17194c69147f1b5ceaaab680119de` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:25.135987 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79dcd4-bf33-4965-add5-2e86f86ec41e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ead17194c69147f1b5ceaaab680119de)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:25.138562 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79dcd4-bf33-4965-add5-2e86f86ec41e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:25.171827 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca41c1-61a0-45ef-a077-8e7500f0bae3 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:25.173465 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-92ca41c1-61a0-45ef-a077-8e7500f0bae3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:25.191852 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca41c1-61a0-45ef-a077-8e7500f0bae3 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:25.198694 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427e624-087f-4089-a1d1-a092191f09a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:25.200171 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427e624-087f-4089-a1d1-a092191f09a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:25.200632 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427e624-087f-4089-a1d1-a092191f09a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:25.201126 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427e624-087f-4089-a1d1-a092191f09a0 admin admin] PATH_INFO: `/v3/users/c5b050f9492440b0a5ba9861e10e34e5` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:25.201247 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6f79dcd4-bf33-4965-add5-2e86f86ec41e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ead17194c69147f1b5ceaaab680119de'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:25.202897 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1427e624-087f-4089-a1d1-a092191f09a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5b050f9492440b0a5ba9861e10e34e5)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:25.205423 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1427e624-087f-4089-a1d1-a092191f09a0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:25.211824 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6f79dcd4-bf33-4965-add5-2e86f86ec41e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ead17194c69147f1b5ceaaab680119de'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:25.231061 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6f79dcd4-bf33-4965-add5-2e86f86ec41e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ead17194c69147f1b5ceaaab680119de'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:25.232698 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6f79dcd4-bf33-4965-add5-2e86f86ec41e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ead17194c69147f1b5ceaaab680119de'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:25.244787 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6f79dcd4-bf33-4965-add5-2e86f86ec41e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ead17194c69147f1b5ceaaab680119de'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:25.258474 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1025/2050] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:13:25 2022] DELETE /identity/v3/users/ead17194c69147f1b5ceaaab680119de => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:25.263023 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468d1bb-640c-4ccf-aa92-6eb767fc4b6c None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:25.263699 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468d1bb-640c-4ccf-aa92-6eb767fc4b6c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:25.264533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468d1bb-640c-4ccf-aa92-6eb767fc4b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:25.288071 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-2468d1bb-640c-4ccf-aa92-6eb767fc4b6c None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:25.289411 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2468d1bb-640c-4ccf-aa92-6eb767fc4b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:25.291189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1427e624-087f-4089-a1d1-a092191f09a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5b050f9492440b0a5ba9861e10e34e5'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:25.307033 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1427e624-087f-4089-a1d1-a092191f09a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5b050f9492440b0a5ba9861e10e34e5'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:25.337685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1427e624-087f-4089-a1d1-a092191f09a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5b050f9492440b0a5ba9861e10e34e5'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:25.340058 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1427e624-087f-4089-a1d1-a092191f09a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5b050f9492440b0a5ba9861e10e34e5'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:25.349643 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1427e624-087f-4089-a1d1-a092191f09a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5b050f9492440b0a5ba9861e10e34e5'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:25.369172 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1026/2051] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:13:25 2022] DELETE /identity/v3/users/c5b050f9492440b0a5ba9861e10e34e5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:25.369172 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427e624-087f-4089-a1d1-a092191f09a0 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:25.372028 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1427e624-087f-4089-a1d1-a092191f09a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:25.416097 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1026/2052] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:13:25.418242 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41e203-7230-4cba-b501-0c5b50d84af6 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:25.418692 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41e203-7230-4cba-b501-0c5b50d84af6 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:25.419056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41e203-7230-4cba-b501-0c5b50d84af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:25.450790 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-9e41e203-7230-4cba-b501-0c5b50d84af6 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:25.452721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-9e41e203-7230-4cba-b501-0c5b50d84af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:25.491525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427e624-087f-4089-a1d1-a092191f09a0 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:25.510417 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71282177-8c34-4306-b61f-fbe7101f75bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:25.511194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71282177-8c34-4306-b61f-fbe7101f75bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:25.511388 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71282177-8c34-4306-b61f-fbe7101f75bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:25.511662 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71282177-8c34-4306-b61f-fbe7101f75bc admin admin] PATH_INFO: `/v3/projects/8faf72a40e1a4b03add45381e91b7120` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:25.512977 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71282177-8c34-4306-b61f-fbe7101f75bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8faf72a40e1a4b03add45381e91b7120)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:25.516292 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71282177-8c34-4306-b61f-fbe7101f75bc admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:25.547483 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:25.573361 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1027/2053] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:25.574568 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41e203-7230-4cba-b501-0c5b50d84af6 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:25.576135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-9e41e203-7230-4cba-b501-0c5b50d84af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:25.586671 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:25.594388 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-71282177-8c34-4306-b61f-fbe7101f75bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8faf72a40e1a4b03add45381e91b7120', 'request_id': 'req-71282177-8c34-4306-b61f-fbe7101f75bc'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:25.606982 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-71282177-8c34-4306-b61f-fbe7101f75bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8faf72a40e1a4b03add45381e91b7120', 'request_id': 'req-71282177-8c34-4306-b61f-fbe7101f75bc'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:25.629991 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-71282177-8c34-4306-b61f-fbe7101f75bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8faf72a40e1a4b03add45381e91b7120', 'request_id': 'req-71282177-8c34-4306-b61f-fbe7101f75bc'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:25.649633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-71282177-8c34-4306-b61f-fbe7101f75bc admin admin] The token cache is being invalidate because project 8faf72a40e1a4b03add45381e91b7120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:25.649913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-71282177-8c34-4306-b61f-fbe7101f75bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:25.651201 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-71282177-8c34-4306-b61f-fbe7101f75bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:25.652757 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1027/2054] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:25 2022] DELETE /identity/v3/projects/8faf72a40e1a4b03add45381e91b7120 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:25.653553 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71282177-8c34-4306-b61f-fbe7101f75bc admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:25.655265 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-71282177-8c34-4306-b61f-fbe7101f75bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:25.655569 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41e203-7230-4cba-b501-0c5b50d84af6 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:25.729056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15973a24-d47d-40a1-bc50-5c3da37b14d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:25.730228 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15973a24-d47d-40a1-bc50-5c3da37b14d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:25.730680 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15973a24-d47d-40a1-bc50-5c3da37b14d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:25.731563 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15973a24-d47d-40a1-bc50-5c3da37b14d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:25.734667 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-15973a24-d47d-40a1-bc50-5c3da37b14d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:25.769922 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71282177-8c34-4306-b61f-fbe7101f75bc admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:25.776025 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64fd05-b7a1-4a82-a270-e566acd74cca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:25.777363 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64fd05-b7a1-4a82-a270-e566acd74cca service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:25.777745 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64fd05-b7a1-4a82-a270-e566acd74cca service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:25.778199 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64fd05-b7a1-4a82-a270-e566acd74cca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:25.782311 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6b64fd05-b7a1-4a82-a270-e566acd74cca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:25.831449 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15973a24-d47d-40a1-bc50-5c3da37b14d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:25.833853 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15973a24-d47d-40a1-bc50-5c3da37b14d7 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:25.853183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1028/2055] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:25.855431 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5e120-f7df-4edf-b746-b863cf20e2e3 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:25.855915 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5e120-f7df-4edf-b746-b863cf20e2e3 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:25.856353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5e120-f7df-4edf-b746-b863cf20e2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:25.882843 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-4cc5e120-f7df-4edf-b746-b863cf20e2e3 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:25.884679 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4cc5e120-f7df-4edf-b746-b863cf20e2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:25.891712 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64fd05-b7a1-4a82-a270-e566acd74cca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:25.893241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64fd05-b7a1-4a82-a270-e566acd74cca service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:25.897335 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1029/2056] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:25.905871 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a806f55-2b2b-4a78-be13-21eaa7d20123 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:25.906372 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a806f55-2b2b-4a78-be13-21eaa7d20123 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:25.906938 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a806f55-2b2b-4a78-be13-21eaa7d20123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:25.924876 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1028/2057] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:25.938353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-7a806f55-2b2b-4a78-be13-21eaa7d20123 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:25.939865 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7a806f55-2b2b-4a78-be13-21eaa7d20123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:25.991828 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1030/2058] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:25.993272 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64fd05-b7a1-4a82-a270-e566acd74cca service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:26.006846 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64fd05-b7a1-4a82-a270-e566acd74cca service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:26.034119 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef059c8-1a0e-497e-b342-a305ee5a729e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:26.034367 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef059c8-1a0e-497e-b342-a305ee5a729e admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:26.034748 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef059c8-1a0e-497e-b342-a305ee5a729e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:26.035124 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef059c8-1a0e-497e-b342-a305ee5a729e admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:26.035995 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef059c8-1a0e-497e-b342-a305ee5a729e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:13:26.036465 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef059c8-1a0e-497e-b342-a305ee5a729e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:26.038687 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef059c8-1a0e-497e-b342-a305ee5a729e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:26.063873 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1029/2059] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:13:26.065586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a806f55-2b2b-4a78-be13-21eaa7d20123 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:26.085401 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a806f55-2b2b-4a78-be13-21eaa7d20123 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:26.102843 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad57f7-1507-4a71-87ec-7e3f41bc1423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:26.102843 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad57f7-1507-4a71-87ec-7e3f41bc1423 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:26.103695 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad57f7-1507-4a71-87ec-7e3f41bc1423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:26.106037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad57f7-1507-4a71-87ec-7e3f41bc1423 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:26.107832 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad57f7-1507-4a71-87ec-7e3f41bc1423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:26.113277 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad57f7-1507-4a71-87ec-7e3f41bc1423 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:26.156948 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1031/2060] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:26 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:26.160997 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef059c8-1a0e-497e-b342-a305ee5a729e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:26.174554 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef059c8-1a0e-497e-b342-a305ee5a729e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:26.287862 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53e94b-e60f-4d79-ad3c-aeb09af54dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:26.288494 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53e94b-e60f-4d79-ad3c-aeb09af54dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:26.288791 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53e94b-e60f-4d79-ad3c-aeb09af54dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:26.289057 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53e94b-e60f-4d79-ad3c-aeb09af54dd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:26.289775 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53e94b-e60f-4d79-ad3c-aeb09af54dd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:26.293279 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53e94b-e60f-4d79-ad3c-aeb09af54dd0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:26.325296 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:26.351218 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1030/2061] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:26 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:13:26.356070 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad57f7-1507-4a71-87ec-7e3f41bc1423 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:26.374318 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad57f7-1507-4a71-87ec-7e3f41bc1423 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:26.383377 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138317e-f172-4178-9435-030be49b17a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:26.384322 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138317e-f172-4178-9435-030be49b17a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:26.385324 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138317e-f172-4178-9435-030be49b17a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:26.387154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138317e-f172-4178-9435-030be49b17a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:26.388625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138317e-f172-4178-9435-030be49b17a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:26.390463 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138317e-f172-4178-9435-030be49b17a3 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:26.447990 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1032/2062] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:13:26.451948 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53e94b-e60f-4d79-ad3c-aeb09af54dd0 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:26.471160 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53e94b-e60f-4d79-ad3c-aeb09af54dd0 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:26.479067 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74d170-14c7-4898-b6fb-e103cba8b647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:26.480395 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74d170-14c7-4898-b6fb-e103cba8b647 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:26.481057 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74d170-14c7-4898-b6fb-e103cba8b647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:26.481618 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74d170-14c7-4898-b6fb-e103cba8b647 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:26.482822 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74d170-14c7-4898-b6fb-e103cba8b647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:26.486139 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74d170-14c7-4898-b6fb-e103cba8b647 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:26.531179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1031/2063] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:26.533807 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138317e-f172-4178-9435-030be49b17a3 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:26.548391 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138317e-f172-4178-9435-030be49b17a3 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:26.557391 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37485752-481a-4b15-9442-019507d51471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:26.558754 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37485752-481a-4b15-9442-019507d51471 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:26.558921 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37485752-481a-4b15-9442-019507d51471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:26.559189 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37485752-481a-4b15-9442-019507d51471 admin admin] PATH_INFO: `/v3/projects/81e4823c4e714e48beb8bd0ef3b8e50c/users/d686b12d07834e85ae767fb5defedbb0/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:26.579816 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37485752-481a-4b15-9442-019507d51471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81e4823c4e714e48beb8bd0ef3b8e50c, user_id=d686b12d07834e85ae767fb5defedbb0, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:26.582864 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37485752-481a-4b15-9442-019507d51471 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:26.586799 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:26.602494 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1033/2064] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:26 2022] PUT /identity/v3/projects/81e4823c4e714e48beb8bd0ef3b8e50c/users/d686b12d07834e85ae767fb5defedbb0/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:26.614872 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3b25e-fdd0-4bc4-b9a1-372e5b1df08a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:26.615158 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3b25e-fdd0-4bc4-b9a1-372e5b1df08a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:26.615432 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3b25e-fdd0-4bc4-b9a1-372e5b1df08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:26.660489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b4a3b25e-fdd0-4bc4-b9a1-372e5b1df08a None None] MFA Rules not processed for user `d686b12d07834e85ae767fb5defedbb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:26.662029 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b4a3b25e-fdd0-4bc4-b9a1-372e5b1df08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:26.789031 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1032/2065] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:26.789935 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37485752-481a-4b15-9442-019507d51471 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:26.790737 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3b25e-fdd0-4bc4-b9a1-372e5b1df08a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:26.792477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b4a3b25e-fdd0-4bc4-b9a1-372e5b1df08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:26.886941 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37485752-481a-4b15-9442-019507d51471 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:26.892279 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfcf5fe-015b-4ef9-83ec-026446ebfe1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:26.893639 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcf5fe-015b-4ef9-83ec-026446ebfe1a admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:26.893922 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcf5fe-015b-4ef9-83ec-026446ebfe1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:26.894190 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcf5fe-015b-4ef9-83ec-026446ebfe1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:26.894840 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfcf5fe-015b-4ef9-83ec-026446ebfe1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:26.897706 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfcf5fe-015b-4ef9-83ec-026446ebfe1a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:26.906589 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3b25e-fdd0-4bc4-b9a1-372e5b1df08a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:26.911513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356c84d-95eb-489c-bb78-14541f4b4cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:26.912286 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356c84d-95eb-489c-bb78-14541f4b4cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:26.912568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356c84d-95eb-489c-bb78-14541f4b4cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:26.912836 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356c84d-95eb-489c-bb78-14541f4b4cf9 admin admin] PATH_INFO: `/v3/projects/2f86a49c51224e3b9a51844c2fde558b` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:26.914121 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356c84d-95eb-489c-bb78-14541f4b4cf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f86a49c51224e3b9a51844c2fde558b)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:26.916469 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356c84d-95eb-489c-bb78-14541f4b4cf9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:26.930578 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1034/2066] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:26 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:26.934001 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfcf5fe-015b-4ef9-83ec-026446ebfe1a admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:26.938144 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8dfcf5fe-015b-4ef9-83ec-026446ebfe1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:26.994188 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8356c84d-95eb-489c-bb78-14541f4b4cf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f86a49c51224e3b9a51844c2fde558b', 'request_id': 'req-8356c84d-95eb-489c-bb78-14541f4b4cf9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:27.002296 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8356c84d-95eb-489c-bb78-14541f4b4cf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f86a49c51224e3b9a51844c2fde558b', 'request_id': 'req-8356c84d-95eb-489c-bb78-14541f4b4cf9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:27.013318 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8356c84d-95eb-489c-bb78-14541f4b4cf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f86a49c51224e3b9a51844c2fde558b', 'request_id': 'req-8356c84d-95eb-489c-bb78-14541f4b4cf9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:27.020440 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfcf5fe-015b-4ef9-83ec-026446ebfe1a admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:27.025984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8356c84d-95eb-489c-bb78-14541f4b4cf9 admin admin] The token cache is being invalidate because project 2f86a49c51224e3b9a51844c2fde558b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:27.026284 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8356c84d-95eb-489c-bb78-14541f4b4cf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:27.028296 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8356c84d-95eb-489c-bb78-14541f4b4cf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:27.030473 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1033/2067] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:26 2022] DELETE /identity/v3/projects/2f86a49c51224e3b9a51844c2fde558b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:27.030940 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356c84d-95eb-489c-bb78-14541f4b4cf9 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:27.034032 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8356c84d-95eb-489c-bb78-14541f4b4cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:27.048472 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:27.094385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50fb802-326a-4e1a-b0f1-8046dd846cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:27.095216 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fb802-326a-4e1a-b0f1-8046dd846cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:27.095563 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fb802-326a-4e1a-b0f1-8046dd846cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:27.095907 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fb802-326a-4e1a-b0f1-8046dd846cf0 admin admin] PATH_INFO: `/v3/projects/11bb85917d5e473ca2cfa78754a45909` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:27.110259 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50fb802-326a-4e1a-b0f1-8046dd846cf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11bb85917d5e473ca2cfa78754a45909)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:27.112530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50fb802-326a-4e1a-b0f1-8046dd846cf0 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:27.125247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356c84d-95eb-489c-bb78-14541f4b4cf9 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:27.130162 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa010dc-4853-49be-8764-7177f91e784d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:27.130783 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa010dc-4853-49be-8764-7177f91e784d admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:27.131235 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa010dc-4853-49be-8764-7177f91e784d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:27.131342 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa010dc-4853-49be-8764-7177f91e784d admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:27.132006 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa010dc-4853-49be-8764-7177f91e784d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:27.134125 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa010dc-4853-49be-8764-7177f91e784d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:27.149926 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:INSERT=2,keystone:SELECT=96,keystone:DELETE=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:27.162406 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1034/2068] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:27 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:27.162406 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa010dc-4853-49be-8764-7177f91e784d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:27.164252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0fa010dc-4853-49be-8764-7177f91e784d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:27.172969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d50fb802-326a-4e1a-b0f1-8046dd846cf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11bb85917d5e473ca2cfa78754a45909', 'request_id': 'req-d50fb802-326a-4e1a-b0f1-8046dd846cf0'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:27.176985 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa010dc-4853-49be-8764-7177f91e784d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:27.181424 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d50fb802-326a-4e1a-b0f1-8046dd846cf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11bb85917d5e473ca2cfa78754a45909', 'request_id': 'req-d50fb802-326a-4e1a-b0f1-8046dd846cf0'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:27.188371 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d50fb802-326a-4e1a-b0f1-8046dd846cf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11bb85917d5e473ca2cfa78754a45909', 'request_id': 'req-d50fb802-326a-4e1a-b0f1-8046dd846cf0'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:27.200744 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d50fb802-326a-4e1a-b0f1-8046dd846cf0 admin admin] The token cache is being invalidate because project 11bb85917d5e473ca2cfa78754a45909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:27.201063 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d50fb802-326a-4e1a-b0f1-8046dd846cf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:27.201800 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d50fb802-326a-4e1a-b0f1-8046dd846cf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:27.203452 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1035/2069] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:26 2022] DELETE /identity/v3/projects/11bb85917d5e473ca2cfa78754a45909 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:13:27.206970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50fb802-326a-4e1a-b0f1-8046dd846cf0 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:27.206970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d50fb802-326a-4e1a-b0f1-8046dd846cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:27.264433 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad04e50-5fe3-46c4-8c05-3d4948018bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:27.265251 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad04e50-5fe3-46c4-8c05-3d4948018bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:27.265602 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad04e50-5fe3-46c4-8c05-3d4948018bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:27.265946 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad04e50-5fe3-46c4-8c05-3d4948018bae admin admin] PATH_INFO: `/v3/users/4dc74c8d34a34ae1b8ae12ab0c3ba960` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:27.267502 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad04e50-5fe3-46c4-8c05-3d4948018bae admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dc74c8d34a34ae1b8ae12ab0c3ba960)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:27.269614 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad04e50-5fe3-46c4-8c05-3d4948018bae admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:27.316421 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50fb802-326a-4e1a-b0f1-8046dd846cf0 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:27.322938 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07b461-2b6e-4faf-b79b-ebd50b7c8d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:27.323734 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07b461-2b6e-4faf-b79b-ebd50b7c8d39 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:27.324174 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07b461-2b6e-4faf-b79b-ebd50b7c8d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:27.324457 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07b461-2b6e-4faf-b79b-ebd50b7c8d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:27.325154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07b461-2b6e-4faf-b79b-ebd50b7c8d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:27.326793 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07b461-2b6e-4faf-b79b-ebd50b7c8d39 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:27.335859 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-dad04e50-5fe3-46c4-8c05-3d4948018bae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dc74c8d34a34ae1b8ae12ab0c3ba960'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:27.342572 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1036/2070] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:27.342572 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ab11d-b5c1-4d35-8c4f-552e05cc8b02 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:27.342572 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ab11d-b5c1-4d35-8c4f-552e05cc8b02 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:27.342572 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ab11d-b5c1-4d35-8c4f-552e05cc8b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:27.356311 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-dad04e50-5fe3-46c4-8c05-3d4948018bae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dc74c8d34a34ae1b8ae12ab0c3ba960'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:27.382686 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-dad04e50-5fe3-46c4-8c05-3d4948018bae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dc74c8d34a34ae1b8ae12ab0c3ba960'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:27.383621 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-dad04e50-5fe3-46c4-8c05-3d4948018bae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dc74c8d34a34ae1b8ae12ab0c3ba960'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:27.393081 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-dad04e50-5fe3-46c4-8c05-3d4948018bae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dc74c8d34a34ae1b8ae12ab0c3ba960'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:27.401291 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-912ab11d-b5c1-4d35-8c4f-552e05cc8b02 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:27.403417 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-912ab11d-b5c1-4d35-8c4f-552e05cc8b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:27.410282 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1035/2071] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:13:27 2022] DELETE /identity/v3/users/4dc74c8d34a34ae1b8ae12ab0c3ba960 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:27.411283 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad04e50-5fe3-46c4-8c05-3d4948018bae admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:27.428887 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-dad04e50-5fe3-46c4-8c05-3d4948018bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:27.476934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:27.541193 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1037/2072] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:27.551439 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ca3a0-16dd-4f1a-9aff-ad63d1bd23fc None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:27.551846 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ca3a0-16dd-4f1a-9aff-ad63d1bd23fc None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:27.552228 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ca3a0-16dd-4f1a-9aff-ad63d1bd23fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:27.578065 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad04e50-5fe3-46c4-8c05-3d4948018bae admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:27.578277 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-fe9ca3a0-16dd-4f1a-9aff-ad63d1bd23fc None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:27.579752 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-fe9ca3a0-16dd-4f1a-9aff-ad63d1bd23fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:27.584961 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a3b0c-5c00-4b1b-829b-aa23907fbe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:27.585627 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a3b0c-5c00-4b1b-829b-aa23907fbe41 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:27.585976 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a3b0c-5c00-4b1b-829b-aa23907fbe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:27.586250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a3b0c-5c00-4b1b-829b-aa23907fbe41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:27.587045 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a3b0c-5c00-4b1b-829b-aa23907fbe41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:27.588673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a3b0c-5c00-4b1b-829b-aa23907fbe41 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:27.590764 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1038/2073] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:13:27.595762 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ca3a0-16dd-4f1a-9aff-ad63d1bd23fc None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:27.604244 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1036/2074] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:27.609932 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ca3a0-16dd-4f1a-9aff-ad63d1bd23fc None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:27.610230 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a3b0c-5c00-4b1b-829b-aa23907fbe41 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:27.624763 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a3b0c-5c00-4b1b-829b-aa23907fbe41 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:27.630786 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1708c51-dc14-4aa7-8bce-45de4bb2de81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:27.630997 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4406f-524c-4d5e-84a7-9b9bc36de4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:27.631751 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4406f-524c-4d5e-84a7-9b9bc36de4c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:27.631882 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1708c51-dc14-4aa7-8bce-45de4bb2de81 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:27.632232 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4406f-524c-4d5e-84a7-9b9bc36de4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:27.632432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1708c51-dc14-4aa7-8bce-45de4bb2de81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:27.632696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4406f-524c-4d5e-84a7-9b9bc36de4c4 admin admin] PATH_INFO: `/v3/projects/e3d155c2128c43e98d07caf2ae6a8830/users/adc42a3a7eef447e994b8fa359558ea1/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:27.632989 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1708c51-dc14-4aa7-8bce-45de4bb2de81 admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:27.633886 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1708c51-dc14-4aa7-8bce-45de4bb2de81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:13:27.634374 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1708c51-dc14-4aa7-8bce-45de4bb2de81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:27.636389 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1708c51-dc14-4aa7-8bce-45de4bb2de81 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:27.652513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4406f-524c-4d5e-84a7-9b9bc36de4c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3d155c2128c43e98d07caf2ae6a8830, user_id=adc42a3a7eef447e994b8fa359558ea1, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:27.653850 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1039/2075] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:13:27.658757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1708c51-dc14-4aa7-8bce-45de4bb2de81 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:27.660161 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4406f-524c-4d5e-84a7-9b9bc36de4c4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:27.672706 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1708c51-dc14-4aa7-8bce-45de4bb2de81 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:27.679911 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1037/2076] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:27 2022] PUT /identity/v3/projects/e3d155c2128c43e98d07caf2ae6a8830/users/adc42a3a7eef447e994b8fa359558ea1/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:27.689916 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88019c8-8b1a-4b45-a20f-83a4bbf2c21f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:27.690171 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88019c8-8b1a-4b45-a20f-83a4bbf2c21f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:27.690449 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88019c8-8b1a-4b45-a20f-83a4bbf2c21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:27.723126 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:27.753782 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a88019c8-8b1a-4b45-a20f-83a4bbf2c21f None None] MFA Rules not processed for user `adc42a3a7eef447e994b8fa359558ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:27.756431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a88019c8-8b1a-4b45-a20f-83a4bbf2c21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:27.764066 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c15a3-1012-41ce-aa3d-131e67530104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:27.764979 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c15a3-1012-41ce-aa3d-131e67530104 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:27.765816 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c15a3-1012-41ce-aa3d-131e67530104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:27.766098 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c15a3-1012-41ce-aa3d-131e67530104 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:27.766747 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c15a3-1012-41ce-aa3d-131e67530104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:27.768919 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c15a3-1012-41ce-aa3d-131e67530104 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:27.826062 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1040/2077] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:27 2022] POST /identity/v3/projects => generated 371 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:13:27.829943 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c15a3-1012-41ce-aa3d-131e67530104 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:27.873392 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1038/2078] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:27.873993 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88019c8-8b1a-4b45-a20f-83a4bbf2c21f None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:27.927854 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c15a3-1012-41ce-aa3d-131e67530104 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:27.932133 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88019c8-8b1a-4b45-a20f-83a4bbf2c21f None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:27.935065 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad85678-f150-4b44-b611-ef94cb78c664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:27.935382 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad85678-f150-4b44-b611-ef94cb78c664 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:27.935817 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad85678-f150-4b44-b611-ef94cb78c664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:27.936230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad85678-f150-4b44-b611-ef94cb78c664 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:27.937210 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad85678-f150-4b44-b611-ef94cb78c664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:27.941119 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad85678-f150-4b44-b611-ef94cb78c664 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:27.960609 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cfb8b-5ff8-4085-88df-16b282ea7b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:27.961277 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cfb8b-5ff8-4085-88df-16b282ea7b66 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:27.961701 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cfb8b-5ff8-4085-88df-16b282ea7b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:27.962103 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cfb8b-5ff8-4085-88df-16b282ea7b66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:27.962754 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9cfb8b-5ff8-4085-88df-16b282ea7b66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:27.967069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9cfb8b-5ff8-4085-88df-16b282ea7b66 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:27.987603 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1041/2079] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:27 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:27.992025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad85678-f150-4b44-b611-ef94cb78c664 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:28.009578 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1039/2080] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:27 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:28.010599 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cfb8b-5ff8-4085-88df-16b282ea7b66 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:28.018033 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad85678-f150-4b44-b611-ef94cb78c664 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:28.124870 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:28.141730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cfb8b-5ff8-4085-88df-16b282ea7b66 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:28.158734 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9edf63-3d98-4ddc-a5c2-5e0f98f060be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:28.158985 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc6a47-69e4-4731-9289-b24e59e2d085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:28.159099 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9edf63-3d98-4ddc-a5c2-5e0f98f060be admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:28.159178 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc6a47-69e4-4731-9289-b24e59e2d085 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:28.159248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9edf63-3d98-4ddc-a5c2-5e0f98f060be admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:28.159534 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc6a47-69e4-4731-9289-b24e59e2d085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:28.159633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9edf63-3d98-4ddc-a5c2-5e0f98f060be admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:28.159704 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc6a47-69e4-4731-9289-b24e59e2d085 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:28.160052 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9edf63-3d98-4ddc-a5c2-5e0f98f060be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:28.160261 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc6a47-69e4-4731-9289-b24e59e2d085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:28.162203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9edf63-3d98-4ddc-a5c2-5e0f98f060be admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:28.168707 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc6a47-69e4-4731-9289-b24e59e2d085 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:28.194391 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1042/2081] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:28.199396 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc6a47-69e4-4731-9289-b24e59e2d085 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:28.222725 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1040/2082] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:28 2022] POST /identity/v3/users => generated 298 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:13:28.231755 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9edf63-3d98-4ddc-a5c2-5e0f98f060be admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:28.238581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc6a47-69e4-4731-9289-b24e59e2d085 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:28.246601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73de2c1-6081-4aa3-bbef-c84f38fe4b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:28.247462 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73de2c1-6081-4aa3-bbef-c84f38fe4b11 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:28.247872 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73de2c1-6081-4aa3-bbef-c84f38fe4b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:28.248247 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73de2c1-6081-4aa3-bbef-c84f38fe4b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:28.249016 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73de2c1-6081-4aa3-bbef-c84f38fe4b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:28.251363 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73de2c1-6081-4aa3-bbef-c84f38fe4b11 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:28.265141 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9edf63-3d98-4ddc-a5c2-5e0f98f060be admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:28.277901 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1043/2083] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:28.284390 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73de2c1-6081-4aa3-bbef-c84f38fe4b11 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:28.285897 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb34d2e-3f0e-4467-bad8-e837511c5d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:28.286503 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb34d2e-3f0e-4467-bad8-e837511c5d81 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:28.286779 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb34d2e-3f0e-4467-bad8-e837511c5d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:28.287043 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb34d2e-3f0e-4467-bad8-e837511c5d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:28.288012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb34d2e-3f0e-4467-bad8-e837511c5d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:28.289547 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb34d2e-3f0e-4467-bad8-e837511c5d81 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:28.311085 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73de2c1-6081-4aa3-bbef-c84f38fe4b11 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:28.319765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1041/2084] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:28.320785 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb34d2e-3f0e-4467-bad8-e837511c5d81 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:28.323276 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe67637-832f-4eb7-b398-e12ba4ba4e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:28.325584 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe67637-832f-4eb7-b398-e12ba4ba4e14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:28.326526 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe67637-832f-4eb7-b398-e12ba4ba4e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:28.327291 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe67637-832f-4eb7-b398-e12ba4ba4e14 admin admin] PATH_INFO: `/v3/projects/1fa6bebf8fc74d40b04d6da16d063f30/users/ec99ae20ce624a0087b10deb18ca3b9e/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:28.344824 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb34d2e-3f0e-4467-bad8-e837511c5d81 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:28.358461 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c38900-58a9-4b47-aafd-be40148cc8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:28.359140 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c38900-58a9-4b47-aafd-be40148cc8c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:28.359889 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c38900-58a9-4b47-aafd-be40148cc8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:28.359889 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c38900-58a9-4b47-aafd-be40148cc8c2 admin admin] PATH_INFO: `/v3/projects/997af73a801c4c0e9e4f76977ab40b1f/users/fa66cb4f0c71468d841bb62ae268af51/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:28.369855 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe67637-832f-4eb7-b398-e12ba4ba4e14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa6bebf8fc74d40b04d6da16d063f30, user_id=ec99ae20ce624a0087b10deb18ca3b9e, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:28.381710 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe67637-832f-4eb7-b398-e12ba4ba4e14 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:28.392436 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c38900-58a9-4b47-aafd-be40148cc8c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=997af73a801c4c0e9e4f76977ab40b1f, user_id=fa66cb4f0c71468d841bb62ae268af51, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:28.397615 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c38900-58a9-4b47-aafd-be40148cc8c2 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:28.406340 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1044/2085] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:28 2022] PUT /identity/v3/projects/1fa6bebf8fc74d40b04d6da16d063f30/users/ec99ae20ce624a0087b10deb18ca3b9e/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:28.416595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4d36a-a132-490c-8260-6ad53fe58b75 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:28.417009 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4d36a-a132-490c-8260-6ad53fe58b75 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:28.418010 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4d36a-a132-490c-8260-6ad53fe58b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:28.439592 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1042/2086] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:28 2022] PUT /identity/v3/projects/997af73a801c4c0e9e4f76977ab40b1f/users/fa66cb4f0c71468d841bb62ae268af51/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:28.440359 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c38900-58a9-4b47-aafd-be40148cc8c2 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:28.459885 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:28.475150 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e6a4d36a-a132-490c-8260-6ad53fe58b75 None None] MFA Rules not processed for user `ec99ae20ce624a0087b10deb18ca3b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:28.476865 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e6a4d36a-a132-490c-8260-6ad53fe58b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:28.564093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c38900-58a9-4b47-aafd-be40148cc8c2 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:28.571319 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541f440-72e1-4291-8c0e-b99988ad23db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:28.572618 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541f440-72e1-4291-8c0e-b99988ad23db admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:28.573437 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541f440-72e1-4291-8c0e-b99988ad23db admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:28.574409 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541f440-72e1-4291-8c0e-b99988ad23db admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:28.576950 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541f440-72e1-4291-8c0e-b99988ad23db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:28.579529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541f440-72e1-4291-8c0e-b99988ad23db admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:28.622598 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1043/2087] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:13:28.626103 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541f440-72e1-4291-8c0e-b99988ad23db admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:28.647544 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1045/2088] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:13:28.656031 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541f440-72e1-4291-8c0e-b99988ad23db admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:28.664704 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800360c-1577-42be-8547-2b9166323db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:28.665744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800360c-1577-42be-8547-2b9166323db1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:28.666153 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800360c-1577-42be-8547-2b9166323db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:28.666617 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800360c-1577-42be-8547-2b9166323db1 admin admin] PATH_INFO: `/v3/projects/997af73a801c4c0e9e4f76977ab40b1f/users/fa66cb4f0c71468d841bb62ae268af51/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:28.667471 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4d36a-a132-490c-8260-6ad53fe58b75 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:28.670055 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800360c-1577-42be-8547-2b9166323db1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=997af73a801c4c0e9e4f76977ab40b1f, user_id=fa66cb4f0c71468d841bb62ae268af51, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:28.671185 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e6a4d36a-a132-490c-8260-6ad53fe58b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:28.674566 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800360c-1577-42be-8547-2b9166323db1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:28.710525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1044/2089] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:28 2022] PUT /identity/v3/projects/997af73a801c4c0e9e4f76977ab40b1f/users/fa66cb4f0c71468d841bb62ae268af51/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:13:28.710525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800360c-1577-42be-8547-2b9166323db1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:28.711089 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7800360c-1577-42be-8547-2b9166323db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:28.787674 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4d36a-a132-490c-8260-6ad53fe58b75 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:28.794770 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800360c-1577-42be-8547-2b9166323db1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:28.800407 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc111d-6a6f-4d36-8f35-4b77f512fae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:28.801051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc111d-6a6f-4d36-8f35-4b77f512fae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:28.801377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc111d-6a6f-4d36-8f35-4b77f512fae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:28.801680 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc111d-6a6f-4d36-8f35-4b77f512fae3 admin admin] PATH_INFO: `/v3/projects/9bfa089e215a4c498732d4e15dafd8bc` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:28.802801 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc111d-6a6f-4d36-8f35-4b77f512fae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bfa089e215a4c498732d4e15dafd8bc)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:28.805198 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc111d-6a6f-4d36-8f35-4b77f512fae3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:28.863296 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:28.874470 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277e0e5-9aab-4d7b-86e2-b890b06795b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:28.875095 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277e0e5-9aab-4d7b-86e2-b890b06795b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:28.875375 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277e0e5-9aab-4d7b-86e2-b890b06795b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:28.875640 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277e0e5-9aab-4d7b-86e2-b890b06795b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:28.884385 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-08fc111d-6a6f-4d36-8f35-4b77f512fae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bfa089e215a4c498732d4e15dafd8bc', 'request_id': 'req-08fc111d-6a6f-4d36-8f35-4b77f512fae3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:28.891698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-08fc111d-6a6f-4d36-8f35-4b77f512fae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bfa089e215a4c498732d4e15dafd8bc', 'request_id': 'req-08fc111d-6a6f-4d36-8f35-4b77f512fae3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:28.900384 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-08fc111d-6a6f-4d36-8f35-4b77f512fae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bfa089e215a4c498732d4e15dafd8bc', 'request_id': 'req-08fc111d-6a6f-4d36-8f35-4b77f512fae3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:28.912651 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-08fc111d-6a6f-4d36-8f35-4b77f512fae3 admin admin] The token cache is being invalidate because project 9bfa089e215a4c498732d4e15dafd8bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:28.913060 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-08fc111d-6a6f-4d36-8f35-4b77f512fae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:28.913845 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-08fc111d-6a6f-4d36-8f35-4b77f512fae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:28.915729 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1045/2090] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:28 2022] DELETE /identity/v3/projects/9bfa089e215a4c498732d4e15dafd8bc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:28.917206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc4ff9-08c9-4bf6-9041-9f39933c6f8d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:28.918115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc4ff9-08c9-4bf6-9041-9f39933c6f8d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:28.919989 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc4ff9-08c9-4bf6-9041-9f39933c6f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:28.949128 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b8cc4ff9-08c9-4bf6-9041-9f39933c6f8d None None] MFA Rules not processed for user `fa66cb4f0c71468d841bb62ae268af51`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:28.950396 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b8cc4ff9-08c9-4bf6-9041-9f39933c6f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:28.955652 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277e0e5-9aab-4d7b-86e2-b890b06795b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:28.957236 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277e0e5-9aab-4d7b-86e2-b890b06795b4 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:28.967367 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1046/2091] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:28.968739 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d7605-9c6b-480b-8b54-9dc5ed430f95 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:28.969026 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d7605-9c6b-480b-8b54-9dc5ed430f95 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:28.969444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d7605-9c6b-480b-8b54-9dc5ed430f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:28.992864 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-8e8d7605-9c6b-480b-8b54-9dc5ed430f95 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:28.994745 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8e8d7605-9c6b-480b-8b54-9dc5ed430f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:28.999291 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:29.025659 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1046/2092] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:29.026510 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc4ff9-08c9-4bf6-9041-9f39933c6f8d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:29.028989 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b8cc4ff9-08c9-4bf6-9041-9f39933c6f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:29.058900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1047/2093] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:29.059991 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d7605-9c6b-480b-8b54-9dc5ed430f95 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:29.061768 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8e8d7605-9c6b-480b-8b54-9dc5ed430f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:29.095312 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc4ff9-08c9-4bf6-9041-9f39933c6f8d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:29.100340 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4958bd-796f-4b63-8b08-1a9068b5facf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:29.100963 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4958bd-796f-4b63-8b08-1a9068b5facf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:29.101267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4958bd-796f-4b63-8b08-1a9068b5facf admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:29.101537 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4958bd-796f-4b63-8b08-1a9068b5facf admin admin] PATH_INFO: `/v3/users/ec99ae20ce624a0087b10deb18ca3b9e` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:29.102664 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4958bd-796f-4b63-8b08-1a9068b5facf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec99ae20ce624a0087b10deb18ca3b9e)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:29.104623 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4958bd-796f-4b63-8b08-1a9068b5facf admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:29.121797 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d7605-9c6b-480b-8b54-9dc5ed430f95 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:29.125514 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0a8ac-05e9-451f-87a1-18430afc08df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:29.126116 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0a8ac-05e9-451f-87a1-18430afc08df service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:29.126396 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0a8ac-05e9-451f-87a1-18430afc08df service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:29.126668 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0a8ac-05e9-451f-87a1-18430afc08df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:29.128443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-58f0a8ac-05e9-451f-87a1-18430afc08df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:29.155062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7e4958bd-796f-4b63-8b08-1a9068b5facf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec99ae20ce624a0087b10deb18ca3b9e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:29.157659 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:29.163454 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7e4958bd-796f-4b63-8b08-1a9068b5facf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec99ae20ce624a0087b10deb18ca3b9e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:29.178421 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7e4958bd-796f-4b63-8b08-1a9068b5facf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec99ae20ce624a0087b10deb18ca3b9e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:29.179387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7e4958bd-796f-4b63-8b08-1a9068b5facf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec99ae20ce624a0087b10deb18ca3b9e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:29.188134 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7e4958bd-796f-4b63-8b08-1a9068b5facf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec99ae20ce624a0087b10deb18ca3b9e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:29.192892 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f0a8ac-05e9-451f-87a1-18430afc08df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:29.194127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1047/2094] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:13:29 2022] DELETE /identity/v3/users/ec99ae20ce624a0087b10deb18ca3b9e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:29.194351 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f0a8ac-05e9-451f-87a1-18430afc08df service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:29.195344 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b3c86-d745-444f-a2e6-a8f9aba4d3bc None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:29.195652 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b3c86-d745-444f-a2e6-a8f9aba4d3bc None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:29.195925 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b3c86-d745-444f-a2e6-a8f9aba4d3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:29.211068 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1048/2095] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:29.212338 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b83bd-5bde-49f6-88d8-75a725fb1341 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:29.212712 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b83bd-5bde-49f6-88d8-75a725fb1341 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:29.212981 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b83bd-5bde-49f6-88d8-75a725fb1341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:29.224266 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-0b6b3c86-d745-444f-a2e6-a8f9aba4d3bc None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:29.225685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0b6b3c86-d745-444f-a2e6-a8f9aba4d3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:29.235110 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-9a4b83bd-5bde-49f6-88d8-75a725fb1341 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:29.236968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-9a4b83bd-5bde-49f6-88d8-75a725fb1341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:29.297397 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1048/2096] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:29.302284 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b3c86-d745-444f-a2e6-a8f9aba4d3bc None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:29.311411 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b3c86-d745-444f-a2e6-a8f9aba4d3bc None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:29.318565 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1049/2097] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:29.319176 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441493fb-6714-42e2-b0fe-80373cf77e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:29.319782 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441493fb-6714-42e2-b0fe-80373cf77e94 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:29.320059 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441493fb-6714-42e2-b0fe-80373cf77e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:29.320427 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441493fb-6714-42e2-b0fe-80373cf77e94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:29.321193 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441493fb-6714-42e2-b0fe-80373cf77e94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:13:29.321500 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441493fb-6714-42e2-b0fe-80373cf77e94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:29.323138 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441493fb-6714-42e2-b0fe-80373cf77e94 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:29.328336 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b83bd-5bde-49f6-88d8-75a725fb1341 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:29.330013 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-9a4b83bd-5bde-49f6-88d8-75a725fb1341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:29.341182 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1049/2098] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:13:29.341907 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:29.342202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441493fb-6714-42e2-b0fe-80373cf77e94 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:29.354320 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441493fb-6714-42e2-b0fe-80373cf77e94 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:29.361353 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53446b18-5d7d-40bc-9309-05e7ae7772a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:29.362156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53446b18-5d7d-40bc-9309-05e7ae7772a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:29.362335 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53446b18-5d7d-40bc-9309-05e7ae7772a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:29.362606 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53446b18-5d7d-40bc-9309-05e7ae7772a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:29.363413 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53446b18-5d7d-40bc-9309-05e7ae7772a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:29.365609 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53446b18-5d7d-40bc-9309-05e7ae7772a1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:29.398349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1050/2099] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:29 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:13:29.403864 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53446b18-5d7d-40bc-9309-05e7ae7772a1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:29.406648 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b83bd-5bde-49f6-88d8-75a725fb1341 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:29.462745 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f8c58-c9fb-4611-aa9c-5a6551faeeb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:29.463352 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f8c58-c9fb-4611-aa9c-5a6551faeeb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:29.463782 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f8c58-c9fb-4611-aa9c-5a6551faeeb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:29.464144 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f8c58-c9fb-4611-aa9c-5a6551faeeb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:29.474341 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53446b18-5d7d-40bc-9309-05e7ae7772a1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:29.479166 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc4d29-7e8f-4330-b4cb-dc184768e49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:29.479810 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc4d29-7e8f-4330-b4cb-dc184768e49c admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:29.480087 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc4d29-7e8f-4330-b4cb-dc184768e49c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:29.480356 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc4d29-7e8f-4330-b4cb-dc184768e49c admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:29.480990 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc4d29-7e8f-4330-b4cb-dc184768e49c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:29.483073 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc4d29-7e8f-4330-b4cb-dc184768e49c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:29.487167 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f8c58-c9fb-4611-aa9c-5a6551faeeb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:29.488684 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f8c58-c9fb-4611-aa9c-5a6551faeeb1 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:29.511636 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1051/2100] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:29 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:13:29.514565 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1050/2101] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 14:13:29.517202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc4d29-7e8f-4330-b4cb-dc184768e49c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:29.535434 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc4d29-7e8f-4330-b4cb-dc184768e49c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:29.546760 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e7f91-38dd-4ba8-b313-034c9503e238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:29.547030 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e7f91-38dd-4ba8-b313-034c9503e238 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:29.547270 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e7f91-38dd-4ba8-b313-034c9503e238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:29.547540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e7f91-38dd-4ba8-b313-034c9503e238 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:29.548195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e7f91-38dd-4ba8-b313-034c9503e238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:29.550263 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e7f91-38dd-4ba8-b313-034c9503e238 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:29.578861 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1052/2102] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:29.584695 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f8c58-c9fb-4611-aa9c-5a6551faeeb1 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:29.597238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f8c58-c9fb-4611-aa9c-5a6551faeeb1 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:29.602571 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2926f-bf3d-490a-9478-3311c331e998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:29.603197 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2926f-bf3d-490a-9478-3311c331e998 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:29.603475 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2926f-bf3d-490a-9478-3311c331e998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:29.603743 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2926f-bf3d-490a-9478-3311c331e998 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:29.604387 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2926f-bf3d-490a-9478-3311c331e998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:29.606189 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2926f-bf3d-490a-9478-3311c331e998 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:29.621721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1051/2103] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:29.626706 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e7f91-38dd-4ba8-b313-034c9503e238 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:29.638025 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e7f91-38dd-4ba8-b313-034c9503e238 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:29.644201 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e3e4a-32af-41cd-969e-b6cb17d443e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:29.644919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e3e4a-32af-41cd-969e-b6cb17d443e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:29.645307 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e3e4a-32af-41cd-969e-b6cb17d443e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:29.645664 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e3e4a-32af-41cd-969e-b6cb17d443e3 admin admin] PATH_INFO: `/v3/projects/f87153874afd4d1a9fd5137e4c51ce36/users/225fb4241a0b43f2a5b2df2e53ad9181/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:29.655465 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:29.663988 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e3e4a-32af-41cd-969e-b6cb17d443e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f87153874afd4d1a9fd5137e4c51ce36, user_id=225fb4241a0b43f2a5b2df2e53ad9181, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:29.666755 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e3e4a-32af-41cd-969e-b6cb17d443e3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:29.697825 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1053/2104] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:29 2022] PUT /identity/v3/projects/f87153874afd4d1a9fd5137e4c51ce36/users/225fb4241a0b43f2a5b2df2e53ad9181/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:29.708598 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe45ec-bb97-4c79-8c9c-1df3f380bf25 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:29.708958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe45ec-bb97-4c79-8c9c-1df3f380bf25 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:29.709357 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe45ec-bb97-4c79-8c9c-1df3f380bf25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:29.738628 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-aebe45ec-bb97-4c79-8c9c-1df3f380bf25 None None] MFA Rules not processed for user `225fb4241a0b43f2a5b2df2e53ad9181`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:29.739782 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-aebe45ec-bb97-4c79-8c9c-1df3f380bf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:29.811571 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1052/2105] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:13:29.816146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e3e4a-32af-41cd-969e-b6cb17d443e3 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:29.882607 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e3e4a-32af-41cd-969e-b6cb17d443e3 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:29.887740 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03270db4-2ec5-4968-bc09-e324b5c1c876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:29.888346 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03270db4-2ec5-4968-bc09-e324b5c1c876 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:29.888633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03270db4-2ec5-4968-bc09-e324b5c1c876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:29.888904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03270db4-2ec5-4968-bc09-e324b5c1c876 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:29.889670 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03270db4-2ec5-4968-bc09-e324b5c1c876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:29.894653 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03270db4-2ec5-4968-bc09-e324b5c1c876 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:29.895484 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe45ec-bb97-4c79-8c9c-1df3f380bf25 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:29.897590 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-aebe45ec-bb97-4c79-8c9c-1df3f380bf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:29.912657 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe45ec-bb97-4c79-8c9c-1df3f380bf25 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:29.917969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5e0eb-4dcf-4471-a374-92f3f6c2d14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:29.918750 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5e0eb-4dcf-4471-a374-92f3f6c2d14a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:29.919054 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5e0eb-4dcf-4471-a374-92f3f6c2d14a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:29.919286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5e0eb-4dcf-4471-a374-92f3f6c2d14a admin admin] PATH_INFO: `/v3/projects/1fa6bebf8fc74d40b04d6da16d063f30` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:29.920499 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5e0eb-4dcf-4471-a374-92f3f6c2d14a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fa6bebf8fc74d40b04d6da16d063f30)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:29.923324 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5e0eb-4dcf-4471-a374-92f3f6c2d14a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:29.932095 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1054/2106] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:29 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:29.936180 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03270db4-2ec5-4968-bc09-e324b5c1c876 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:29.989326 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:30.003137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7cd5e0eb-4dcf-4471-a374-92f3f6c2d14a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fa6bebf8fc74d40b04d6da16d063f30', 'request_id': 'req-7cd5e0eb-4dcf-4471-a374-92f3f6c2d14a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:30.017618 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7cd5e0eb-4dcf-4471-a374-92f3f6c2d14a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fa6bebf8fc74d40b04d6da16d063f30', 'request_id': 'req-7cd5e0eb-4dcf-4471-a374-92f3f6c2d14a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:30.025649 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7cd5e0eb-4dcf-4471-a374-92f3f6c2d14a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fa6bebf8fc74d40b04d6da16d063f30', 'request_id': 'req-7cd5e0eb-4dcf-4471-a374-92f3f6c2d14a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:30.025851 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03270db4-2ec5-4968-bc09-e324b5c1c876 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:30.040434 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7cd5e0eb-4dcf-4471-a374-92f3f6c2d14a admin admin] The token cache is being invalidate because project 1fa6bebf8fc74d40b04d6da16d063f30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:30.040975 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7cd5e0eb-4dcf-4471-a374-92f3f6c2d14a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:30.043022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7cd5e0eb-4dcf-4471-a374-92f3f6c2d14a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:30.045536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1053/2107] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:29 2022] DELETE /identity/v3/projects/1fa6bebf8fc74d40b04d6da16d063f30 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:30.050232 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a4862-7d2d-4a29-a033-317ea8916c5c None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:30.050715 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a4862-7d2d-4a29-a033-317ea8916c5c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:30.051709 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a4862-7d2d-4a29-a033-317ea8916c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:30.081572 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-076a4862-7d2d-4a29-a033-317ea8916c5c None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:30.083363 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-076a4862-7d2d-4a29-a033-317ea8916c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:30.110005 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d208d47-84bc-4490-8325-fc0e8addb1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:30.111306 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d208d47-84bc-4490-8325-fc0e8addb1cf admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:30.111753 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d208d47-84bc-4490-8325-fc0e8addb1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:30.112070 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d208d47-84bc-4490-8325-fc0e8addb1cf admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:30.113135 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d208d47-84bc-4490-8325-fc0e8addb1cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:30.114907 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d208d47-84bc-4490-8325-fc0e8addb1cf admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:30.143563 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1055/2108] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:29 2022] POST /identity/v3/users => generated 299 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:13:30.147174 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d208d47-84bc-4490-8325-fc0e8addb1cf admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:30.150272 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6d208d47-84bc-4490-8325-fc0e8addb1cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:30.164599 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d208d47-84bc-4490-8325-fc0e8addb1cf admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:30.169940 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670fdba-c6c8-4063-b9e2-35989cdf1c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:30.170540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670fdba-c6c8-4063-b9e2-35989cdf1c7a admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:30.170814 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670fdba-c6c8-4063-b9e2-35989cdf1c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:30.171147 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670fdba-c6c8-4063-b9e2-35989cdf1c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:30.171828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670fdba-c6c8-4063-b9e2-35989cdf1c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:30.173476 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670fdba-c6c8-4063-b9e2-35989cdf1c7a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:30.175551 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:30.189503 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1054/2109] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:13:30.189689 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1056/2110] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:30.190780 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a4862-7d2d-4a29-a033-317ea8916c5c None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:30.191874 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ad6b1-9d35-49b2-9750-2e414746e503 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:30.192168 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ad6b1-9d35-49b2-9750-2e414746e503 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:30.192817 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ad6b1-9d35-49b2-9750-2e414746e503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:30.201212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a4862-7d2d-4a29-a033-317ea8916c5c None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:30.205849 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12295d4-bf0f-4b0c-8877-161698563e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:30.206491 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12295d4-bf0f-4b0c-8877-161698563e44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:30.206773 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12295d4-bf0f-4b0c-8877-161698563e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:30.207045 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12295d4-bf0f-4b0c-8877-161698563e44 admin admin] PATH_INFO: `/v3/projects/6d885f8c3d714640b36d2d825f8a97f4/users/ac79a6d3e4aa49de942b2f8e5ad017d4/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:30.213762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ff5ad6b1-9d35-49b2-9750-2e414746e503 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:30.215561 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ff5ad6b1-9d35-49b2-9750-2e414746e503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:30.223079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12295d4-bf0f-4b0c-8877-161698563e44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d885f8c3d714640b36d2d825f8a97f4, user_id=ac79a6d3e4aa49de942b2f8e5ad017d4, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:30.224726 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1057/2111] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:30.226197 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12295d4-bf0f-4b0c-8877-161698563e44 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:30.229951 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ad6b1-9d35-49b2-9750-2e414746e503 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:30.241674 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1055/2112] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:30 2022] PUT /identity/v3/projects/6d885f8c3d714640b36d2d825f8a97f4/users/ac79a6d3e4aa49de942b2f8e5ad017d4/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:30.241848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ad6b1-9d35-49b2-9750-2e414746e503 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:30.246251 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12295d4-bf0f-4b0c-8877-161698563e44 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:30.319176 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12295d4-bf0f-4b0c-8877-161698563e44 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:30.325028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd8dc0-170a-498f-b209-ebb1a996bbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:30.325678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd8dc0-170a-498f-b209-ebb1a996bbd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:30.325966 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd8dc0-170a-498f-b209-ebb1a996bbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:30.326224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd8dc0-170a-498f-b209-ebb1a996bbd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:30.326873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd8dc0-170a-498f-b209-ebb1a996bbd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:30.328524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd8dc0-170a-498f-b209-ebb1a996bbd0 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:30.335287 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a70b2-000d-4ca2-aafa-f3e6ee4e5c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:30.336316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a70b2-000d-4ca2-aafa-f3e6ee4e5c8e admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:30.336803 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a70b2-000d-4ca2-aafa-f3e6ee4e5c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:30.337198 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a70b2-000d-4ca2-aafa-f3e6ee4e5c8e admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:30.338270 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a70b2-000d-4ca2-aafa-f3e6ee4e5c8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:13:30.338675 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a70b2-000d-4ca2-aafa-f3e6ee4e5c8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:30.340564 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a70b2-000d-4ca2-aafa-f3e6ee4e5c8e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:30.342753 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1056/2113] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:30.343637 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd8dc0-170a-498f-b209-ebb1a996bbd0 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:30.356178 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd8dc0-170a-498f-b209-ebb1a996bbd0 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:30.365595 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1058/2114] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:13:30.366727 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a70b2-000d-4ca2-aafa-f3e6ee4e5c8e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:30.367029 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98957e2b-105c-4706-98fd-2ce307b124fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:30.368169 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98957e2b-105c-4706-98fd-2ce307b124fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:30.368598 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98957e2b-105c-4706-98fd-2ce307b124fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:30.369061 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98957e2b-105c-4706-98fd-2ce307b124fa admin admin] PATH_INFO: `/v3/projects/6d885f8c3d714640b36d2d825f8a97f4/users/ac79a6d3e4aa49de942b2f8e5ad017d4/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:30.372263 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98957e2b-105c-4706-98fd-2ce307b124fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d885f8c3d714640b36d2d825f8a97f4, user_id=ac79a6d3e4aa49de942b2f8e5ad017d4, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:30.375402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98957e2b-105c-4706-98fd-2ce307b124fa admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:30.378458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a70b2-000d-4ca2-aafa-f3e6ee4e5c8e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:30.383231 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd84433-2b4d-471e-84fa-c6a0defe9f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:30.383831 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd84433-2b4d-471e-84fa-c6a0defe9f01 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:30.384108 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd84433-2b4d-471e-84fa-c6a0defe9f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:30.384475 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd84433-2b4d-471e-84fa-c6a0defe9f01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:30.385121 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd84433-2b4d-471e-84fa-c6a0defe9f01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:30.387596 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd84433-2b4d-471e-84fa-c6a0defe9f01 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:30.389992 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1057/2115] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:30 2022] PUT /identity/v3/projects/6d885f8c3d714640b36d2d825f8a97f4/users/ac79a6d3e4aa49de942b2f8e5ad017d4/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:30.401497 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940df530-dc38-46d3-a015-9b938eab8569 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:30.401817 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940df530-dc38-46d3-a015-9b938eab8569 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:30.402089 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940df530-dc38-46d3-a015-9b938eab8569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:30.420730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1059/2116] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:30 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:13:30.424892 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd84433-2b4d-471e-84fa-c6a0defe9f01 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:30.435190 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-940df530-dc38-46d3-a015-9b938eab8569 None None] MFA Rules not processed for user `ac79a6d3e4aa49de942b2f8e5ad017d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:30.436612 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-940df530-dc38-46d3-a015-9b938eab8569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:30.450440 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:30.514644 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd84433-2b4d-471e-84fa-c6a0defe9f01 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:30.520175 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e161b12-39d5-4f04-9da0-592d310b289b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:30.520943 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e161b12-39d5-4f04-9da0-592d310b289b admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:30.521346 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e161b12-39d5-4f04-9da0-592d310b289b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:30.521717 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e161b12-39d5-4f04-9da0-592d310b289b admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:30.522446 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e161b12-39d5-4f04-9da0-592d310b289b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:30.524643 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e161b12-39d5-4f04-9da0-592d310b289b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:30.531708 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1058/2117] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:13:30.549403 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940df530-dc38-46d3-a015-9b938eab8569 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:30.552085 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-940df530-dc38-46d3-a015-9b938eab8569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:30.575148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1060/2118] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:30 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:30.579276 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e161b12-39d5-4f04-9da0-592d310b289b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:30.604432 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e161b12-39d5-4f04-9da0-592d310b289b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:30.612091 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a4b22-6b87-42a6-965d-bdc3a1c91955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:30.613984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a4b22-6b87-42a6-965d-bdc3a1c91955 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:30.614267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a4b22-6b87-42a6-965d-bdc3a1c91955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:30.615095 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a4b22-6b87-42a6-965d-bdc3a1c91955 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:30.615321 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a4b22-6b87-42a6-965d-bdc3a1c91955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:30.617017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a4b22-6b87-42a6-965d-bdc3a1c91955 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:30.632866 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1061/2119] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:30.637328 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a4b22-6b87-42a6-965d-bdc3a1c91955 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:30.648933 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a4b22-6b87-42a6-965d-bdc3a1c91955 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:30.654541 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38892c65-1b5e-4bd5-a78d-303ed1489af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:30.655141 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38892c65-1b5e-4bd5-a78d-303ed1489af8 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:30.655534 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38892c65-1b5e-4bd5-a78d-303ed1489af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:30.655811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38892c65-1b5e-4bd5-a78d-303ed1489af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:30.656538 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38892c65-1b5e-4bd5-a78d-303ed1489af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:30.658282 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38892c65-1b5e-4bd5-a78d-303ed1489af8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:30.664352 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940df530-dc38-46d3-a015-9b938eab8569 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:30.668135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2ba2d-e757-466e-9000-dc7e6f7ff9fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:30.668765 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2ba2d-e757-466e-9000-dc7e6f7ff9fc service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:30.669039 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2ba2d-e757-466e-9000-dc7e6f7ff9fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:30.669341 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2ba2d-e757-466e-9000-dc7e6f7ff9fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:30.670883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1062/2120] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:13:30.675116 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38892c65-1b5e-4bd5-a78d-303ed1489af8 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:30.680244 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2ba2d-e757-466e-9000-dc7e6f7ff9fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:30.681740 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2ba2d-e757-466e-9000-dc7e6f7ff9fc service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:30.685933 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38892c65-1b5e-4bd5-a78d-303ed1489af8 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:30.691435 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0988f-c9de-48e6-9844-8a2bf9627d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:30.692088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0988f-c9de-48e6-9844-8a2bf9627d20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:30.692364 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0988f-c9de-48e6-9844-8a2bf9627d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:30.692477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1059/2121] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:30.692626 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0988f-c9de-48e6-9844-8a2bf9627d20 admin admin] PATH_INFO: `/v3/projects/d52398c40f3f4b9eb7be83d5930733f4/users/56181965309c407c9b22ca137810bd9b/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:30.710924 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0988f-c9de-48e6-9844-8a2bf9627d20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d52398c40f3f4b9eb7be83d5930733f4, user_id=56181965309c407c9b22ca137810bd9b, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:30.715035 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0988f-c9de-48e6-9844-8a2bf9627d20 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:30.731109 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1063/2122] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:30 2022] PUT /identity/v3/projects/d52398c40f3f4b9eb7be83d5930733f4/users/56181965309c407c9b22ca137810bd9b/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:13:30.742241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1281ead-0ece-4ede-aa01-34427e237496 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:30.742721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1281ead-0ece-4ede-aa01-34427e237496 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:30.743608 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1281ead-0ece-4ede-aa01-34427e237496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:30.798774 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-a1281ead-0ece-4ede-aa01-34427e237496 None None] MFA Rules not processed for user `56181965309c407c9b22ca137810bd9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:30.800128 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a1281ead-0ece-4ede-aa01-34427e237496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:30.860844 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0988f-c9de-48e6-9844-8a2bf9627d20 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:30.863666 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8ec0988f-c9de-48e6-9844-8a2bf9627d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:30.878734 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:30.916783 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1060/2123] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:30.937003 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1281ead-0ece-4ede-aa01-34427e237496 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:30.973351 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0988f-c9de-48e6-9844-8a2bf9627d20 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:30.980631 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a22b5e-cd95-41e3-8b21-514c394fcd54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:30.981816 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a22b5e-cd95-41e3-8b21-514c394fcd54 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:30.982319 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a22b5e-cd95-41e3-8b21-514c394fcd54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:30.982819 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a22b5e-cd95-41e3-8b21-514c394fcd54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:30.985958 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-52a22b5e-cd95-41e3-8b21-514c394fcd54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:30.998801 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:31.017851 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1281ead-0ece-4ede-aa01-34427e237496 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:31.023406 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90339f2-358b-4d70-bbd6-04a594ed387d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:31.024363 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90339f2-358b-4d70-bbd6-04a594ed387d service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:31.024825 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90339f2-358b-4d70-bbd6-04a594ed387d service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:31.025474 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90339f2-358b-4d70-bbd6-04a594ed387d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:31.040497 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90339f2-358b-4d70-bbd6-04a594ed387d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:31.043582 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90339f2-358b-4d70-bbd6-04a594ed387d service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:31.081528 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1061/2124] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 14:13:31.114817 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a22b5e-cd95-41e3-8b21-514c394fcd54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:31.117681 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a22b5e-cd95-41e3-8b21-514c394fcd54 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:31.143740 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1064/2125] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 14:13:31.980387 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90339f2-358b-4d70-bbd6-04a594ed387d service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:31.990411 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90339f2-358b-4d70-bbd6-04a594ed387d service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:31.994880 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed834dad-70f2-438b-a5cc-b0b49030dad4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:31.996219 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed834dad-70f2-438b-a5cc-b0b49030dad4 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:31.996594 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed834dad-70f2-438b-a5cc-b0b49030dad4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:31.996959 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed834dad-70f2-438b-a5cc-b0b49030dad4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:31.999213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ed834dad-70f2-438b-a5cc-b0b49030dad4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:32.103026 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed834dad-70f2-438b-a5cc-b0b49030dad4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:32.104539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed834dad-70f2-438b-a5cc-b0b49030dad4 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:32.125333 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1062/2126] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:32.420664 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a22b5e-cd95-41e3-8b21-514c394fcd54 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:32.507606 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a22b5e-cd95-41e3-8b21-514c394fcd54 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:32.513529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f2d30-ab1d-4cb6-8f27-a0d83bb05beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:32.513847 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f2d30-ab1d-4cb6-8f27-a0d83bb05beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:32.514118 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f2d30-ab1d-4cb6-8f27-a0d83bb05beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:32.514386 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f2d30-ab1d-4cb6-8f27-a0d83bb05beb admin admin] PATH_INFO: `/v3/users/225fb4241a0b43f2a5b2df2e53ad9181` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:32.515874 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f2d30-ab1d-4cb6-8f27-a0d83bb05beb admin admin] RBAC: Authorizing `identity:delete_user(user_id=225fb4241a0b43f2a5b2df2e53ad9181)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:32.517737 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f2d30-ab1d-4cb6-8f27-a0d83bb05beb admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:32.576364 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-915f2d30-ab1d-4cb6-8f27-a0d83bb05beb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '225fb4241a0b43f2a5b2df2e53ad9181'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:32.586155 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-915f2d30-ab1d-4cb6-8f27-a0d83bb05beb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '225fb4241a0b43f2a5b2df2e53ad9181'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:32.598501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:32.606749 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-915f2d30-ab1d-4cb6-8f27-a0d83bb05beb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '225fb4241a0b43f2a5b2df2e53ad9181'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:32.608344 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-915f2d30-ab1d-4cb6-8f27-a0d83bb05beb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '225fb4241a0b43f2a5b2df2e53ad9181'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:32.618185 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-915f2d30-ab1d-4cb6-8f27-a0d83bb05beb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '225fb4241a0b43f2a5b2df2e53ad9181'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:32.631187 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1065/2127] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:13:32 2022] DELETE /identity/v3/users/225fb4241a0b43f2a5b2df2e53ad9181 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:32.635875 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad926ec-1301-4239-bad7-b0a09bbff9bb None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:32.636216 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad926ec-1301-4239-bad7-b0a09bbff9bb None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:32.636493 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad926ec-1301-4239-bad7-b0a09bbff9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:32.661713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-6ad926ec-1301-4239-bad7-b0a09bbff9bb None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:32.663337 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-6ad926ec-1301-4239-bad7-b0a09bbff9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:32.743698 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1063/2128] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:32.761298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f2d30-ab1d-4cb6-8f27-a0d83bb05beb admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:32.762765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-915f2d30-ab1d-4cb6-8f27-a0d83bb05beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:32.837325 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f2d30-ab1d-4cb6-8f27-a0d83bb05beb admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:32.841307 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3543aba-73f4-4435-a093-506c37fada62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:32.842006 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3543aba-73f4-4435-a093-506c37fada62 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:32.842973 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3543aba-73f4-4435-a093-506c37fada62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:32.842973 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3543aba-73f4-4435-a093-506c37fada62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:32.852392 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3543aba-73f4-4435-a093-506c37fada62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:32.854257 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3543aba-73f4-4435-a093-506c37fada62 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:32.885778 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1066/2129] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:33.235022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad926ec-1301-4239-bad7-b0a09bbff9bb None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:33.236629 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-6ad926ec-1301-4239-bad7-b0a09bbff9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:33.257564 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad926ec-1301-4239-bad7-b0a09bbff9bb None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:33.262667 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045b191-1c5a-40fa-b347-8adc833b883c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:33.263353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045b191-1c5a-40fa-b347-8adc833b883c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:33.263748 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045b191-1c5a-40fa-b347-8adc833b883c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:33.263916 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045b191-1c5a-40fa-b347-8adc833b883c admin admin] PATH_INFO: `/v3/projects/f87153874afd4d1a9fd5137e4c51ce36` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:33.265392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045b191-1c5a-40fa-b347-8adc833b883c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f87153874afd4d1a9fd5137e4c51ce36)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:33.268087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045b191-1c5a-40fa-b347-8adc833b883c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:33.335881 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7045b191-1c5a-40fa-b347-8adc833b883c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f87153874afd4d1a9fd5137e4c51ce36', 'request_id': 'req-7045b191-1c5a-40fa-b347-8adc833b883c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:33.365991 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7045b191-1c5a-40fa-b347-8adc833b883c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f87153874afd4d1a9fd5137e4c51ce36', 'request_id': 'req-7045b191-1c5a-40fa-b347-8adc833b883c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:33.375586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7045b191-1c5a-40fa-b347-8adc833b883c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f87153874afd4d1a9fd5137e4c51ce36', 'request_id': 'req-7045b191-1c5a-40fa-b347-8adc833b883c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:33.390466 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7045b191-1c5a-40fa-b347-8adc833b883c admin admin] The token cache is being invalidate because project f87153874afd4d1a9fd5137e4c51ce36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:33.391106 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7045b191-1c5a-40fa-b347-8adc833b883c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:33.391927 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7045b191-1c5a-40fa-b347-8adc833b883c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:33.394118 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1064/2130] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:33 2022] DELETE /identity/v3/projects/f87153874afd4d1a9fd5137e4c51ce36 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:33.398124 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3543aba-73f4-4435-a093-506c37fada62 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:33.411025 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3543aba-73f4-4435-a093-506c37fada62 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:33.483078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eeeb02-64a0-4624-b3af-e8fe77e133a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:33.484607 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eeeb02-64a0-4624-b3af-e8fe77e133a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:33.484930 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eeeb02-64a0-4624-b3af-e8fe77e133a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:33.485267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eeeb02-64a0-4624-b3af-e8fe77e133a0 admin admin] PATH_INFO: `/v3/users/ac79a6d3e4aa49de942b2f8e5ad017d4` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:33.486492 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eeeb02-64a0-4624-b3af-e8fe77e133a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac79a6d3e4aa49de942b2f8e5ad017d4)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:33.488636 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eeeb02-64a0-4624-b3af-e8fe77e133a0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:33.538835 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-97eeeb02-64a0-4624-b3af-e8fe77e133a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac79a6d3e4aa49de942b2f8e5ad017d4'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:33.547676 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-97eeeb02-64a0-4624-b3af-e8fe77e133a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac79a6d3e4aa49de942b2f8e5ad017d4'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:33.566479 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-97eeeb02-64a0-4624-b3af-e8fe77e133a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac79a6d3e4aa49de942b2f8e5ad017d4'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:33.567470 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-97eeeb02-64a0-4624-b3af-e8fe77e133a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac79a6d3e4aa49de942b2f8e5ad017d4'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:33.578154 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-97eeeb02-64a0-4624-b3af-e8fe77e133a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac79a6d3e4aa49de942b2f8e5ad017d4'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:33.588306 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1067/2131] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:13:33 2022] DELETE /identity/v3/users/ac79a6d3e4aa49de942b2f8e5ad017d4 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:33.994413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045b191-1c5a-40fa-b347-8adc833b883c admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:33.996506 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7045b191-1c5a-40fa-b347-8adc833b883c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:34.005080 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:34.012254 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045b191-1c5a-40fa-b347-8adc833b883c admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:34.092015 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09695cfe-24f4-4671-bf4b-e1ed1542955f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:34.092642 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09695cfe-24f4-4671-bf4b-e1ed1542955f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:34.092921 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09695cfe-24f4-4671-bf4b-e1ed1542955f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:34.093229 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09695cfe-24f4-4671-bf4b-e1ed1542955f admin admin] PATH_INFO: `/v3/projects/6d885f8c3d714640b36d2d825f8a97f4` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:34.094373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09695cfe-24f4-4671-bf4b-e1ed1542955f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d885f8c3d714640b36d2d825f8a97f4)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:34.096297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09695cfe-24f4-4671-bf4b-e1ed1542955f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:34.145455 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-09695cfe-24f4-4671-bf4b-e1ed1542955f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d885f8c3d714640b36d2d825f8a97f4', 'request_id': 'req-09695cfe-24f4-4671-bf4b-e1ed1542955f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:34.152865 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-09695cfe-24f4-4671-bf4b-e1ed1542955f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d885f8c3d714640b36d2d825f8a97f4', 'request_id': 'req-09695cfe-24f4-4671-bf4b-e1ed1542955f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:34.158647 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-09695cfe-24f4-4671-bf4b-e1ed1542955f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d885f8c3d714640b36d2d825f8a97f4', 'request_id': 'req-09695cfe-24f4-4671-bf4b-e1ed1542955f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:34.171928 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-09695cfe-24f4-4671-bf4b-e1ed1542955f admin admin] The token cache is being invalidate because project 6d885f8c3d714640b36d2d825f8a97f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:34.172213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-09695cfe-24f4-4671-bf4b-e1ed1542955f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:34.172848 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-09695cfe-24f4-4671-bf4b-e1ed1542955f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:34.174342 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1065/2132] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:33 2022] DELETE /identity/v3/projects/6d885f8c3d714640b36d2d825f8a97f4 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:34.179208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccf75a-701e-4691-8f8a-0c7e831a5f17 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:34.179494 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccf75a-701e-4691-8f8a-0c7e831a5f17 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:34.179790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccf75a-701e-4691-8f8a-0c7e831a5f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:34.187939 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:34.205243 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-71ccf75a-701e-4691-8f8a-0c7e831a5f17 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:34.206513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-71ccf75a-701e-4691-8f8a-0c7e831a5f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:34.269262 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1068/2133] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:34.277423 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2554a-8809-492b-b3a4-5ec57b3c9dc5 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:34.277896 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2554a-8809-492b-b3a4-5ec57b3c9dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:34.278025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2554a-8809-492b-b3a4-5ec57b3c9dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:34.297794 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-acf2554a-8809-492b-b3a4-5ec57b3c9dc5 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:34.298973 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-acf2554a-8809-492b-b3a4-5ec57b3c9dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:34.306764 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1066/2134] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:34.311496 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccf75a-701e-4691-8f8a-0c7e831a5f17 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:34.321017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccf75a-701e-4691-8f8a-0c7e831a5f17 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:34.326241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcce3e-0606-4f17-9209-6a54e00f904d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:34.326828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcce3e-0606-4f17-9209-6a54e00f904d admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:34.327101 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcce3e-0606-4f17-9209-6a54e00f904d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:34.327368 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcce3e-0606-4f17-9209-6a54e00f904d admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:34.328004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcce3e-0606-4f17-9209-6a54e00f904d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:13:34.328303 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcce3e-0606-4f17-9209-6a54e00f904d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:34.329930 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcce3e-0606-4f17-9209-6a54e00f904d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:34.341974 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1069/2135] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:13:34.346167 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2554a-8809-492b-b3a4-5ec57b3c9dc5 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:34.355352 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2554a-8809-492b-b3a4-5ec57b3c9dc5 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:34.361006 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50a2f2-7776-4c23-9342-96af5e18025f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:34.361872 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50a2f2-7776-4c23-9342-96af5e18025f admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:34.362387 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50a2f2-7776-4c23-9342-96af5e18025f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:34.362771 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50a2f2-7776-4c23-9342-96af5e18025f admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:34.363644 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50a2f2-7776-4c23-9342-96af5e18025f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:34.366519 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50a2f2-7776-4c23-9342-96af5e18025f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:34.397258 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1067/2136] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:34 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:13:34.400846 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcce3e-0606-4f17-9209-6a54e00f904d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:34.411228 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcce3e-0606-4f17-9209-6a54e00f904d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:34.481273 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478d873-c4c9-4b68-8132-d8be73b80495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:34.481273 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478d873-c4c9-4b68-8132-d8be73b80495 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:34.481273 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478d873-c4c9-4b68-8132-d8be73b80495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:34.481273 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478d873-c4c9-4b68-8132-d8be73b80495 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:34.481647 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478d873-c4c9-4b68-8132-d8be73b80495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:34.481647 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478d873-c4c9-4b68-8132-d8be73b80495 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:34.497171 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1070/2137] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:34 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:34.501618 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50a2f2-7776-4c23-9342-96af5e18025f admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:34.513198 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50a2f2-7776-4c23-9342-96af5e18025f admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:34.518121 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143355b-8c0e-4a4c-8fe7-890f96fdf807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:34.518780 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143355b-8c0e-4a4c-8fe7-890f96fdf807 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:34.519060 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143355b-8c0e-4a4c-8fe7-890f96fdf807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:34.519456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143355b-8c0e-4a4c-8fe7-890f96fdf807 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:34.520161 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143355b-8c0e-4a4c-8fe7-890f96fdf807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:34.521887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143355b-8c0e-4a4c-8fe7-890f96fdf807 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:34.532576 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1068/2138] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:34.536691 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478d873-c4c9-4b68-8132-d8be73b80495 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:34.547708 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478d873-c4c9-4b68-8132-d8be73b80495 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:34.552558 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf19c5-5ab4-4c2b-b324-90b273b4a5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:34.553264 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf19c5-5ab4-4c2b-b324-90b273b4a5b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:34.553549 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf19c5-5ab4-4c2b-b324-90b273b4a5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:34.553821 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf19c5-5ab4-4c2b-b324-90b273b4a5b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:34.554620 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf19c5-5ab4-4c2b-b324-90b273b4a5b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:34.556220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf19c5-5ab4-4c2b-b324-90b273b4a5b3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:34.567823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1071/2139] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:34.572174 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143355b-8c0e-4a4c-8fe7-890f96fdf807 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:34.582867 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143355b-8c0e-4a4c-8fe7-890f96fdf807 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:34.587584 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d7eb9-ec10-448e-8d4c-c609065452af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:34.588226 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d7eb9-ec10-448e-8d4c-c609065452af admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:34.588501 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d7eb9-ec10-448e-8d4c-c609065452af admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:34.589638 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d7eb9-ec10-448e-8d4c-c609065452af admin admin] PATH_INFO: `/v3/projects/1316b7812854401db1f79291e7d43214/users/37b66ff326764749bd34e49e6fa004e5/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:34.607426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d7eb9-ec10-448e-8d4c-c609065452af admin admin] RBAC: Authorizing `identity:create_grant(project_id=1316b7812854401db1f79291e7d43214, user_id=37b66ff326764749bd34e49e6fa004e5, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:34.610295 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d7eb9-ec10-448e-8d4c-c609065452af admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:34.634785 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1069/2140] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:34 2022] PUT /identity/v3/projects/1316b7812854401db1f79291e7d43214/users/37b66ff326764749bd34e49e6fa004e5/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:34.646844 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cc735-3a14-4c39-94e0-91b0e381d269 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:34.647520 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cc735-3a14-4c39-94e0-91b0e381d269 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:34.647972 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cc735-3a14-4c39-94e0-91b0e381d269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:34.681621 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-078cc735-3a14-4c39-94e0-91b0e381d269 None None] MFA Rules not processed for user `37b66ff326764749bd34e49e6fa004e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:34.683678 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-078cc735-3a14-4c39-94e0-91b0e381d269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:34.763155 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:34.777935 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1072/2141] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:34.820725 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d7eb9-ec10-448e-8d4c-c609065452af admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:34.823312 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-605d7eb9-ec10-448e-8d4c-c609065452af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:34.937274 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:34.992342 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d7eb9-ec10-448e-8d4c-c609065452af admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:35.001589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7aec9a-ba9f-4012-ac53-859b4c7894dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:35.002653 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7aec9a-ba9f-4012-ac53-859b4c7894dc service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:35.003084 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7aec9a-ba9f-4012-ac53-859b4c7894dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:35.003573 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7aec9a-ba9f-4012-ac53-859b4c7894dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:35.015393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7aec9a-ba9f-4012-ac53-859b4c7894dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:35.017816 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7aec9a-ba9f-4012-ac53-859b4c7894dc service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:35.030113 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1070/2142] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:36.716714 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078cc735-3a14-4c39-94e0-91b0e381d269 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:36.719643 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-078cc735-3a14-4c39-94e0-91b0e381d269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:36.820084 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078cc735-3a14-4c39-94e0-91b0e381d269 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:36.825558 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348404e2-6281-4d34-8914-3d8dbb59b8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:36.826194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348404e2-6281-4d34-8914-3d8dbb59b8ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:36.826501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348404e2-6281-4d34-8914-3d8dbb59b8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:36.826830 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348404e2-6281-4d34-8914-3d8dbb59b8ab admin admin] PATH_INFO: `/v3/users/d686b12d07834e85ae767fb5defedbb0` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:36.827918 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348404e2-6281-4d34-8914-3d8dbb59b8ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=d686b12d07834e85ae767fb5defedbb0)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:36.829874 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348404e2-6281-4d34-8914-3d8dbb59b8ab admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:36.891591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-348404e2-6281-4d34-8914-3d8dbb59b8ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd686b12d07834e85ae767fb5defedbb0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:36.900138 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-348404e2-6281-4d34-8914-3d8dbb59b8ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd686b12d07834e85ae767fb5defedbb0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:36.930595 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-348404e2-6281-4d34-8914-3d8dbb59b8ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd686b12d07834e85ae767fb5defedbb0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:36.933645 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-348404e2-6281-4d34-8914-3d8dbb59b8ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd686b12d07834e85ae767fb5defedbb0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:36.943239 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-348404e2-6281-4d34-8914-3d8dbb59b8ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd686b12d07834e85ae767fb5defedbb0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:36.950117 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1073/2143] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:13:36 2022] DELETE /identity/v3/users/d686b12d07834e85ae767fb5defedbb0 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:13:36.956168 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbcc29-77a7-4984-be49-aa97922482fe None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:36.956672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbcc29-77a7-4984-be49-aa97922482fe None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:36.956971 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbcc29-77a7-4984-be49-aa97922482fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:36.982737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-dadbcc29-77a7-4984-be49-aa97922482fe None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:36.984214 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-dadbcc29-77a7-4984-be49-aa97922482fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:37.048113 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1071/2144] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:37.063249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348404e2-6281-4d34-8914-3d8dbb59b8ab admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:37.065238 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-348404e2-6281-4d34-8914-3d8dbb59b8ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:37.142952 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348404e2-6281-4d34-8914-3d8dbb59b8ab admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:37.147243 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed9faf-a367-43c5-af97-4a7937e4462b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:37.147910 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed9faf-a367-43c5-af97-4a7937e4462b service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:37.148204 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed9faf-a367-43c5-af97-4a7937e4462b service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:37.148538 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed9faf-a367-43c5-af97-4a7937e4462b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:37.162579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed9faf-a367-43c5-af97-4a7937e4462b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:37.164121 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed9faf-a367-43c5-af97-4a7937e4462b service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:37.174857 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1074/2145] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:37.714272 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbcc29-77a7-4984-be49-aa97922482fe None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:37.716577 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-dadbcc29-77a7-4984-be49-aa97922482fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:37.734871 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbcc29-77a7-4984-be49-aa97922482fe None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:37.740182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d6cd5-b5c3-4bf4-b6a6-c36d09135b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:37.741022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d6cd5-b5c3-4bf4-b6a6-c36d09135b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:37.741322 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d6cd5-b5c3-4bf4-b6a6-c36d09135b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:37.741665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d6cd5-b5c3-4bf4-b6a6-c36d09135b2a admin admin] PATH_INFO: `/v3/projects/81e4823c4e714e48beb8bd0ef3b8e50c` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:37.742880 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d6cd5-b5c3-4bf4-b6a6-c36d09135b2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=81e4823c4e714e48beb8bd0ef3b8e50c)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:37.744869 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d6cd5-b5c3-4bf4-b6a6-c36d09135b2a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:37.831557 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-877d6cd5-b5c3-4bf4-b6a6-c36d09135b2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81e4823c4e714e48beb8bd0ef3b8e50c', 'request_id': 'req-877d6cd5-b5c3-4bf4-b6a6-c36d09135b2a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:37.841537 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-877d6cd5-b5c3-4bf4-b6a6-c36d09135b2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81e4823c4e714e48beb8bd0ef3b8e50c', 'request_id': 'req-877d6cd5-b5c3-4bf4-b6a6-c36d09135b2a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:37.849403 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-877d6cd5-b5c3-4bf4-b6a6-c36d09135b2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81e4823c4e714e48beb8bd0ef3b8e50c', 'request_id': 'req-877d6cd5-b5c3-4bf4-b6a6-c36d09135b2a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:37.864455 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-877d6cd5-b5c3-4bf4-b6a6-c36d09135b2a admin admin] The token cache is being invalidate because project 81e4823c4e714e48beb8bd0ef3b8e50c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:37.864811 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-877d6cd5-b5c3-4bf4-b6a6-c36d09135b2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:37.865492 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-877d6cd5-b5c3-4bf4-b6a6-c36d09135b2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:37.869299 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1072/2146] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:37 2022] DELETE /identity/v3/projects/81e4823c4e714e48beb8bd0ef3b8e50c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:37.872279 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed9faf-a367-43c5-af97-4a7937e4462b service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:37.886260 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed9faf-a367-43c5-af97-4a7937e4462b service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:37.905598 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:37.951808 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d42cd-fa53-405f-ae47-318053a815fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:37.952670 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d42cd-fa53-405f-ae47-318053a815fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:37.952929 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d42cd-fa53-405f-ae47-318053a815fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:37.953290 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d42cd-fa53-405f-ae47-318053a815fa admin admin] PATH_INFO: `/v3/users/adc42a3a7eef447e994b8fa359558ea1` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:37.954822 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d42cd-fa53-405f-ae47-318053a815fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=adc42a3a7eef447e994b8fa359558ea1)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:37.956929 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d42cd-fa53-405f-ae47-318053a815fa admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:38.023920 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2c5d42cd-fa53-405f-ae47-318053a815fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adc42a3a7eef447e994b8fa359558ea1'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:38.032424 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2c5d42cd-fa53-405f-ae47-318053a815fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adc42a3a7eef447e994b8fa359558ea1'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:38.046019 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2c5d42cd-fa53-405f-ae47-318053a815fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adc42a3a7eef447e994b8fa359558ea1'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:38.046714 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2c5d42cd-fa53-405f-ae47-318053a815fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adc42a3a7eef447e994b8fa359558ea1'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:38.054220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2c5d42cd-fa53-405f-ae47-318053a815fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adc42a3a7eef447e994b8fa359558ea1'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:38.060671 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1075/2147] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:13:37 2022] DELETE /identity/v3/users/adc42a3a7eef447e994b8fa359558ea1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:38.347423 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d6cd5-b5c3-4bf4-b6a6-c36d09135b2a admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:38.349034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-877d6cd5-b5c3-4bf4-b6a6-c36d09135b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:38.381704 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d6cd5-b5c3-4bf4-b6a6-c36d09135b2a admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:38.439259 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:38.448044 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6e2de-fe65-4c8b-b9a2-ea11109057e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:38.449390 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6e2de-fe65-4c8b-b9a2-ea11109057e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:38.450023 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6e2de-fe65-4c8b-b9a2-ea11109057e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:38.450506 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6e2de-fe65-4c8b-b9a2-ea11109057e7 admin admin] PATH_INFO: `/v3/projects/e3d155c2128c43e98d07caf2ae6a8830` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:38.451789 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6e2de-fe65-4c8b-b9a2-ea11109057e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3d155c2128c43e98d07caf2ae6a8830)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:38.453886 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6e2de-fe65-4c8b-b9a2-ea11109057e7 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:38.503132 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-47d6e2de-fe65-4c8b-b9a2-ea11109057e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3d155c2128c43e98d07caf2ae6a8830', 'request_id': 'req-47d6e2de-fe65-4c8b-b9a2-ea11109057e7'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:38.510290 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-47d6e2de-fe65-4c8b-b9a2-ea11109057e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3d155c2128c43e98d07caf2ae6a8830', 'request_id': 'req-47d6e2de-fe65-4c8b-b9a2-ea11109057e7'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:38.516039 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-47d6e2de-fe65-4c8b-b9a2-ea11109057e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3d155c2128c43e98d07caf2ae6a8830', 'request_id': 'req-47d6e2de-fe65-4c8b-b9a2-ea11109057e7'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:38.529494 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-47d6e2de-fe65-4c8b-b9a2-ea11109057e7 admin admin] The token cache is being invalidate because project e3d155c2128c43e98d07caf2ae6a8830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:38.529888 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-47d6e2de-fe65-4c8b-b9a2-ea11109057e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:38.530661 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-47d6e2de-fe65-4c8b-b9a2-ea11109057e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:38.532409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1073/2148] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:38 2022] DELETE /identity/v3/projects/e3d155c2128c43e98d07caf2ae6a8830 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:38.536311 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d42cd-fa53-405f-ae47-318053a815fa admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:38.537688 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2c5d42cd-fa53-405f-ae47-318053a815fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:38.550561 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d42cd-fa53-405f-ae47-318053a815fa admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:38.613828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26068d-32e0-4095-b79b-11d46bb474b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:38.614575 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26068d-32e0-4095-b79b-11d46bb474b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:38.615214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26068d-32e0-4095-b79b-11d46bb474b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:38.615566 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26068d-32e0-4095-b79b-11d46bb474b2 admin admin] PATH_INFO: `/v3/users/fa66cb4f0c71468d841bb62ae268af51` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:38.616855 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26068d-32e0-4095-b79b-11d46bb474b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa66cb4f0c71468d841bb62ae268af51)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:38.625830 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26068d-32e0-4095-b79b-11d46bb474b2 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:38.697497 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:38.707817 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-df26068d-32e0-4095-b79b-11d46bb474b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa66cb4f0c71468d841bb62ae268af51'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:38.725701 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-df26068d-32e0-4095-b79b-11d46bb474b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa66cb4f0c71468d841bb62ae268af51'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:38.741451 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-df26068d-32e0-4095-b79b-11d46bb474b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa66cb4f0c71468d841bb62ae268af51'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:38.742583 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-df26068d-32e0-4095-b79b-11d46bb474b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa66cb4f0c71468d841bb62ae268af51'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:38.751571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-df26068d-32e0-4095-b79b-11d46bb474b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa66cb4f0c71468d841bb62ae268af51'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:38.758534 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1076/2149] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:13:38 2022] DELETE /identity/v3/users/fa66cb4f0c71468d841bb62ae268af51 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:39.108610 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6e2de-fe65-4c8b-b9a2-ea11109057e7 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:39.110273 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-47d6e2de-fe65-4c8b-b9a2-ea11109057e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:39.127807 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6e2de-fe65-4c8b-b9a2-ea11109057e7 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:39.209300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfafbc-ff2f-43cc-bd2f-b5d23e1f0de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:39.210002 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfafbc-ff2f-43cc-bd2f-b5d23e1f0de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:39.210349 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfafbc-ff2f-43cc-bd2f-b5d23e1f0de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:39.210682 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfafbc-ff2f-43cc-bd2f-b5d23e1f0de6 admin admin] PATH_INFO: `/v3/projects/997af73a801c4c0e9e4f76977ab40b1f` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:39.212114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfafbc-ff2f-43cc-bd2f-b5d23e1f0de6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=997af73a801c4c0e9e4f76977ab40b1f)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:39.214977 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfafbc-ff2f-43cc-bd2f-b5d23e1f0de6 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:39.270719 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6adfafbc-ff2f-43cc-bd2f-b5d23e1f0de6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '997af73a801c4c0e9e4f76977ab40b1f', 'request_id': 'req-6adfafbc-ff2f-43cc-bd2f-b5d23e1f0de6'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:39.280770 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6adfafbc-ff2f-43cc-bd2f-b5d23e1f0de6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '997af73a801c4c0e9e4f76977ab40b1f', 'request_id': 'req-6adfafbc-ff2f-43cc-bd2f-b5d23e1f0de6'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:39.286300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6adfafbc-ff2f-43cc-bd2f-b5d23e1f0de6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '997af73a801c4c0e9e4f76977ab40b1f', 'request_id': 'req-6adfafbc-ff2f-43cc-bd2f-b5d23e1f0de6'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:39.299139 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6adfafbc-ff2f-43cc-bd2f-b5d23e1f0de6 admin admin] The token cache is being invalidate because project 997af73a801c4c0e9e4f76977ab40b1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:39.299362 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6adfafbc-ff2f-43cc-bd2f-b5d23e1f0de6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:39.300086 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6adfafbc-ff2f-43cc-bd2f-b5d23e1f0de6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:39.302299 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1074/2150] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:39 2022] DELETE /identity/v3/projects/997af73a801c4c0e9e4f76977ab40b1f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:39.307418 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e024828-008e-47ce-a511-71e94d9e9ffe None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:39.308010 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e024828-008e-47ce-a511-71e94d9e9ffe None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:39.308010 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e024828-008e-47ce-a511-71e94d9e9ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:39.329080 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-9e024828-008e-47ce-a511-71e94d9e9ffe None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:39.330349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9e024828-008e-47ce-a511-71e94d9e9ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:39.393806 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1077/2151] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:39.403943 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19201c-a28f-4ec2-9f04-6a04b0553a75 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:39.404742 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19201c-a28f-4ec2-9f04-6a04b0553a75 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:39.404742 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19201c-a28f-4ec2-9f04-6a04b0553a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:39.426527 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-7b19201c-a28f-4ec2-9f04-6a04b0553a75 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:39.427731 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7b19201c-a28f-4ec2-9f04-6a04b0553a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:39.436418 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1075/2152] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:39.440805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e024828-008e-47ce-a511-71e94d9e9ffe None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:39.450711 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e024828-008e-47ce-a511-71e94d9e9ffe None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:39.455464 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133d07c-424d-4e4c-8356-b5fcc68b8d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:39.456069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133d07c-424d-4e4c-8356-b5fcc68b8d9e admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:39.456345 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133d07c-424d-4e4c-8356-b5fcc68b8d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:39.456617 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133d07c-424d-4e4c-8356-b5fcc68b8d9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:39.457325 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133d07c-424d-4e4c-8356-b5fcc68b8d9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:13:39.457625 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133d07c-424d-4e4c-8356-b5fcc68b8d9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:39.459323 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133d07c-424d-4e4c-8356-b5fcc68b8d9e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:39.473112 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1078/2153] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:13:39.477548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19201c-a28f-4ec2-9f04-6a04b0553a75 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:39.486994 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19201c-a28f-4ec2-9f04-6a04b0553a75 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:39.491670 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647312ec-ad2c-4d28-a15e-7a2f6901ad1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:39.492284 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647312ec-ad2c-4d28-a15e-7a2f6901ad1a admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:39.492560 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647312ec-ad2c-4d28-a15e-7a2f6901ad1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:39.492821 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647312ec-ad2c-4d28-a15e-7a2f6901ad1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:39.493501 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647312ec-ad2c-4d28-a15e-7a2f6901ad1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:39.495905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647312ec-ad2c-4d28-a15e-7a2f6901ad1a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:39.501364 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:39.530084 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1076/2154] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:39 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:39.534357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133d07c-424d-4e4c-8356-b5fcc68b8d9e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:39.545047 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133d07c-424d-4e4c-8356-b5fcc68b8d9e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:39.611111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260183a-b79f-4f13-a97f-c34c9c8df37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:39.611716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260183a-b79f-4f13-a97f-c34c9c8df37b admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:39.611995 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260183a-b79f-4f13-a97f-c34c9c8df37b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:39.612264 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260183a-b79f-4f13-a97f-c34c9c8df37b admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:39.612900 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260183a-b79f-4f13-a97f-c34c9c8df37b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:39.614865 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260183a-b79f-4f13-a97f-c34c9c8df37b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:39.642718 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1079/2155] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:39 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:13:39.646901 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647312ec-ad2c-4d28-a15e-7a2f6901ad1a admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:39.657574 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647312ec-ad2c-4d28-a15e-7a2f6901ad1a admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:39.662175 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9eec34-e587-4974-bfe8-7daea2ffe667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:39.662762 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9eec34-e587-4974-bfe8-7daea2ffe667 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:39.663281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9eec34-e587-4974-bfe8-7daea2ffe667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:39.664362 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9eec34-e587-4974-bfe8-7daea2ffe667 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:39.665611 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9eec34-e587-4974-bfe8-7daea2ffe667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:39.667525 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9eec34-e587-4974-bfe8-7daea2ffe667 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:39.677983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1077/2156] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:13:39.681923 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260183a-b79f-4f13-a97f-c34c9c8df37b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:39.692993 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260183a-b79f-4f13-a97f-c34c9c8df37b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:39.697917 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5c075-dcbc-4550-bfad-99c773d66c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:39.698617 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5c075-dcbc-4550-bfad-99c773d66c21 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:39.698952 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5c075-dcbc-4550-bfad-99c773d66c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:39.699287 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5c075-dcbc-4550-bfad-99c773d66c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:39.700026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5c075-dcbc-4550-bfad-99c773d66c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:39.701752 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5c075-dcbc-4550-bfad-99c773d66c21 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:39.713428 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1080/2157] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:13:39.717609 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9eec34-e587-4974-bfe8-7daea2ffe667 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:39.729966 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9eec34-e587-4974-bfe8-7daea2ffe667 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:39.734790 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d4137-25fb-4e8c-a91b-209f1ad2ccfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:39.735520 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d4137-25fb-4e8c-a91b-209f1ad2ccfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:39.735857 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d4137-25fb-4e8c-a91b-209f1ad2ccfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:39.736196 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d4137-25fb-4e8c-a91b-209f1ad2ccfb admin admin] PATH_INFO: `/v3/projects/6435fc86f8b44d3fa9b0417d7bd61433/users/4c0e15bafe7c4085b65eb9f1e7fe7aa6/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:39.751480 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d4137-25fb-4e8c-a91b-209f1ad2ccfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6435fc86f8b44d3fa9b0417d7bd61433, user_id=4c0e15bafe7c4085b65eb9f1e7fe7aa6, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:39.754282 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d4137-25fb-4e8c-a91b-209f1ad2ccfb admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:39.769869 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1078/2158] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:39 2022] PUT /identity/v3/projects/6435fc86f8b44d3fa9b0417d7bd61433/users/4c0e15bafe7c4085b65eb9f1e7fe7aa6/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:39.775066 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709099f8-904e-4459-9be0-898fdf091dac None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:39.775354 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709099f8-904e-4459-9be0-898fdf091dac None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:39.775626 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709099f8-904e-4459-9be0-898fdf091dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:39.796778 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-709099f8-904e-4459-9be0-898fdf091dac None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:39.798081 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-709099f8-904e-4459-9be0-898fdf091dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:39.817455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:39.862777 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1081/2159] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:39.873037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d4137-25fb-4e8c-a91b-209f1ad2ccfb admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:39.874850 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c97d4137-25fb-4e8c-a91b-209f1ad2ccfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:39.984494 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d4137-25fb-4e8c-a91b-209f1ad2ccfb admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:39.993721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e840e6-b438-4ee2-9ea7-dec6a9196f91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:39.995787 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e840e6-b438-4ee2-9ea7-dec6a9196f91 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:39.996730 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e840e6-b438-4ee2-9ea7-dec6a9196f91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:39.998505 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e840e6-b438-4ee2-9ea7-dec6a9196f91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:40.012634 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e840e6-b438-4ee2-9ea7-dec6a9196f91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:40.014585 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e840e6-b438-4ee2-9ea7-dec6a9196f91 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:40.034196 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1079/2160] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 14:13:41.491864 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122c510-3088-4661-8cf5-aed90f7b699c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:41.492636 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122c510-3088-4661-8cf5-aed90f7b699c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:41.493085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122c510-3088-4661-8cf5-aed90f7b699c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:41.555268 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-8122c510-3088-4661-8cf5-aed90f7b699c None None] MFA Rules not processed for user `4c0e15bafe7c4085b65eb9f1e7fe7aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:41.559276 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8122c510-3088-4661-8cf5-aed90f7b699c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:41.715752 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1082/2161] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:13:41.727145 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e840e6-b438-4ee2-9ea7-dec6a9196f91 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:41.729617 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f8e840e6-b438-4ee2-9ea7-dec6a9196f91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:41.837393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e840e6-b438-4ee2-9ea7-dec6a9196f91 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:41.844781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b070f85-f48a-40a5-bcd1-794a50fd18ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:41.845552 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b070f85-f48a-40a5-bcd1-794a50fd18ec service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:41.846736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b070f85-f48a-40a5-bcd1-794a50fd18ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:41.846736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b070f85-f48a-40a5-bcd1-794a50fd18ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:41.866686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b070f85-f48a-40a5-bcd1-794a50fd18ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:41.869835 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b070f85-f48a-40a5-bcd1-794a50fd18ec service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:41.893665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1080/2162] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:42.332974 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122c510-3088-4661-8cf5-aed90f7b699c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:42.334397 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8122c510-3088-4661-8cf5-aed90f7b699c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:42.350522 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122c510-3088-4661-8cf5-aed90f7b699c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:42.358629 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b999d-b316-4282-9981-c21cbc6fa500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:42.359282 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b999d-b316-4282-9981-c21cbc6fa500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:42.360156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b999d-b316-4282-9981-c21cbc6fa500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:42.360156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b999d-b316-4282-9981-c21cbc6fa500 admin admin] PATH_INFO: `/v3/users/56181965309c407c9b22ca137810bd9b` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:42.361241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b999d-b316-4282-9981-c21cbc6fa500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56181965309c407c9b22ca137810bd9b)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:42.363318 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b999d-b316-4282-9981-c21cbc6fa500 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:42.427050 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-787b999d-b316-4282-9981-c21cbc6fa500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56181965309c407c9b22ca137810bd9b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:42.435739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-787b999d-b316-4282-9981-c21cbc6fa500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56181965309c407c9b22ca137810bd9b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:42.450237 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-787b999d-b316-4282-9981-c21cbc6fa500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56181965309c407c9b22ca137810bd9b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:42.451042 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-787b999d-b316-4282-9981-c21cbc6fa500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56181965309c407c9b22ca137810bd9b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:42.459355 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-787b999d-b316-4282-9981-c21cbc6fa500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56181965309c407c9b22ca137810bd9b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:42.466387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1083/2163] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:13:42 2022] DELETE /identity/v3/users/56181965309c407c9b22ca137810bd9b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:42.470858 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9f62d-fa39-44a5-8642-f6b22f747b5e None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:42.471147 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9f62d-fa39-44a5-8642-f6b22f747b5e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:42.471424 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9f62d-fa39-44a5-8642-f6b22f747b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:42.507908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-41c9f62d-fa39-44a5-8642-f6b22f747b5e None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:42.509612 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-41c9f62d-fa39-44a5-8642-f6b22f747b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:42.616843 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:42.634162 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1081/2164] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:42.655331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b999d-b316-4282-9981-c21cbc6fa500 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:42.656952 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-787b999d-b316-4282-9981-c21cbc6fa500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:42.694109 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:42.735642 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b999d-b316-4282-9981-c21cbc6fa500 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:42.740302 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b279811-9c4a-4bb4-9b41-eabf2761629f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:42.741030 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b279811-9c4a-4bb4-9b41-eabf2761629f service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:42.741414 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b279811-9c4a-4bb4-9b41-eabf2761629f service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:42.742068 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b279811-9c4a-4bb4-9b41-eabf2761629f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:42.762060 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b279811-9c4a-4bb4-9b41-eabf2761629f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:42.766397 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b279811-9c4a-4bb4-9b41-eabf2761629f service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:42.790976 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1084/2165] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:43.168417 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9f62d-fa39-44a5-8642-f6b22f747b5e None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:43.170498 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-41c9f62d-fa39-44a5-8642-f6b22f747b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:43.241965 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9f62d-fa39-44a5-8642-f6b22f747b5e None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:43.246768 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f796100-7479-409c-952d-1024f342316e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:43.247409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f796100-7479-409c-952d-1024f342316e service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:43.247688 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f796100-7479-409c-952d-1024f342316e service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:43.247957 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f796100-7479-409c-952d-1024f342316e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:43.249751 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0f796100-7479-409c-952d-1024f342316e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:43.296733 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d44e34-a5b8-4f02-9eeb-ae36294678a3 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:43.297027 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d44e34-a5b8-4f02-9eeb-ae36294678a3 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:43.297354 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d44e34-a5b8-4f02-9eeb-ae36294678a3 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:43.301527 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1085/2166] 10.222.0.26 () {54 vars in 921 bytes} [Tue Sep 13 14:13:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:13:43.329874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f796100-7479-409c-952d-1024f342316e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:43.331661 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f796100-7479-409c-952d-1024f342316e service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:43.333881 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee574c-11d7-4ac3-8067-e1887c83216b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:43.333881 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee574c-11d7-4ac3-8067-e1887c83216b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:43.333881 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee574c-11d7-4ac3-8067-e1887c83216b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:43.363550 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1082/2167] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:43.378200 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-03ee574c-11d7-4ac3-8067-e1887c83216b None None] MFA Rules not processed for user `311397bfe2c04569852fca0cfcdbad66`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:43.385486 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-03ee574c-11d7-4ac3-8067-e1887c83216b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:43.388697 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a402da4-db6e-4f05-9a02-ad21b40cd5e3 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:43.388986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a402da4-db6e-4f05-9a02-ad21b40cd5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:43.389507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a402da4-db6e-4f05-9a02-ad21b40cd5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:43.427430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-8a402da4-db6e-4f05-9a02-ad21b40cd5e3 None None] MFA Rules not processed for user `4c0e15bafe7c4085b65eb9f1e7fe7aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:43.428778 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8a402da4-db6e-4f05-9a02-ad21b40cd5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:43.498451 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1086/2168] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Sep 13 14:13:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:43.499616 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee574c-11d7-4ac3-8067-e1887c83216b None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:43.501235 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-03ee574c-11d7-4ac3-8067-e1887c83216b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:43.508771 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1083/2169] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:13:43.518887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a402da4-db6e-4f05-9a02-ad21b40cd5e3 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:43.520524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8a402da4-db6e-4f05-9a02-ad21b40cd5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:43.522756 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee574c-11d7-4ac3-8067-e1887c83216b None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:43.535326 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cfec8-5a48-4a86-bd18-28ded80d83ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:43.535982 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cfec8-5a48-4a86-bd18-28ded80d83ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:43.536262 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cfec8-5a48-4a86-bd18-28ded80d83ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:43.536537 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cfec8-5a48-4a86-bd18-28ded80d83ca admin admin] PATH_INFO: `/v3/users/d80c0ee007b24a22b08e91ef863d330b` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:43.538369 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a402da4-db6e-4f05-9a02-ad21b40cd5e3 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:43.539024 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cfec8-5a48-4a86-bd18-28ded80d83ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=d80c0ee007b24a22b08e91ef863d330b)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:43.541714 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cfec8-5a48-4a86-bd18-28ded80d83ca admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:43.545327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3b2d3-cd8a-4caf-8f75-f00d5c167db8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311397bfe2c04569852fca0cfcdbad66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:43.549268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3b2d3-cd8a-4caf-8f75-f00d5c167db8 service placement] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:43.549268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3b2d3-cd8a-4caf-8f75-f00d5c167db8 service placement] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:43.549268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3b2d3-cd8a-4caf-8f75-f00d5c167db8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:43.565569 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3b2d3-cd8a-4caf-8f75-f00d5c167db8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:43.567745 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3b2d3-cd8a-4caf-8f75-f00d5c167db8 service placement] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:43.592562 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1084/2170] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:43.593764 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3b2d3-cd8a-4caf-8f75-f00d5c167db8 service placement] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:43.598873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-feb3b2d3-cd8a-4caf-8f75-f00d5c167db8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:43.632201 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3b2d3-cd8a-4caf-8f75-f00d5c167db8 service placement] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:43.639811 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15b501-5f7e-40da-ba5a-4bd9c1c5da21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:43.640579 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15b501-5f7e-40da-ba5a-4bd9c1c5da21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:43.641083 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15b501-5f7e-40da-ba5a-4bd9c1c5da21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:43.641686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15b501-5f7e-40da-ba5a-4bd9c1c5da21 admin admin] PATH_INFO: `/v3/projects/d52398c40f3f4b9eb7be83d5930733f4` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:43.642680 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15b501-5f7e-40da-ba5a-4bd9c1c5da21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d52398c40f3f4b9eb7be83d5930733f4)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:43.643327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-371cfec8-5a48-4a86-bd18-28ded80d83ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd80c0ee007b24a22b08e91ef863d330b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:43.644609 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15b501-5f7e-40da-ba5a-4bd9c1c5da21 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:43.653090 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-371cfec8-5a48-4a86-bd18-28ded80d83ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd80c0ee007b24a22b08e91ef863d330b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:43.669218 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-371cfec8-5a48-4a86-bd18-28ded80d83ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd80c0ee007b24a22b08e91ef863d330b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:43.672235 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-371cfec8-5a48-4a86-bd18-28ded80d83ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd80c0ee007b24a22b08e91ef863d330b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:43.683602 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-371cfec8-5a48-4a86-bd18-28ded80d83ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd80c0ee007b24a22b08e91ef863d330b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:43.691232 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1087/2171] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:13:43 2022] DELETE /identity/v3/users/d80c0ee007b24a22b08e91ef863d330b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:43.694338 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:43.711951 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-9e15b501-5f7e-40da-ba5a-4bd9c1c5da21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd52398c40f3f4b9eb7be83d5930733f4', 'request_id': 'req-9e15b501-5f7e-40da-ba5a-4bd9c1c5da21'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:43.724985 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-9e15b501-5f7e-40da-ba5a-4bd9c1c5da21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd52398c40f3f4b9eb7be83d5930733f4', 'request_id': 'req-9e15b501-5f7e-40da-ba5a-4bd9c1c5da21'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:43.732863 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-9e15b501-5f7e-40da-ba5a-4bd9c1c5da21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd52398c40f3f4b9eb7be83d5930733f4', 'request_id': 'req-9e15b501-5f7e-40da-ba5a-4bd9c1c5da21'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:43.745986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-9e15b501-5f7e-40da-ba5a-4bd9c1c5da21 admin admin] The token cache is being invalidate because project d52398c40f3f4b9eb7be83d5930733f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:43.746305 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-9e15b501-5f7e-40da-ba5a-4bd9c1c5da21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:43.746961 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-9e15b501-5f7e-40da-ba5a-4bd9c1c5da21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:43.749075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1085/2172] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:43 2022] DELETE /identity/v3/projects/d52398c40f3f4b9eb7be83d5930733f4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:44.047907 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cfec8-5a48-4a86-bd18-28ded80d83ca admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:44.049361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-371cfec8-5a48-4a86-bd18-28ded80d83ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:44.100934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:44.137376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cfec8-5a48-4a86-bd18-28ded80d83ca admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:44.143311 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b419b-b95b-4344-bcdd-b9bac236e581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:44.143992 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b419b-b95b-4344-bcdd-b9bac236e581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:44.144272 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b419b-b95b-4344-bcdd-b9bac236e581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:44.144542 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b419b-b95b-4344-bcdd-b9bac236e581 admin admin] PATH_INFO: `/v3/projects/a23107977116428c99ac940373c1a3f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:44.145793 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b419b-b95b-4344-bcdd-b9bac236e581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a23107977116428c99ac940373c1a3f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:44.147621 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b419b-b95b-4344-bcdd-b9bac236e581 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:44.216952 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-490b419b-b95b-4344-bcdd-b9bac236e581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a23107977116428c99ac940373c1a3f2', 'request_id': 'req-490b419b-b95b-4344-bcdd-b9bac236e581'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:44.225309 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-490b419b-b95b-4344-bcdd-b9bac236e581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a23107977116428c99ac940373c1a3f2', 'request_id': 'req-490b419b-b95b-4344-bcdd-b9bac236e581'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:44.242871 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-490b419b-b95b-4344-bcdd-b9bac236e581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a23107977116428c99ac940373c1a3f2', 'request_id': 'req-490b419b-b95b-4344-bcdd-b9bac236e581'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:44.270662 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-490b419b-b95b-4344-bcdd-b9bac236e581 admin admin] The token cache is being invalidate because project a23107977116428c99ac940373c1a3f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:44.273515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-490b419b-b95b-4344-bcdd-b9bac236e581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:44.279453 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-490b419b-b95b-4344-bcdd-b9bac236e581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:44.281495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1088/2173] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:44 2022] DELETE /identity/v3/projects/a23107977116428c99ac940373c1a3f2 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:44.295295 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842d836-9391-47fd-b3a6-dc6f445db48e None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:44.296094 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842d836-9391-47fd-b3a6-dc6f445db48e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:44.296515 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842d836-9391-47fd-b3a6-dc6f445db48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:44.328261 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-c842d836-9391-47fd-b3a6-dc6f445db48e None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:44.329580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c842d836-9391-47fd-b3a6-dc6f445db48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:44.421657 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1086/2174] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:44.429909 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c2a6b-452a-42a1-b5f5-05838685e692 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:44.430417 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c2a6b-452a-42a1-b5f5-05838685e692 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:44.430975 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c2a6b-452a-42a1-b5f5-05838685e692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:44.466107 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e05c2a6b-452a-42a1-b5f5-05838685e692 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:44.467904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e05c2a6b-452a-42a1-b5f5-05838685e692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:44.500056 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1089/2175] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:44.503551 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842d836-9391-47fd-b3a6-dc6f445db48e None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:44.519386 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842d836-9391-47fd-b3a6-dc6f445db48e None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:44.531026 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6e969-681a-46e9-8bf6-146b6c3eb54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:44.531790 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6e969-681a-46e9-8bf6-146b6c3eb54f admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:44.532189 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6e969-681a-46e9-8bf6-146b6c3eb54f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:44.532725 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6e969-681a-46e9-8bf6-146b6c3eb54f admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:44.533523 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6e969-681a-46e9-8bf6-146b6c3eb54f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:13:44.535297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6e969-681a-46e9-8bf6-146b6c3eb54f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:44.537595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6e969-681a-46e9-8bf6-146b6c3eb54f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:44.562116 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1087/2176] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:13:44.566999 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c2a6b-452a-42a1-b5f5-05838685e692 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:44.578006 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c2a6b-452a-42a1-b5f5-05838685e692 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:44.588592 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8643b0-ea42-4cf3-af53-57244da3efbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:44.589932 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8643b0-ea42-4cf3-af53-57244da3efbe admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:44.589932 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8643b0-ea42-4cf3-af53-57244da3efbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:44.589932 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8643b0-ea42-4cf3-af53-57244da3efbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:44.590952 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8643b0-ea42-4cf3-af53-57244da3efbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:44.593154 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8643b0-ea42-4cf3-af53-57244da3efbe admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:44.655808 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1090/2177] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:44 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:44.659973 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6e969-681a-46e9-8bf6-146b6c3eb54f admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:44.670321 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6e969-681a-46e9-8bf6-146b6c3eb54f admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:44.766942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb4f67-2e53-47bb-956e-d6165e38e63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:44.768929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb4f67-2e53-47bb-956e-d6165e38e63e admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:44.768929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb4f67-2e53-47bb-956e-d6165e38e63e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:44.768929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb4f67-2e53-47bb-956e-d6165e38e63e admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:44.769295 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb4f67-2e53-47bb-956e-d6165e38e63e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:44.773990 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb4f67-2e53-47bb-956e-d6165e38e63e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:44.799175 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1088/2178] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:44 2022] POST /identity/v3/users => generated 287 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:13:44.804135 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8643b0-ea42-4cf3-af53-57244da3efbe admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:44.816040 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8643b0-ea42-4cf3-af53-57244da3efbe admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:44.820888 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2931d3-db67-4f48-86ea-d140f6ff4a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:44.821615 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2931d3-db67-4f48-86ea-d140f6ff4a82 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:44.821966 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2931d3-db67-4f48-86ea-d140f6ff4a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:44.822397 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2931d3-db67-4f48-86ea-d140f6ff4a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:44.823778 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2931d3-db67-4f48-86ea-d140f6ff4a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:44.825463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2931d3-db67-4f48-86ea-d140f6ff4a82 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:44.836883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1091/2179] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:44.840983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb4f67-2e53-47bb-956e-d6165e38e63e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:44.852965 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb4f67-2e53-47bb-956e-d6165e38e63e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:44.859111 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c39ef-f906-47cb-b8ad-836840c6ca75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:44.859714 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c39ef-f906-47cb-b8ad-836840c6ca75 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:44.859994 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c39ef-f906-47cb-b8ad-836840c6ca75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:44.860263 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c39ef-f906-47cb-b8ad-836840c6ca75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:44.860904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c39ef-f906-47cb-b8ad-836840c6ca75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:44.862580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c39ef-f906-47cb-b8ad-836840c6ca75 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:44.875768 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1089/2180] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:44.880051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2931d3-db67-4f48-86ea-d140f6ff4a82 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:44.890807 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2931d3-db67-4f48-86ea-d140f6ff4a82 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:44.895717 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4d2e5-4c69-47af-a705-4f1f1a31c8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:44.896367 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4d2e5-4c69-47af-a705-4f1f1a31c8d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:44.896648 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4d2e5-4c69-47af-a705-4f1f1a31c8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:44.896924 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4d2e5-4c69-47af-a705-4f1f1a31c8d4 admin admin] PATH_INFO: `/v3/projects/018a6d4afbf14a329fe3c6f190c5de41/users/6a4da3366c2749e3831744df38bcd896/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:44.911726 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4d2e5-4c69-47af-a705-4f1f1a31c8d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=018a6d4afbf14a329fe3c6f190c5de41, user_id=6a4da3366c2749e3831744df38bcd896, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:44.914433 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4d2e5-4c69-47af-a705-4f1f1a31c8d4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:44.927412 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1092/2181] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:44 2022] PUT /identity/v3/projects/018a6d4afbf14a329fe3c6f190c5de41/users/6a4da3366c2749e3831744df38bcd896/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:13:44.938111 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9b255-0b45-4257-9a59-a21eff101272 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:44.938396 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9b255-0b45-4257-9a59-a21eff101272 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:44.938697 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9b255-0b45-4257-9a59-a21eff101272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:44.966085 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-d8d9b255-0b45-4257-9a59-a21eff101272 None None] MFA Rules not processed for user `6a4da3366c2749e3831744df38bcd896`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:44.967309 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d8d9b255-0b45-4257-9a59-a21eff101272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:44.984137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:45.038444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1090/2182] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:45.043292 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4d2e5-4c69-47af-a705-4f1f1a31c8d4 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:45.107445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4d2e5-4c69-47af-a705-4f1f1a31c8d4 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:45.112678 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7955699-4cc3-480b-be90-be08374dfa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:45.112903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7955699-4cc3-480b-be90-be08374dfa15 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:45.113257 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7955699-4cc3-480b-be90-be08374dfa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:45.113566 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7955699-4cc3-480b-be90-be08374dfa15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:45.114279 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7955699-4cc3-480b-be90-be08374dfa15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:45.116264 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7955699-4cc3-480b-be90-be08374dfa15 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:45.126467 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:45.146791 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1093/2183] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:45 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:45.151977 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9b255-0b45-4257-9a59-a21eff101272 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:45.163267 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9b255-0b45-4257-9a59-a21eff101272 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:45.221575 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d758d2-3e86-484e-81e7-ac9d6161994e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:45.222228 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d758d2-3e86-484e-81e7-ac9d6161994e admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:45.222508 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d758d2-3e86-484e-81e7-ac9d6161994e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:45.222814 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d758d2-3e86-484e-81e7-ac9d6161994e admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:45.223433 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d758d2-3e86-484e-81e7-ac9d6161994e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:45.225495 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d758d2-3e86-484e-81e7-ac9d6161994e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:45.247346 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1091/2184] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:45 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:45.251535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7955699-4cc3-480b-be90-be08374dfa15 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:45.262476 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7955699-4cc3-480b-be90-be08374dfa15 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:45.267060 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083d2a1-419e-47bc-907f-dfa013d9ea66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:45.267644 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083d2a1-419e-47bc-907f-dfa013d9ea66 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:45.267917 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083d2a1-419e-47bc-907f-dfa013d9ea66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:45.268184 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083d2a1-419e-47bc-907f-dfa013d9ea66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:45.268820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083d2a1-419e-47bc-907f-dfa013d9ea66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:45.270447 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083d2a1-419e-47bc-907f-dfa013d9ea66 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:45.280497 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1094/2185] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:45.284429 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d758d2-3e86-484e-81e7-ac9d6161994e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:45.294427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d758d2-3e86-484e-81e7-ac9d6161994e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:45.299075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc945c00-bec8-43c2-aba0-16558de726c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:45.299759 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc945c00-bec8-43c2-aba0-16558de726c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:45.300034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc945c00-bec8-43c2-aba0-16558de726c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:45.300301 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc945c00-bec8-43c2-aba0-16558de726c1 admin admin] PATH_INFO: `/v3/projects/85c8360870464177b20f4dba9f2355a1/users/bd8f79c54e3e4536a09f2abb9d6ed336/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:45.316452 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc945c00-bec8-43c2-aba0-16558de726c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c8360870464177b20f4dba9f2355a1, user_id=bd8f79c54e3e4536a09f2abb9d6ed336, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:45.319131 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc945c00-bec8-43c2-aba0-16558de726c1 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:45.332822 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1092/2186] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:45 2022] PUT /identity/v3/projects/85c8360870464177b20f4dba9f2355a1/users/bd8f79c54e3e4536a09f2abb9d6ed336/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:45.336783 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083d2a1-419e-47bc-907f-dfa013d9ea66 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:45.346969 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083d2a1-419e-47bc-907f-dfa013d9ea66 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:45.409230 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb65a2-3500-47f7-834c-b73ee1f23f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:45.409843 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb65a2-3500-47f7-834c-b73ee1f23f66 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:45.410123 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb65a2-3500-47f7-834c-b73ee1f23f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:45.410411 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb65a2-3500-47f7-834c-b73ee1f23f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:45.411055 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb65a2-3500-47f7-834c-b73ee1f23f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:45.412656 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb65a2-3500-47f7-834c-b73ee1f23f66 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:45.422818 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1095/2187] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:45.427038 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc945c00-bec8-43c2-aba0-16558de726c1 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:45.437873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc945c00-bec8-43c2-aba0-16558de726c1 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:45.442649 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598d5ea-cf0c-422a-b7da-419131a8cbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:45.443310 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598d5ea-cf0c-422a-b7da-419131a8cbc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:45.443585 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598d5ea-cf0c-422a-b7da-419131a8cbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:45.443867 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598d5ea-cf0c-422a-b7da-419131a8cbc8 admin admin] PATH_INFO: `/v3/projects/85c8360870464177b20f4dba9f2355a1/users/bd8f79c54e3e4536a09f2abb9d6ed336/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:45.445839 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598d5ea-cf0c-422a-b7da-419131a8cbc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c8360870464177b20f4dba9f2355a1, user_id=bd8f79c54e3e4536a09f2abb9d6ed336, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:45.449016 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598d5ea-cf0c-422a-b7da-419131a8cbc8 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:45.462794 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1093/2188] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:45 2022] PUT /identity/v3/projects/85c8360870464177b20f4dba9f2355a1/users/bd8f79c54e3e4536a09f2abb9d6ed336/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:45.474459 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389a042-d8cb-4f1b-849d-8483d7ce043b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:45.474852 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389a042-d8cb-4f1b-849d-8483d7ce043b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:45.475202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389a042-d8cb-4f1b-849d-8483d7ce043b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:45.504069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-6389a042-d8cb-4f1b-849d-8483d7ce043b None None] MFA Rules not processed for user `bd8f79c54e3e4536a09f2abb9d6ed336`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:45.505297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6389a042-d8cb-4f1b-849d-8483d7ce043b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:45.572724 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1096/2189] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:45.584199 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598d5ea-cf0c-422a-b7da-419131a8cbc8 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:45.585911 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-9598d5ea-cf0c-422a-b7da-419131a8cbc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:45.646916 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598d5ea-cf0c-422a-b7da-419131a8cbc8 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:45.650513 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd75c0-e648-45e1-a4c5-3f97f0a80a6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:45.651680 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd75c0-e648-45e1-a4c5-3f97f0a80a6e service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:45.651966 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd75c0-e648-45e1-a4c5-3f97f0a80a6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:45.652230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd75c0-e648-45e1-a4c5-3f97f0a80a6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:45.662373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd75c0-e648-45e1-a4c5-3f97f0a80a6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:45.664216 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd75c0-e648-45e1-a4c5-3f97f0a80a6e service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:45.675020 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1094/2190] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:45.752798 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389a042-d8cb-4f1b-849d-8483d7ce043b None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:45.765183 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389a042-d8cb-4f1b-849d-8483d7ce043b None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:45.768907 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff006a-ad99-4a61-9815-073b4d97dfa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:45.769652 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff006a-ad99-4a61-9815-073b4d97dfa2 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:45.770006 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff006a-ad99-4a61-9815-073b4d97dfa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:45.770282 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff006a-ad99-4a61-9815-073b4d97dfa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:45.850282 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff006a-ad99-4a61-9815-073b4d97dfa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:45.852370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff006a-ad99-4a61-9815-073b4d97dfa2 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:45.856630 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:45.863763 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1097/2191] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:50.636992 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd75c0-e648-45e1-a4c5-3f97f0a80a6e service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:50.638504 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-33fd75c0-e648-45e1-a4c5-3f97f0a80a6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:50.652912 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:50.706860 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd75c0-e648-45e1-a4c5-3f97f0a80a6e service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:50.711602 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf43637-f8d2-43c1-9e35-b9b5e13c1196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:50.712225 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf43637-f8d2-43c1-9e35-b9b5e13c1196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:50.712503 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf43637-f8d2-43c1-9e35-b9b5e13c1196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:50.712777 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf43637-f8d2-43c1-9e35-b9b5e13c1196 admin admin] PATH_INFO: `/v3/users/37b66ff326764749bd34e49e6fa004e5` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:50.714442 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf43637-f8d2-43c1-9e35-b9b5e13c1196 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37b66ff326764749bd34e49e6fa004e5)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:50.716348 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf43637-f8d2-43c1-9e35-b9b5e13c1196 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:50.765335 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-faf43637-f8d2-43c1-9e35-b9b5e13c1196 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37b66ff326764749bd34e49e6fa004e5'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:50.773613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-faf43637-f8d2-43c1-9e35-b9b5e13c1196 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37b66ff326764749bd34e49e6fa004e5'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:50.788294 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-faf43637-f8d2-43c1-9e35-b9b5e13c1196 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37b66ff326764749bd34e49e6fa004e5'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:50.788998 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-faf43637-f8d2-43c1-9e35-b9b5e13c1196 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37b66ff326764749bd34e49e6fa004e5'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:50.797406 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-faf43637-f8d2-43c1-9e35-b9b5e13c1196 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37b66ff326764749bd34e49e6fa004e5'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:50.804128 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1095/2192] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:13:50 2022] DELETE /identity/v3/users/37b66ff326764749bd34e49e6fa004e5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:50.809470 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea74e8-a660-4ebd-b2f5-bebb48208a5e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:50.809470 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea74e8-a660-4ebd-b2f5-bebb48208a5e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:50.809470 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea74e8-a660-4ebd-b2f5-bebb48208a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:50.839192 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-37ea74e8-a660-4ebd-b2f5-bebb48208a5e None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:50.840493 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-37ea74e8-a660-4ebd-b2f5-bebb48208a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:50.903646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1098/2193] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:13:50.913833 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf43637-f8d2-43c1-9e35-b9b5e13c1196 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:50.915240 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-faf43637-f8d2-43c1-9e35-b9b5e13c1196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:50.978592 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf43637-f8d2-43c1-9e35-b9b5e13c1196 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:50.982506 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57462d-af99-46b2-8f20-f52361c74df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:50.983140 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57462d-af99-46b2-8f20-f52361c74df4 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:50.983419 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57462d-af99-46b2-8f20-f52361c74df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:50.983715 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57462d-af99-46b2-8f20-f52361c74df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:50.992705 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57462d-af99-46b2-8f20-f52361c74df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:50.994175 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57462d-af99-46b2-8f20-f52361c74df4 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:51.004446 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1096/2194] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:51.378905 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea74e8-a660-4ebd-b2f5-bebb48208a5e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:51.380430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-37ea74e8-a660-4ebd-b2f5-bebb48208a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:51.393348 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea74e8-a660-4ebd-b2f5-bebb48208a5e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:51.398597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961b5b0-3171-4177-9c21-24bb7ebdfae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:51.398785 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961b5b0-3171-4177-9c21-24bb7ebdfae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:51.399058 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961b5b0-3171-4177-9c21-24bb7ebdfae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:51.399315 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961b5b0-3171-4177-9c21-24bb7ebdfae3 admin admin] PATH_INFO: `/v3/projects/1316b7812854401db1f79291e7d43214` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:51.400430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961b5b0-3171-4177-9c21-24bb7ebdfae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1316b7812854401db1f79291e7d43214)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:51.402423 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961b5b0-3171-4177-9c21-24bb7ebdfae3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:51.463943 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8961b5b0-3171-4177-9c21-24bb7ebdfae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1316b7812854401db1f79291e7d43214', 'request_id': 'req-8961b5b0-3171-4177-9c21-24bb7ebdfae3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:51.471241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8961b5b0-3171-4177-9c21-24bb7ebdfae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1316b7812854401db1f79291e7d43214', 'request_id': 'req-8961b5b0-3171-4177-9c21-24bb7ebdfae3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:51.479015 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8961b5b0-3171-4177-9c21-24bb7ebdfae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1316b7812854401db1f79291e7d43214', 'request_id': 'req-8961b5b0-3171-4177-9c21-24bb7ebdfae3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:51.490264 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8961b5b0-3171-4177-9c21-24bb7ebdfae3 admin admin] The token cache is being invalidate because project 1316b7812854401db1f79291e7d43214 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:13:51.490552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8961b5b0-3171-4177-9c21-24bb7ebdfae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:51.491210 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8961b5b0-3171-4177-9c21-24bb7ebdfae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:13:51.492695 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1099/2195] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:13:51 2022] DELETE /identity/v3/projects/1316b7812854401db1f79291e7d43214 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:13:51.498137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476f2e4-f6c3-4297-aa74-5a7e2af05d38 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:51.498449 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476f2e4-f6c3-4297-aa74-5a7e2af05d38 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:51.498719 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476f2e4-f6c3-4297-aa74-5a7e2af05d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:51.521223 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-a476f2e4-f6c3-4297-aa74-5a7e2af05d38 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:51.522455 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a476f2e4-f6c3-4297-aa74-5a7e2af05d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:51.553764 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:51.585986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1097/2196] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:51.594042 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de736c5c-446d-4bd9-9d04-2b1c4314e681 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:51.594329 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de736c5c-446d-4bd9-9d04-2b1c4314e681 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:51.594598 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de736c5c-446d-4bd9-9d04-2b1c4314e681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:51.614318 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-de736c5c-446d-4bd9-9d04-2b1c4314e681 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:51.623310 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-de736c5c-446d-4bd9-9d04-2b1c4314e681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:51.627575 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1100/2197] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:51.631833 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476f2e4-f6c3-4297-aa74-5a7e2af05d38 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:51.642343 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476f2e4-f6c3-4297-aa74-5a7e2af05d38 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:51.646921 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886736ca-5f24-4881-9402-04ce872d7eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:51.647540 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886736ca-5f24-4881-9402-04ce872d7eef admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:51.647816 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886736ca-5f24-4881-9402-04ce872d7eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:51.648084 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886736ca-5f24-4881-9402-04ce872d7eef admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:51.648728 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886736ca-5f24-4881-9402-04ce872d7eef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:13:51.649046 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886736ca-5f24-4881-9402-04ce872d7eef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:51.650665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886736ca-5f24-4881-9402-04ce872d7eef admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:51.662904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1098/2198] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:13:51.670536 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de736c5c-446d-4bd9-9d04-2b1c4314e681 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:51.680210 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de736c5c-446d-4bd9-9d04-2b1c4314e681 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:51.685716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84dbccb-a323-42e0-b52a-e7b577e0987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:51.686325 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dbccb-a323-42e0-b52a-e7b577e0987b admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:51.686606 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dbccb-a323-42e0-b52a-e7b577e0987b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:51.686858 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dbccb-a323-42e0-b52a-e7b577e0987b admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:51.687486 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84dbccb-a323-42e0-b52a-e7b577e0987b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:51.689470 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84dbccb-a323-42e0-b52a-e7b577e0987b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:51.721437 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1101/2199] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:13:51 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:51.724734 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886736ca-5f24-4881-9402-04ce872d7eef admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:51.734928 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886736ca-5f24-4881-9402-04ce872d7eef admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:51.794171 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8073e2-b9b7-4e29-9226-dcdcdd6733ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:51.794768 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8073e2-b9b7-4e29-9226-dcdcdd6733ac admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:51.795043 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8073e2-b9b7-4e29-9226-dcdcdd6733ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:51.795314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8073e2-b9b7-4e29-9226-dcdcdd6733ac admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:51.795922 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8073e2-b9b7-4e29-9226-dcdcdd6733ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:51.797859 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8073e2-b9b7-4e29-9226-dcdcdd6733ac admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:51.822427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1099/2200] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:13:51 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:13:51.824333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84dbccb-a323-42e0-b52a-e7b577e0987b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:51.837852 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84dbccb-a323-42e0-b52a-e7b577e0987b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:51.843311 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c9146-0ad8-4eca-98ae-7f49fbe33b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:51.844012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c9146-0ad8-4eca-98ae-7f49fbe33b82 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:51.844358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c9146-0ad8-4eca-98ae-7f49fbe33b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:51.844699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c9146-0ad8-4eca-98ae-7f49fbe33b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:51.845468 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c9146-0ad8-4eca-98ae-7f49fbe33b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:51.847349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c9146-0ad8-4eca-98ae-7f49fbe33b82 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:51.858965 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1102/2201] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:13:51.862939 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8073e2-b9b7-4e29-9226-dcdcdd6733ac admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:51.878480 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8073e2-b9b7-4e29-9226-dcdcdd6733ac admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:51.885083 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bcded9-0dec-40c6-8faf-d644cf54052a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:51.885848 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcded9-0dec-40c6-8faf-d644cf54052a admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:51.886198 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcded9-0dec-40c6-8faf-d644cf54052a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:51.886543 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcded9-0dec-40c6-8faf-d644cf54052a admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:51.887370 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bcded9-0dec-40c6-8faf-d644cf54052a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:51.889136 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bcded9-0dec-40c6-8faf-d644cf54052a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:51.904701 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1100/2202] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:13:51.905489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c9146-0ad8-4eca-98ae-7f49fbe33b82 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:51.920967 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c9146-0ad8-4eca-98ae-7f49fbe33b82 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:51.925809 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccd2ad-c62c-4b70-a55b-6b1768ed8009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:51.926456 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccd2ad-c62c-4b70-a55b-6b1768ed8009 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:51.926732 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccd2ad-c62c-4b70-a55b-6b1768ed8009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:51.927002 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccd2ad-c62c-4b70-a55b-6b1768ed8009 admin admin] PATH_INFO: `/v3/projects/ee75c4ccbd914216aed02d1b289fb727/users/33d7e0d80ad14191ab2f7f386d4c7ac3/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:51.945668 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daccd2ad-c62c-4b70-a55b-6b1768ed8009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee75c4ccbd914216aed02d1b289fb727, user_id=33d7e0d80ad14191ab2f7f386d4c7ac3, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:51.948893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daccd2ad-c62c-4b70-a55b-6b1768ed8009 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:51.961932 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1103/2203] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:13:51 2022] PUT /identity/v3/projects/ee75c4ccbd914216aed02d1b289fb727/users/33d7e0d80ad14191ab2f7f386d4c7ac3/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:13:51.967255 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2decf3-fdf9-4472-a89a-1f6d84756cf8 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:51.967539 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2decf3-fdf9-4472-a89a-1f6d84756cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:51.967839 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2decf3-fdf9-4472-a89a-1f6d84756cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:51.989879 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-cd2decf3-fdf9-4472-a89a-1f6d84756cf8 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:51.991087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-cd2decf3-fdf9-4472-a89a-1f6d84756cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:52.062636 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1101/2204] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:13:52.072293 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccd2ad-c62c-4b70-a55b-6b1768ed8009 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:52.074207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-daccd2ad-c62c-4b70-a55b-6b1768ed8009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:52.099328 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:52.144655 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccd2ad-c62c-4b70-a55b-6b1768ed8009 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:52.150062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64556321-5134-42bb-b520-d5443945bbe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:52.151373 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64556321-5134-42bb-b520-d5443945bbe0 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:52.152693 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64556321-5134-42bb-b520-d5443945bbe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:52.152693 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64556321-5134-42bb-b520-d5443945bbe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:52.169785 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64556321-5134-42bb-b520-d5443945bbe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:52.171874 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64556321-5134-42bb-b520-d5443945bbe0 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:52.185638 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1104/2205] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 14:13:53.081761 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd59f23-dcc7-4459-8827-1524fbbbcffd None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:53.082392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd59f23-dcc7-4459-8827-1524fbbbcffd None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:53.082392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd59f23-dcc7-4459-8827-1524fbbbcffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:53.116924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-0bd59f23-dcc7-4459-8827-1524fbbbcffd None None] MFA Rules not processed for user `33d7e0d80ad14191ab2f7f386d4c7ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:53.119127 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0bd59f23-dcc7-4459-8827-1524fbbbcffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:53.160891 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:53.204962 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1102/2206] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:13:53.225550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64556321-5134-42bb-b520-d5443945bbe0 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:13:53.227167 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-64556321-5134-42bb-b520-d5443945bbe0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:53.310857 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64556321-5134-42bb-b520-d5443945bbe0 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:13:53.315887 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f7be0-ec4d-4b20-8fc9-e4a6b3652b50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:13:53.316492 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f7be0-ec4d-4b20-8fc9-e4a6b3652b50 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:53.316766 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f7be0-ec4d-4b20-8fc9-e4a6b3652b50 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:53.317033 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f7be0-ec4d-4b20-8fc9-e4a6b3652b50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:53.330144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f7be0-ec4d-4b20-8fc9-e4a6b3652b50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:13:53.331829 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f7be0-ec4d-4b20-8fc9-e4a6b3652b50 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:13:53.343446 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1105/2207] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:13:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:13:54.749195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee76c09-69bc-4ac0-bad4-62bc3b0bc2ca None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:13:54.749729 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee76c09-69bc-4ac0-bad4-62bc3b0bc2ca None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:13:54.749982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee76c09-69bc-4ac0-bad4-62bc3b0bc2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:13:54.777572 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-dee76c09-69bc-4ac0-bad4-62bc3b0bc2ca None None] MFA Rules not processed for user `33d7e0d80ad14191ab2f7f386d4c7ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:13:54.778796 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-dee76c09-69bc-4ac0-bad4-62bc3b0bc2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:13:54.787182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1103/2208] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:13:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:03.338150 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=44 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:04.766276 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=16 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:05.420404 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c567639-a6d5-4658-9814-7682fd7dd466 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:05.421239 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c567639-a6d5-4658-9814-7682fd7dd466 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:05.421544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c567639-a6d5-4658-9814-7682fd7dd466 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:05.422939 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1106/2209] 10.222.0.26 () {54 vars in 921 bytes} [Tue Sep 13 14:14:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:14:05.433321 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc8d23-ed1e-4c89-ba88-01e85ddb74ae None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:05.433630 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc8d23-ed1e-4c89-ba88-01e85ddb74ae None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:05.433927 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc8d23-ed1e-4c89-ba88-01e85ddb74ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:05.455601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-bfdc8d23-ed1e-4c89-ba88-01e85ddb74ae None None] MFA Rules not processed for user `311397bfe2c04569852fca0cfcdbad66`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:05.456811 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-bfdc8d23-ed1e-4c89-ba88-01e85ddb74ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:05.534466 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1104/2210] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Sep 13 14:14:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:14:05.545655 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c567639-a6d5-4658-9814-7682fd7dd466 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:05.547435 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8c567639-a6d5-4658-9814-7682fd7dd466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:05.570413 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c567639-a6d5-4658-9814-7682fd7dd466 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:05.578067 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c763d-2e7a-4e7c-83c8-789922901438 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311397bfe2c04569852fca0cfcdbad66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:05.579001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c763d-2e7a-4e7c-83c8-789922901438 service placement] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:05.579287 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c763d-2e7a-4e7c-83c8-789922901438 service placement] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:05.579565 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c763d-2e7a-4e7c-83c8-789922901438 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:05.592299 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c763d-2e7a-4e7c-83c8-789922901438 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:05.594754 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c763d-2e7a-4e7c-83c8-789922901438 service placement] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:05.605964 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1107/2211] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:14:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:14:06.148304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc8d23-ed1e-4c89-ba88-01e85ddb74ae None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:06.149801 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-bfdc8d23-ed1e-4c89-ba88-01e85ddb74ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:06.168739 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc8d23-ed1e-4c89-ba88-01e85ddb74ae None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:06.173917 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9bae5b-6a11-4ed8-aca3-a1d8c949d8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:06.174687 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9bae5b-6a11-4ed8-aca3-a1d8c949d8ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:06.174987 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9bae5b-6a11-4ed8-aca3-a1d8c949d8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:06.175259 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9bae5b-6a11-4ed8-aca3-a1d8c949d8ad admin admin] PATH_INFO: `/v3/users/aa789671903f4df881155468680b5a31` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:06.176522 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9bae5b-6a11-4ed8-aca3-a1d8c949d8ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa789671903f4df881155468680b5a31)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:06.178731 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9bae5b-6a11-4ed8-aca3-a1d8c949d8ad admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:06.233607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2a9bae5b-6a11-4ed8-aca3-a1d8c949d8ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa789671903f4df881155468680b5a31'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:06.244368 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2a9bae5b-6a11-4ed8-aca3-a1d8c949d8ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa789671903f4df881155468680b5a31'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:06.257783 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2a9bae5b-6a11-4ed8-aca3-a1d8c949d8ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa789671903f4df881155468680b5a31'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:06.258491 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2a9bae5b-6a11-4ed8-aca3-a1d8c949d8ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa789671903f4df881155468680b5a31'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:06.266483 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2a9bae5b-6a11-4ed8-aca3-a1d8c949d8ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa789671903f4df881155468680b5a31'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:06.273717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1105/2212] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:14:06 2022] DELETE /identity/v3/users/aa789671903f4df881155468680b5a31 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:14:06.481050 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c763d-2e7a-4e7c-83c8-789922901438 service placement] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:06.497626 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c763d-2e7a-4e7c-83c8-789922901438 service placement] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:06.573933 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a293c58-ee77-4c54-bb3c-68fa0ea113ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:06.574583 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a293c58-ee77-4c54-bb3c-68fa0ea113ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:06.574866 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a293c58-ee77-4c54-bb3c-68fa0ea113ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:06.575140 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a293c58-ee77-4c54-bb3c-68fa0ea113ba admin admin] PATH_INFO: `/v3/projects/1583fce8ce0849b68b997fd2a3bce2be` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:06.577180 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a293c58-ee77-4c54-bb3c-68fa0ea113ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=1583fce8ce0849b68b997fd2a3bce2be)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:06.580306 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a293c58-ee77-4c54-bb3c-68fa0ea113ba admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:06.665291 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1a293c58-ee77-4c54-bb3c-68fa0ea113ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1583fce8ce0849b68b997fd2a3bce2be', 'request_id': 'req-1a293c58-ee77-4c54-bb3c-68fa0ea113ba'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:06.673401 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1a293c58-ee77-4c54-bb3c-68fa0ea113ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1583fce8ce0849b68b997fd2a3bce2be', 'request_id': 'req-1a293c58-ee77-4c54-bb3c-68fa0ea113ba'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:06.689164 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1a293c58-ee77-4c54-bb3c-68fa0ea113ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1583fce8ce0849b68b997fd2a3bce2be', 'request_id': 'req-1a293c58-ee77-4c54-bb3c-68fa0ea113ba'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:06.701298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1a293c58-ee77-4c54-bb3c-68fa0ea113ba admin admin] The token cache is being invalidate because project 1583fce8ce0849b68b997fd2a3bce2be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:14:06.701760 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1a293c58-ee77-4c54-bb3c-68fa0ea113ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:06.702443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1a293c58-ee77-4c54-bb3c-68fa0ea113ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:06.704247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1108/2213] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:14:06 2022] DELETE /identity/v3/projects/1583fce8ce0849b68b997fd2a3bce2be => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:14:06.710957 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9bae5b-6a11-4ed8-aca3-a1d8c949d8ad admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:06.712406 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2a9bae5b-6a11-4ed8-aca3-a1d8c949d8ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:06.726295 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9bae5b-6a11-4ed8-aca3-a1d8c949d8ad admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:06.785874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21feca6a-518b-473d-b2fa-91c966a6797a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:06.786419 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21feca6a-518b-473d-b2fa-91c966a6797a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:06.786695 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21feca6a-518b-473d-b2fa-91c966a6797a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:06.786968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21feca6a-518b-473d-b2fa-91c966a6797a admin admin] PATH_INFO: `/v3/users/c87a8e33965a4d7e80d599af6e0a8e18` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:06.788083 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21feca6a-518b-473d-b2fa-91c966a6797a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c87a8e33965a4d7e80d599af6e0a8e18)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:06.790017 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21feca6a-518b-473d-b2fa-91c966a6797a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:06.799986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:06.837676 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-21feca6a-518b-473d-b2fa-91c966a6797a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c87a8e33965a4d7e80d599af6e0a8e18'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:06.845482 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-21feca6a-518b-473d-b2fa-91c966a6797a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c87a8e33965a4d7e80d599af6e0a8e18'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:06.857287 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-21feca6a-518b-473d-b2fa-91c966a6797a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c87a8e33965a4d7e80d599af6e0a8e18'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:06.857968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-21feca6a-518b-473d-b2fa-91c966a6797a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c87a8e33965a4d7e80d599af6e0a8e18'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:06.866568 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-21feca6a-518b-473d-b2fa-91c966a6797a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c87a8e33965a4d7e80d599af6e0a8e18'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:06.876545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1106/2214] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:14:06 2022] DELETE /identity/v3/users/c87a8e33965a4d7e80d599af6e0a8e18 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:14:07.052592 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a293c58-ee77-4c54-bb3c-68fa0ea113ba admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:07.054135 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1a293c58-ee77-4c54-bb3c-68fa0ea113ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:07.077763 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a293c58-ee77-4c54-bb3c-68fa0ea113ba admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:07.137746 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f9116-0d0f-4fbc-a301-0246a4535ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:07.138438 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f9116-0d0f-4fbc-a301-0246a4535ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:07.138653 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f9116-0d0f-4fbc-a301-0246a4535ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:07.138920 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f9116-0d0f-4fbc-a301-0246a4535ad9 admin admin] PATH_INFO: `/v3/projects/79400cd9e4534bf78138939552915974` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:07.140091 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f9116-0d0f-4fbc-a301-0246a4535ad9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79400cd9e4534bf78138939552915974)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:07.142134 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f9116-0d0f-4fbc-a301-0246a4535ad9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:07.169056 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:07.205900 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d06f9116-0d0f-4fbc-a301-0246a4535ad9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79400cd9e4534bf78138939552915974', 'request_id': 'req-d06f9116-0d0f-4fbc-a301-0246a4535ad9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:07.212340 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d06f9116-0d0f-4fbc-a301-0246a4535ad9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79400cd9e4534bf78138939552915974', 'request_id': 'req-d06f9116-0d0f-4fbc-a301-0246a4535ad9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:07.221442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d06f9116-0d0f-4fbc-a301-0246a4535ad9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79400cd9e4534bf78138939552915974', 'request_id': 'req-d06f9116-0d0f-4fbc-a301-0246a4535ad9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:07.232717 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d06f9116-0d0f-4fbc-a301-0246a4535ad9 admin admin] The token cache is being invalidate because project 79400cd9e4534bf78138939552915974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:14:07.232957 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d06f9116-0d0f-4fbc-a301-0246a4535ad9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:07.233637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d06f9116-0d0f-4fbc-a301-0246a4535ad9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:07.235346 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1109/2215] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:14:07 2022] DELETE /identity/v3/projects/79400cd9e4534bf78138939552915974 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:14:07.240426 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e34276-04fc-4a65-bcf7-98cb50f058a1 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:07.241310 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e34276-04fc-4a65-bcf7-98cb50f058a1 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:07.241591 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e34276-04fc-4a65-bcf7-98cb50f058a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:07.274059 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-c8e34276-04fc-4a65-bcf7-98cb50f058a1 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:07.275334 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c8e34276-04fc-4a65-bcf7-98cb50f058a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:07.342240 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1107/2216] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:07.355349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78631719-cce8-4535-8bac-c255c0204fe2 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:07.355821 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78631719-cce8-4535-8bac-c255c0204fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:07.356280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78631719-cce8-4535-8bac-c255c0204fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:07.384515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-78631719-cce8-4535-8bac-c255c0204fe2 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:07.386316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-78631719-cce8-4535-8bac-c255c0204fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:07.395219 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1110/2217] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:07.400998 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e34276-04fc-4a65-bcf7-98cb50f058a1 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:07.412223 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e34276-04fc-4a65-bcf7-98cb50f058a1 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:07.417275 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871cf949-36f3-4c7e-91d3-b4ac4fef02d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:07.417945 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cf949-36f3-4c7e-91d3-b4ac4fef02d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:07.418343 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cf949-36f3-4c7e-91d3-b4ac4fef02d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:07.418621 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cf949-36f3-4c7e-91d3-b4ac4fef02d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:07.419319 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871cf949-36f3-4c7e-91d3-b4ac4fef02d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:14:07.419901 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871cf949-36f3-4c7e-91d3-b4ac4fef02d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:07.421403 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871cf949-36f3-4c7e-91d3-b4ac4fef02d9 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:07.437849 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1108/2218] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:14:07.439444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78631719-cce8-4535-8bac-c255c0204fe2 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:07.449525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78631719-cce8-4535-8bac-c255c0204fe2 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:07.454677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc30ad-e0c2-40e2-b469-3140b545a0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:07.455362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc30ad-e0c2-40e2-b469-3140b545a0a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:07.455852 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc30ad-e0c2-40e2-b469-3140b545a0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:07.456119 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc30ad-e0c2-40e2-b469-3140b545a0a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:07.456837 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc30ad-e0c2-40e2-b469-3140b545a0a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:07.458829 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc30ad-e0c2-40e2-b469-3140b545a0a5 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:07.487232 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1111/2219] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:14:07 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:14:07.491491 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871cf949-36f3-4c7e-91d3-b4ac4fef02d9 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:07.505741 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871cf949-36f3-4c7e-91d3-b4ac4fef02d9 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:07.566668 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21931f60-1b1f-49dd-8077-70e106fcf56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:07.567266 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21931f60-1b1f-49dd-8077-70e106fcf56a admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:07.567540 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21931f60-1b1f-49dd-8077-70e106fcf56a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:07.567802 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21931f60-1b1f-49dd-8077-70e106fcf56a admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:07.568423 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21931f60-1b1f-49dd-8077-70e106fcf56a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:07.570395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21931f60-1b1f-49dd-8077-70e106fcf56a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:07.597157 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1109/2220] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:14:07 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:14:07.604467 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc30ad-e0c2-40e2-b469-3140b545a0a5 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:07.614964 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc30ad-e0c2-40e2-b469-3140b545a0a5 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:07.619620 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875673d4-70db-43fd-8982-ac6a05c64244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:07.620904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875673d4-70db-43fd-8982-ac6a05c64244 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:07.620904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875673d4-70db-43fd-8982-ac6a05c64244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:07.620904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875673d4-70db-43fd-8982-ac6a05c64244 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:07.621481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875673d4-70db-43fd-8982-ac6a05c64244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:07.623064 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875673d4-70db-43fd-8982-ac6a05c64244 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:07.633113 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1112/2221] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:14:07.638126 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21931f60-1b1f-49dd-8077-70e106fcf56a admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:07.645891 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:07.651101 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21931f60-1b1f-49dd-8077-70e106fcf56a admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:07.658878 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d3e63-f1a7-4d00-bc6f-10692f4aebfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:07.659479 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d3e63-f1a7-4d00-bc6f-10692f4aebfd admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:07.659924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d3e63-f1a7-4d00-bc6f-10692f4aebfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:07.660191 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d3e63-f1a7-4d00-bc6f-10692f4aebfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:07.660835 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d3e63-f1a7-4d00-bc6f-10692f4aebfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:07.662778 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d3e63-f1a7-4d00-bc6f-10692f4aebfd admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:07.673289 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1110/2222] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:14:07.677304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875673d4-70db-43fd-8982-ac6a05c64244 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:07.687433 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875673d4-70db-43fd-8982-ac6a05c64244 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:07.692329 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfd7fb-050b-4215-97a9-6aad3154a416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:07.693116 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfd7fb-050b-4215-97a9-6aad3154a416 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:07.693410 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfd7fb-050b-4215-97a9-6aad3154a416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:07.693684 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfd7fb-050b-4215-97a9-6aad3154a416 admin admin] PATH_INFO: `/v3/projects/e015da2882c840388dcc6b7d5bc247c5/users/2ccf63d5c90544f08954b123c8003a24/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:07.712125 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfd7fb-050b-4215-97a9-6aad3154a416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e015da2882c840388dcc6b7d5bc247c5, user_id=2ccf63d5c90544f08954b123c8003a24, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:07.715669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfd7fb-050b-4215-97a9-6aad3154a416 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:07.731680 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1113/2223] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:14:07 2022] PUT /identity/v3/projects/e015da2882c840388dcc6b7d5bc247c5/users/2ccf63d5c90544f08954b123c8003a24/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:14:07.741930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa297414-1326-4330-ab73-3d6b97980098 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:07.742223 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa297414-1326-4330-ab73-3d6b97980098 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:07.742492 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa297414-1326-4330-ab73-3d6b97980098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:07.774773 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-aa297414-1326-4330-ab73-3d6b97980098 None None] MFA Rules not processed for user `2ccf63d5c90544f08954b123c8003a24`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:07.775970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-aa297414-1326-4330-ab73-3d6b97980098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:07.846816 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1111/2224] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:14:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:07.858721 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfd7fb-050b-4215-97a9-6aad3154a416 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:07.860530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-42bfd7fb-050b-4215-97a9-6aad3154a416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:07.917780 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfd7fb-050b-4215-97a9-6aad3154a416 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:07.921502 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00ac4d-3ee1-4c6b-8a04-4c903db97ec6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:07.922108 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00ac4d-3ee1-4c6b-8a04-4c903db97ec6 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:07.922390 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00ac4d-3ee1-4c6b-8a04-4c903db97ec6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:07.922663 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00ac4d-3ee1-4c6b-8a04-4c903db97ec6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:07.931314 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00ac4d-3ee1-4c6b-8a04-4c903db97ec6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:07.933293 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00ac4d-3ee1-4c6b-8a04-4c903db97ec6 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:07.942133 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1114/2225] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:14:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:14:07.964896 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa297414-1326-4330-ab73-3d6b97980098 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:08.026559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa297414-1326-4330-ab73-3d6b97980098 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:08.031643 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d85eb-c175-4bb3-8aa2-495b099d6477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:08.032261 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d85eb-c175-4bb3-8aa2-495b099d6477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:08.032537 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d85eb-c175-4bb3-8aa2-495b099d6477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:08.032813 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d85eb-c175-4bb3-8aa2-495b099d6477 admin admin] PATH_INFO: `/v3/users/2ccf63d5c90544f08954b123c8003a24` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:08.033970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d85eb-c175-4bb3-8aa2-495b099d6477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ccf63d5c90544f08954b123c8003a24)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:08.035879 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d85eb-c175-4bb3-8aa2-495b099d6477 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:08.082463 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-532d85eb-c175-4bb3-8aa2-495b099d6477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ccf63d5c90544f08954b123c8003a24'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:08.089004 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-532d85eb-c175-4bb3-8aa2-495b099d6477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ccf63d5c90544f08954b123c8003a24'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:08.106026 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-532d85eb-c175-4bb3-8aa2-495b099d6477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ccf63d5c90544f08954b123c8003a24'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:08.106709 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-532d85eb-c175-4bb3-8aa2-495b099d6477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ccf63d5c90544f08954b123c8003a24'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:08.114215 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-532d85eb-c175-4bb3-8aa2-495b099d6477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ccf63d5c90544f08954b123c8003a24'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:08.121154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1112/2226] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:14:07 2022] DELETE /identity/v3/users/2ccf63d5c90544f08954b123c8003a24 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:14:08.125750 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f647ee-4ad9-49a8-bb7e-cb377414a08e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:08.126040 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f647ee-4ad9-49a8-bb7e-cb377414a08e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:08.126320 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f647ee-4ad9-49a8-bb7e-cb377414a08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:08.145120 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c0f647ee-4ad9-49a8-bb7e-cb377414a08e None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:08.146333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c0f647ee-4ad9-49a8-bb7e-cb377414a08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:08.188575 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:08.208026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1115/2227] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:08.217834 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d85eb-c175-4bb3-8aa2-495b099d6477 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:08.219233 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-532d85eb-c175-4bb3-8aa2-495b099d6477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:08.224575 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:08.280705 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d85eb-c175-4bb3-8aa2-495b099d6477 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:08.284430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db91f9-59d8-489f-a27e-eff568ba6fc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:08.285050 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db91f9-59d8-489f-a27e-eff568ba6fc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:08.285354 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db91f9-59d8-489f-a27e-eff568ba6fc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:08.285623 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db91f9-59d8-489f-a27e-eff568ba6fc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:08.296214 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db91f9-59d8-489f-a27e-eff568ba6fc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:08.298003 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db91f9-59d8-489f-a27e-eff568ba6fc0 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:08.308540 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1113/2228] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:14:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:14:08.642290 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f647ee-4ad9-49a8-bb7e-cb377414a08e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:08.643828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c0f647ee-4ad9-49a8-bb7e-cb377414a08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:08.656933 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f647ee-4ad9-49a8-bb7e-cb377414a08e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:08.662338 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0019f0-5bce-4d42-a0ab-18e66c728b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:08.663265 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0019f0-5bce-4d42-a0ab-18e66c728b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:08.663798 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0019f0-5bce-4d42-a0ab-18e66c728b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:08.664076 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0019f0-5bce-4d42-a0ab-18e66c728b79 admin admin] PATH_INFO: `/v3/projects/e015da2882c840388dcc6b7d5bc247c5` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:08.666154 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0019f0-5bce-4d42-a0ab-18e66c728b79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e015da2882c840388dcc6b7d5bc247c5)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:08.668124 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0019f0-5bce-4d42-a0ab-18e66c728b79 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:08.718746 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1e0019f0-5bce-4d42-a0ab-18e66c728b79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e015da2882c840388dcc6b7d5bc247c5', 'request_id': 'req-1e0019f0-5bce-4d42-a0ab-18e66c728b79'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:08.725499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1e0019f0-5bce-4d42-a0ab-18e66c728b79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e015da2882c840388dcc6b7d5bc247c5', 'request_id': 'req-1e0019f0-5bce-4d42-a0ab-18e66c728b79'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:08.732971 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1e0019f0-5bce-4d42-a0ab-18e66c728b79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e015da2882c840388dcc6b7d5bc247c5', 'request_id': 'req-1e0019f0-5bce-4d42-a0ab-18e66c728b79'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:08.744794 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1e0019f0-5bce-4d42-a0ab-18e66c728b79 admin admin] The token cache is being invalidate because project e015da2882c840388dcc6b7d5bc247c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:14:08.745642 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1e0019f0-5bce-4d42-a0ab-18e66c728b79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:08.746381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1e0019f0-5bce-4d42-a0ab-18e66c728b79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:08.748061 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1116/2229] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:14:08 2022] DELETE /identity/v3/projects/e015da2882c840388dcc6b7d5bc247c5 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:14:08.753198 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba164ac-5103-47d0-8d26-e6c3a13220b1 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:08.753486 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba164ac-5103-47d0-8d26-e6c3a13220b1 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:08.753791 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba164ac-5103-47d0-8d26-e6c3a13220b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:08.777381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-8ba164ac-5103-47d0-8d26-e6c3a13220b1 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:08.778647 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8ba164ac-5103-47d0-8d26-e6c3a13220b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:08.845004 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1114/2230] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:14:08.853184 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e70fd-51d2-479f-82a5-a2d3aaf47240 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:08.853473 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e70fd-51d2-479f-82a5-a2d3aaf47240 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:08.853750 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e70fd-51d2-479f-82a5-a2d3aaf47240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:08.874766 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-6b8e70fd-51d2-479f-82a5-a2d3aaf47240 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:08.875966 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6b8e70fd-51d2-479f-82a5-a2d3aaf47240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:08.884041 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1117/2231] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:08.888525 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba164ac-5103-47d0-8d26-e6c3a13220b1 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:08.898408 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba164ac-5103-47d0-8d26-e6c3a13220b1 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:08.903562 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26071195-34ae-4334-97a9-7d6492bb006c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:08.904430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26071195-34ae-4334-97a9-7d6492bb006c admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:08.904694 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26071195-34ae-4334-97a9-7d6492bb006c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:08.904960 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26071195-34ae-4334-97a9-7d6492bb006c admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:08.905654 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26071195-34ae-4334-97a9-7d6492bb006c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:14:08.905937 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26071195-34ae-4334-97a9-7d6492bb006c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:08.907780 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26071195-34ae-4334-97a9-7d6492bb006c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:08.923039 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1115/2232] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:14:08.927581 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e70fd-51d2-479f-82a5-a2d3aaf47240 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:08.938248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e70fd-51d2-479f-82a5-a2d3aaf47240 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:08.943068 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7853137-67d9-4063-952e-51b4ed63a3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:08.943667 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7853137-67d9-4063-952e-51b4ed63a3e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:08.943944 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7853137-67d9-4063-952e-51b4ed63a3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:08.944215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7853137-67d9-4063-952e-51b4ed63a3e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:08.944846 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7853137-67d9-4063-952e-51b4ed63a3e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:08.946778 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7853137-67d9-4063-952e-51b4ed63a3e2 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:08.974418 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1118/2233] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:14:08 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:14:08.978755 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26071195-34ae-4334-97a9-7d6492bb006c admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:08.991261 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26071195-34ae-4334-97a9-7d6492bb006c admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:09.049646 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9fffb-aee4-4745-bd32-ff2d8c98c86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:09.050252 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9fffb-aee4-4745-bd32-ff2d8c98c86d admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:09.050532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9fffb-aee4-4745-bd32-ff2d8c98c86d admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:09.050803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9fffb-aee4-4745-bd32-ff2d8c98c86d admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:09.051731 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9fffb-aee4-4745-bd32-ff2d8c98c86d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:09.053676 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9fffb-aee4-4745-bd32-ff2d8c98c86d admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:09.078679 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1116/2234] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:14:08 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:14:09.082925 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7853137-67d9-4063-952e-51b4ed63a3e2 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:09.093208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7853137-67d9-4063-952e-51b4ed63a3e2 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:09.097812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea6fe9-a38b-4918-a2fb-9c1441ce7c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:09.098399 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea6fe9-a38b-4918-a2fb-9c1441ce7c5c admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:09.098676 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea6fe9-a38b-4918-a2fb-9c1441ce7c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:09.098947 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea6fe9-a38b-4918-a2fb-9c1441ce7c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:09.099580 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea6fe9-a38b-4918-a2fb-9c1441ce7c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:09.101219 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea6fe9-a38b-4918-a2fb-9c1441ce7c5c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:09.111550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1119/2235] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:14:09.115564 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9fffb-aee4-4745-bd32-ff2d8c98c86d admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:09.126066 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9fffb-aee4-4745-bd32-ff2d8c98c86d admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:09.130666 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f641b-55e1-42dc-a527-51140165626b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:09.131252 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f641b-55e1-42dc-a527-51140165626b admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:09.131528 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f641b-55e1-42dc-a527-51140165626b admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:09.131802 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f641b-55e1-42dc-a527-51140165626b admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:09.132442 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f641b-55e1-42dc-a527-51140165626b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:09.134118 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f641b-55e1-42dc-a527-51140165626b admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:09.144707 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1117/2236] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:14:09.148654 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea6fe9-a38b-4918-a2fb-9c1441ce7c5c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:09.159083 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea6fe9-a38b-4918-a2fb-9c1441ce7c5c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:09.164142 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09441a6-bce4-45e8-b74f-d4c1f6e53f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:09.164841 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09441a6-bce4-45e8-b74f-d4c1f6e53f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:09.165220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09441a6-bce4-45e8-b74f-d4c1f6e53f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:09.165522 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09441a6-bce4-45e8-b74f-d4c1f6e53f21 admin admin] PATH_INFO: `/v3/projects/e1dc299bd30a41ad9d5a56d0d8406920/users/e26fc979637c4110beab76f1f26e5918/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:09.181842 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09441a6-bce4-45e8-b74f-d4c1f6e53f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1dc299bd30a41ad9d5a56d0d8406920, user_id=e26fc979637c4110beab76f1f26e5918, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:09.185079 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09441a6-bce4-45e8-b74f-d4c1f6e53f21 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:09.199106 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1120/2237] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:14:09 2022] PUT /identity/v3/projects/e1dc299bd30a41ad9d5a56d0d8406920/users/e26fc979637c4110beab76f1f26e5918/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:14:09.210115 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81d852-6806-400e-a3d1-91bb752d56d7 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:09.210399 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81d852-6806-400e-a3d1-91bb752d56d7 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:09.210669 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81d852-6806-400e-a3d1-91bb752d56d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:09.231999 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:09.240200 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-4d81d852-6806-400e-a3d1-91bb752d56d7 None None] MFA Rules not processed for user `e26fc979637c4110beab76f1f26e5918`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:09.241791 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4d81d852-6806-400e-a3d1-91bb752d56d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:09.310052 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1118/2238] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:14:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:09.321770 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09441a6-bce4-45e8-b74f-d4c1f6e53f21 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:09.323488 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c09441a6-bce4-45e8-b74f-d4c1f6e53f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:09.400843 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:09.408917 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09441a6-bce4-45e8-b74f-d4c1f6e53f21 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:09.414849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbc884-df60-486a-916b-922f525681cf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22959df6ef034036b5f6b3cda7918e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:09.415467 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbc884-df60-486a-916b-922f525681cf service glance] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:09.415743 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbc884-df60-486a-916b-922f525681cf service glance] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:09.416010 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbc884-df60-486a-916b-922f525681cf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:09.425352 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bbc884-df60-486a-916b-922f525681cf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:09.426781 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bbc884-df60-486a-916b-922f525681cf service glance] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:09.435588 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1121/2239] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:14:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:14:15.730173 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e98e6f-ddd7-482c-84f2-feac6cc13d70 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:15.730713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e98e6f-ddd7-482c-84f2-feac6cc13d70 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:15.730713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e98e6f-ddd7-482c-84f2-feac6cc13d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:15.750197 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e1e98e6f-ddd7-482c-84f2-feac6cc13d70 None None] MFA Rules not processed for user `33d7e0d80ad14191ab2f7f386d4c7ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:15.751707 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e1e98e6f-ddd7-482c-84f2-feac6cc13d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:15.809812 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1119/2240] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:14:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:19.431608 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:20.470170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbc884-df60-486a-916b-922f525681cf service glance] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:20.471724 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-26bbc884-df60-486a-916b-922f525681cf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:20.540159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbc884-df60-486a-916b-922f525681cf service glance] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:20.545359 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63ec73-332e-49be-b654-8561b8fdffaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:20.545986 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63ec73-332e-49be-b654-8561b8fdffaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:20.546261 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63ec73-332e-49be-b654-8561b8fdffaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:20.546528 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63ec73-332e-49be-b654-8561b8fdffaf admin admin] PATH_INFO: `/v3/users/6a4da3366c2749e3831744df38bcd896` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:20.547656 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63ec73-332e-49be-b654-8561b8fdffaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a4da3366c2749e3831744df38bcd896)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:20.549761 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63ec73-332e-49be-b654-8561b8fdffaf admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:20.600226 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9a63ec73-332e-49be-b654-8561b8fdffaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a4da3366c2749e3831744df38bcd896'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:20.607643 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9a63ec73-332e-49be-b654-8561b8fdffaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a4da3366c2749e3831744df38bcd896'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:20.622028 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9a63ec73-332e-49be-b654-8561b8fdffaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a4da3366c2749e3831744df38bcd896'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:20.623035 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9a63ec73-332e-49be-b654-8561b8fdffaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a4da3366c2749e3831744df38bcd896'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:20.634382 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9a63ec73-332e-49be-b654-8561b8fdffaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a4da3366c2749e3831744df38bcd896'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:20.641049 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1122/2241] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:14:20 2022] DELETE /identity/v3/users/6a4da3366c2749e3831744df38bcd896 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:14:20.645321 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc3770-9097-44c2-bcbb-effb1527835d None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:20.645778 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc3770-9097-44c2-bcbb-effb1527835d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:20.645885 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc3770-9097-44c2-bcbb-effb1527835d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:20.664908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-afcc3770-9097-44c2-bcbb-effb1527835d None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:20.666119 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-afcc3770-9097-44c2-bcbb-effb1527835d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:20.732783 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1120/2242] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:20.743116 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63ec73-332e-49be-b654-8561b8fdffaf admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:20.744508 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9a63ec73-332e-49be-b654-8561b8fdffaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:20.805515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63ec73-332e-49be-b654-8561b8fdffaf admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:20.809279 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b21dd-2182-4006-9cae-71f5a420d2a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:20.810072 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b21dd-2182-4006-9cae-71f5a420d2a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:20.810349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b21dd-2182-4006-9cae-71f5a420d2a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:20.810743 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b21dd-2182-4006-9cae-71f5a420d2a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:20.821503 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b21dd-2182-4006-9cae-71f5a420d2a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:20.823011 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b21dd-2182-4006-9cae-71f5a420d2a9 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:20.832771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1123/2243] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:14:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:14:21.116647 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc3770-9097-44c2-bcbb-effb1527835d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:21.118182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-afcc3770-9097-44c2-bcbb-effb1527835d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:21.131744 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc3770-9097-44c2-bcbb-effb1527835d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:21.138490 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cae5f7-9538-46ef-a963-8ef39b3b63b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:21.138996 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cae5f7-9538-46ef-a963-8ef39b3b63b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:21.139278 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cae5f7-9538-46ef-a963-8ef39b3b63b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:21.139548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cae5f7-9538-46ef-a963-8ef39b3b63b5 admin admin] PATH_INFO: `/v3/projects/018a6d4afbf14a329fe3c6f190c5de41` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:21.140764 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cae5f7-9538-46ef-a963-8ef39b3b63b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=018a6d4afbf14a329fe3c6f190c5de41)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:21.142742 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cae5f7-9538-46ef-a963-8ef39b3b63b5 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:21.185535 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:21.192955 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c2cae5f7-9538-46ef-a963-8ef39b3b63b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '018a6d4afbf14a329fe3c6f190c5de41', 'request_id': 'req-c2cae5f7-9538-46ef-a963-8ef39b3b63b5'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:21.200165 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c2cae5f7-9538-46ef-a963-8ef39b3b63b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '018a6d4afbf14a329fe3c6f190c5de41', 'request_id': 'req-c2cae5f7-9538-46ef-a963-8ef39b3b63b5'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:21.205975 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c2cae5f7-9538-46ef-a963-8ef39b3b63b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '018a6d4afbf14a329fe3c6f190c5de41', 'request_id': 'req-c2cae5f7-9538-46ef-a963-8ef39b3b63b5'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:21.219047 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c2cae5f7-9538-46ef-a963-8ef39b3b63b5 admin admin] The token cache is being invalidate because project 018a6d4afbf14a329fe3c6f190c5de41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:14:21.219336 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c2cae5f7-9538-46ef-a963-8ef39b3b63b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:21.220002 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c2cae5f7-9538-46ef-a963-8ef39b3b63b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:21.221541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1121/2244] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:14:21 2022] DELETE /identity/v3/projects/018a6d4afbf14a329fe3c6f190c5de41 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:14:21.225728 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b21dd-2182-4006-9cae-71f5a420d2a9 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:21.235458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b21dd-2182-4006-9cae-71f5a420d2a9 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:21.253700 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:21.294324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921dc174-62dc-4a3c-8aa8-a65ab8a632a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:21.294975 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dc174-62dc-4a3c-8aa8-a65ab8a632a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:21.295252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dc174-62dc-4a3c-8aa8-a65ab8a632a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:21.295524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dc174-62dc-4a3c-8aa8-a65ab8a632a2 admin admin] PATH_INFO: `/v3/users/bd8f79c54e3e4536a09f2abb9d6ed336` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:21.296667 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921dc174-62dc-4a3c-8aa8-a65ab8a632a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd8f79c54e3e4536a09f2abb9d6ed336)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:21.298633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921dc174-62dc-4a3c-8aa8-a65ab8a632a2 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:21.344150 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-921dc174-62dc-4a3c-8aa8-a65ab8a632a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd8f79c54e3e4536a09f2abb9d6ed336'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:21.352013 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-921dc174-62dc-4a3c-8aa8-a65ab8a632a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd8f79c54e3e4536a09f2abb9d6ed336'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:21.364241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-921dc174-62dc-4a3c-8aa8-a65ab8a632a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd8f79c54e3e4536a09f2abb9d6ed336'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:21.364930 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-921dc174-62dc-4a3c-8aa8-a65ab8a632a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd8f79c54e3e4536a09f2abb9d6ed336'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:21.377652 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-921dc174-62dc-4a3c-8aa8-a65ab8a632a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd8f79c54e3e4536a09f2abb9d6ed336'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:21.384035 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1124/2245] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:14:21 2022] DELETE /identity/v3/users/bd8f79c54e3e4536a09f2abb9d6ed336 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:14:21.722840 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cae5f7-9538-46ef-a963-8ef39b3b63b5 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:21.724392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c2cae5f7-9538-46ef-a963-8ef39b3b63b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:21.739705 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cae5f7-9538-46ef-a963-8ef39b3b63b5 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:21.817848 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa6b96-3551-4edf-9bf7-f1851ad50478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:21.818752 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa6b96-3551-4edf-9bf7-f1851ad50478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:21.819201 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa6b96-3551-4edf-9bf7-f1851ad50478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:21.819643 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa6b96-3551-4edf-9bf7-f1851ad50478 admin admin] PATH_INFO: `/v3/projects/85c8360870464177b20f4dba9f2355a1` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:21.821071 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa6b96-3551-4edf-9bf7-f1851ad50478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85c8360870464177b20f4dba9f2355a1)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:21.823823 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa6b96-3551-4edf-9bf7-f1851ad50478 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:21.881315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ecaa6b96-3551-4edf-9bf7-f1851ad50478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85c8360870464177b20f4dba9f2355a1', 'request_id': 'req-ecaa6b96-3551-4edf-9bf7-f1851ad50478'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:21.889395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ecaa6b96-3551-4edf-9bf7-f1851ad50478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85c8360870464177b20f4dba9f2355a1', 'request_id': 'req-ecaa6b96-3551-4edf-9bf7-f1851ad50478'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:21.895360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ecaa6b96-3551-4edf-9bf7-f1851ad50478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85c8360870464177b20f4dba9f2355a1', 'request_id': 'req-ecaa6b96-3551-4edf-9bf7-f1851ad50478'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:21.907181 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ecaa6b96-3551-4edf-9bf7-f1851ad50478 admin admin] The token cache is being invalidate because project 85c8360870464177b20f4dba9f2355a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:14:21.907468 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ecaa6b96-3551-4edf-9bf7-f1851ad50478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:21.908133 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ecaa6b96-3551-4edf-9bf7-f1851ad50478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:21.909673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1122/2246] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:14:21 2022] DELETE /identity/v3/projects/85c8360870464177b20f4dba9f2355a1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:14:21.915590 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de6b66-fd8d-4014-927d-f271ee967036 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:21.916198 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de6b66-fd8d-4014-927d-f271ee967036 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:21.916572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de6b66-fd8d-4014-927d-f271ee967036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:21.937156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-23de6b66-fd8d-4014-927d-f271ee967036 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:21.938361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-23de6b66-fd8d-4014-927d-f271ee967036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:21.996543 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1125/2247] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:22.004767 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba75d6a-992f-4b78-bc93-d319595d7571 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:22.005056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba75d6a-992f-4b78-bc93-d319595d7571 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:22.005439 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba75d6a-992f-4b78-bc93-d319595d7571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:22.026286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-7ba75d6a-992f-4b78-bc93-d319595d7571 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:22.027499 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7ba75d6a-992f-4b78-bc93-d319595d7571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:22.035827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1123/2248] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:22.040263 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de6b66-fd8d-4014-927d-f271ee967036 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:22.050749 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de6b66-fd8d-4014-927d-f271ee967036 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:22.055361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73eaec-534b-4d7c-b212-a2e737cc8ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:22.055951 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73eaec-534b-4d7c-b212-a2e737cc8ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:22.056230 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73eaec-534b-4d7c-b212-a2e737cc8ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:22.056500 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73eaec-534b-4d7c-b212-a2e737cc8ee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:22.057689 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73eaec-534b-4d7c-b212-a2e737cc8ee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:14:22.057991 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73eaec-534b-4d7c-b212-a2e737cc8ee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:22.059595 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73eaec-534b-4d7c-b212-a2e737cc8ee4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:22.071201 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1126/2249] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:14:22.076066 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba75d6a-992f-4b78-bc93-d319595d7571 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:22.085331 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba75d6a-992f-4b78-bc93-d319595d7571 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:22.090385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f44b7-f872-48dd-afa9-bbe04493bf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:22.091069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f44b7-f872-48dd-afa9-bbe04493bf78 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:22.091354 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f44b7-f872-48dd-afa9-bbe04493bf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:22.091626 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f44b7-f872-48dd-afa9-bbe04493bf78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:22.092309 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f44b7-f872-48dd-afa9-bbe04493bf78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:22.094378 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f44b7-f872-48dd-afa9-bbe04493bf78 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:22.122060 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1124/2250] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:14:22 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:14:22.126336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73eaec-534b-4d7c-b212-a2e737cc8ee4 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:22.137078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73eaec-534b-4d7c-b212-a2e737cc8ee4 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:22.164442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:22.202665 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c60d3-9cd9-4023-b1a7-ff2dead21e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:22.203273 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c60d3-9cd9-4023-b1a7-ff2dead21e54 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:22.203554 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c60d3-9cd9-4023-b1a7-ff2dead21e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:22.203827 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c60d3-9cd9-4023-b1a7-ff2dead21e54 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:22.204459 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c60d3-9cd9-4023-b1a7-ff2dead21e54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:22.206435 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c60d3-9cd9-4023-b1a7-ff2dead21e54 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:22.227009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1127/2251] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:14:22 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:14:22.231210 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f44b7-f872-48dd-afa9-bbe04493bf78 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:22.241606 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f44b7-f872-48dd-afa9-bbe04493bf78 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:22.246739 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1492c-f1b4-43e5-b7e8-df0b4ad9a510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:22.247325 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1492c-f1b4-43e5-b7e8-df0b4ad9a510 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:22.247602 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1492c-f1b4-43e5-b7e8-df0b4ad9a510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:22.247874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1492c-f1b4-43e5-b7e8-df0b4ad9a510 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:22.248514 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1492c-f1b4-43e5-b7e8-df0b4ad9a510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:22.250149 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1492c-f1b4-43e5-b7e8-df0b4ad9a510 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:22.262198 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1125/2252] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:14:22.266144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c60d3-9cd9-4023-b1a7-ff2dead21e54 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:22.276418 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c60d3-9cd9-4023-b1a7-ff2dead21e54 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:22.281503 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb2b27-b181-474d-92ae-356b26420e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:22.282100 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb2b27-b181-474d-92ae-356b26420e5f admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:22.282379 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb2b27-b181-474d-92ae-356b26420e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:22.282651 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb2b27-b181-474d-92ae-356b26420e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:22.283306 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb2b27-b181-474d-92ae-356b26420e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:22.284882 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb2b27-b181-474d-92ae-356b26420e5f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:22.294894 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1128/2253] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:14:22.299097 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1492c-f1b4-43e5-b7e8-df0b4ad9a510 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:22.309549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1492c-f1b4-43e5-b7e8-df0b4ad9a510 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:22.314095 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b8157-ba02-4d01-bc79-6f1e93148f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:22.314721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b8157-ba02-4d01-bc79-6f1e93148f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:22.314994 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b8157-ba02-4d01-bc79-6f1e93148f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:22.315263 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b8157-ba02-4d01-bc79-6f1e93148f96 admin admin] PATH_INFO: `/v3/projects/e28ef071ab9147e9a5b4b348ae34dfd4/users/e7db50a3c49845f6b128a4649108acf7/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:22.330406 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b8157-ba02-4d01-bc79-6f1e93148f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e28ef071ab9147e9a5b4b348ae34dfd4, user_id=e7db50a3c49845f6b128a4649108acf7, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:22.333261 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b8157-ba02-4d01-bc79-6f1e93148f96 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:22.337679 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:22.351363 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1126/2254] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:14:22 2022] PUT /identity/v3/projects/e28ef071ab9147e9a5b4b348ae34dfd4/users/e7db50a3c49845f6b128a4649108acf7/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:14:22.363676 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c3fde-bf50-4ad3-b000-cda5829fab14 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:22.364001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c3fde-bf50-4ad3-b000-cda5829fab14 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:22.364319 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c3fde-bf50-4ad3-b000-cda5829fab14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:22.392822 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-bd7c3fde-bf50-4ad3-b000-cda5829fab14 None None] MFA Rules not processed for user `e7db50a3c49845f6b128a4649108acf7`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:22.394078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-bd7c3fde-bf50-4ad3-b000-cda5829fab14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:22.460042 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1129/2255] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:14:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:22.464734 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b8157-ba02-4d01-bc79-6f1e93148f96 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:22.529785 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b8157-ba02-4d01-bc79-6f1e93148f96 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:22.536177 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f37b4-ff7b-40bb-b177-dd7ed15bf073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:22.536788 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f37b4-ff7b-40bb-b177-dd7ed15bf073 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:22.537061 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f37b4-ff7b-40bb-b177-dd7ed15bf073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:22.537357 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f37b4-ff7b-40bb-b177-dd7ed15bf073 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:22.537990 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f37b4-ff7b-40bb-b177-dd7ed15bf073 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:22.539925 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f37b4-ff7b-40bb-b177-dd7ed15bf073 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:22.569850 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1127/2256] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:14:22 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:14:22.572834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c3fde-bf50-4ad3-b000-cda5829fab14 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:22.583996 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c3fde-bf50-4ad3-b000-cda5829fab14 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:22.654998 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e06a19-72b6-4984-ba9f-e057c96064da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:22.655459 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e06a19-72b6-4984-ba9f-e057c96064da admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:22.655731 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e06a19-72b6-4984-ba9f-e057c96064da admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:22.655997 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e06a19-72b6-4984-ba9f-e057c96064da admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:22.656630 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e06a19-72b6-4984-ba9f-e057c96064da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:22.658811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e06a19-72b6-4984-ba9f-e057c96064da admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:22.685730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1130/2257] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:14:22 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:14:22.686960 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f37b4-ff7b-40bb-b177-dd7ed15bf073 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:22.697873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f37b4-ff7b-40bb-b177-dd7ed15bf073 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:22.702617 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628e1b8-857e-4a6d-91fd-e02bbc803216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:22.703211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628e1b8-857e-4a6d-91fd-e02bbc803216 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:22.703487 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628e1b8-857e-4a6d-91fd-e02bbc803216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:22.703759 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628e1b8-857e-4a6d-91fd-e02bbc803216 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:22.704403 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628e1b8-857e-4a6d-91fd-e02bbc803216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:22.706093 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628e1b8-857e-4a6d-91fd-e02bbc803216 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:22.720450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1128/2258] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:14:22.721512 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e06a19-72b6-4984-ba9f-e057c96064da admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:22.732418 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e06a19-72b6-4984-ba9f-e057c96064da admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:22.737079 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078dccc1-bbb9-48a5-81c3-3f7e8175a507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:22.737756 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078dccc1-bbb9-48a5-81c3-3f7e8175a507 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:22.738034 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078dccc1-bbb9-48a5-81c3-3f7e8175a507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:22.738304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078dccc1-bbb9-48a5-81c3-3f7e8175a507 admin admin] PATH_INFO: `/v3/projects/20a4e69a400d4f009cee0c526d1b9cd7/users/d4fbdde2812f4c0699120c9cb1fc432f/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:22.754151 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078dccc1-bbb9-48a5-81c3-3f7e8175a507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a4e69a400d4f009cee0c526d1b9cd7, user_id=d4fbdde2812f4c0699120c9cb1fc432f, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:22.756920 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078dccc1-bbb9-48a5-81c3-3f7e8175a507 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:22.771098 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1131/2259] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:14:22 2022] PUT /identity/v3/projects/20a4e69a400d4f009cee0c526d1b9cd7/users/d4fbdde2812f4c0699120c9cb1fc432f/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:14:22.775512 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628e1b8-857e-4a6d-91fd-e02bbc803216 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:22.788652 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628e1b8-857e-4a6d-91fd-e02bbc803216 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:22.848051 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6fa37-0899-4217-9966-461ade88d880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:22.848650 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6fa37-0899-4217-9966-461ade88d880 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:22.848927 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6fa37-0899-4217-9966-461ade88d880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:22.849224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6fa37-0899-4217-9966-461ade88d880 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:22.849869 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6fa37-0899-4217-9966-461ade88d880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:22.851521 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6fa37-0899-4217-9966-461ade88d880 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:22.863247 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1129/2260] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:14:22.867252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078dccc1-bbb9-48a5-81c3-3f7e8175a507 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:22.873800 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:22.879601 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078dccc1-bbb9-48a5-81c3-3f7e8175a507 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:22.893523 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f033d3-4b44-4a72-a6a3-e40f8c9bbc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:22.894377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f033d3-4b44-4a72-a6a3-e40f8c9bbc6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:22.895030 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f033d3-4b44-4a72-a6a3-e40f8c9bbc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:22.895356 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f033d3-4b44-4a72-a6a3-e40f8c9bbc6b admin admin] PATH_INFO: `/v3/projects/20a4e69a400d4f009cee0c526d1b9cd7/users/d4fbdde2812f4c0699120c9cb1fc432f/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:22.897774 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f033d3-4b44-4a72-a6a3-e40f8c9bbc6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a4e69a400d4f009cee0c526d1b9cd7, user_id=d4fbdde2812f4c0699120c9cb1fc432f, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:22.902016 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f033d3-4b44-4a72-a6a3-e40f8c9bbc6b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:22.913317 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1132/2261] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:14:22 2022] PUT /identity/v3/projects/20a4e69a400d4f009cee0c526d1b9cd7/users/d4fbdde2812f4c0699120c9cb1fc432f/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:14:22.924208 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea86fac-18d5-49af-a78f-a47c71d3ea19 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:22.924488 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea86fac-18d5-49af-a78f-a47c71d3ea19 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:22.924755 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea86fac-18d5-49af-a78f-a47c71d3ea19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:22.954277 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-7ea86fac-18d5-49af-a78f-a47c71d3ea19 None None] MFA Rules not processed for user `d4fbdde2812f4c0699120c9cb1fc432f`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:22.955584 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7ea86fac-18d5-49af-a78f-a47c71d3ea19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:23.013259 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:23.035260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1130/2262] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:14:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:23.047148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f033d3-4b44-4a72-a6a3-e40f8c9bbc6b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:23.048941 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d5f033d3-4b44-4a72-a6a3-e40f8c9bbc6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:23.108022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f033d3-4b44-4a72-a6a3-e40f8c9bbc6b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:23.111778 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3506b7-1d35-4aa0-a17d-63791673b605 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:23.112525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3506b7-1d35-4aa0-a17d-63791673b605 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:23.112807 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3506b7-1d35-4aa0-a17d-63791673b605 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:23.113073 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3506b7-1d35-4aa0-a17d-63791673b605 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:23.122673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3506b7-1d35-4aa0-a17d-63791673b605 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:23.124102 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3506b7-1d35-4aa0-a17d-63791673b605 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:23.136507 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1133/2263] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:14:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:14:23.547554 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea86fac-18d5-49af-a78f-a47c71d3ea19 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:23.612574 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea86fac-18d5-49af-a78f-a47c71d3ea19 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:23.617196 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e97bb-66a9-48ff-8013-a6f9eff484d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:23.617828 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e97bb-66a9-48ff-8013-a6f9eff484d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:23.618111 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e97bb-66a9-48ff-8013-a6f9eff484d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:23.618384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e97bb-66a9-48ff-8013-a6f9eff484d8 admin admin] PATH_INFO: `/v3/users/e7db50a3c49845f6b128a4649108acf7` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:23.619535 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e97bb-66a9-48ff-8013-a6f9eff484d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7db50a3c49845f6b128a4649108acf7)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:23.621559 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e97bb-66a9-48ff-8013-a6f9eff484d8 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:23.673232 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-061e97bb-66a9-48ff-8013-a6f9eff484d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7db50a3c49845f6b128a4649108acf7'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:23.681478 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-061e97bb-66a9-48ff-8013-a6f9eff484d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7db50a3c49845f6b128a4649108acf7'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:23.693359 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-061e97bb-66a9-48ff-8013-a6f9eff484d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7db50a3c49845f6b128a4649108acf7'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:23.693993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-061e97bb-66a9-48ff-8013-a6f9eff484d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7db50a3c49845f6b128a4649108acf7'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:23.701208 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-061e97bb-66a9-48ff-8013-a6f9eff484d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7db50a3c49845f6b128a4649108acf7'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:23.707049 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1131/2264] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:14:23 2022] DELETE /identity/v3/users/e7db50a3c49845f6b128a4649108acf7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:14:23.711505 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1423b32-5df2-4882-b703-c709e053caed None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:23.711791 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1423b32-5df2-4882-b703-c709e053caed None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:23.712056 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1423b32-5df2-4882-b703-c709e053caed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:23.731427 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f1423b32-5df2-4882-b703-c709e053caed None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:23.732785 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f1423b32-5df2-4882-b703-c709e053caed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:23.796291 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1134/2265] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:23.806004 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e97bb-66a9-48ff-8013-a6f9eff484d8 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:23.807456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-061e97bb-66a9-48ff-8013-a6f9eff484d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:23.874950 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e97bb-66a9-48ff-8013-a6f9eff484d8 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:23.878913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2045e7e-6b36-44ec-a054-b475519ec69e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:23.879258 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2045e7e-6b36-44ec-a054-b475519ec69e service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:23.879537 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2045e7e-6b36-44ec-a054-b475519ec69e service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:23.879810 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2045e7e-6b36-44ec-a054-b475519ec69e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:23.889836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2045e7e-6b36-44ec-a054-b475519ec69e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:23.891259 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2045e7e-6b36-44ec-a054-b475519ec69e service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:23.903264 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1132/2266] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:14:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:14:24.279406 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1423b32-5df2-4882-b703-c709e053caed None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:24.281237 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f1423b32-5df2-4882-b703-c709e053caed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:24.294777 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1423b32-5df2-4882-b703-c709e053caed None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:24.316397 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec03800-4009-4ce7-84ef-8a07fb3425bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:24.317077 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec03800-4009-4ce7-84ef-8a07fb3425bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:24.317386 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec03800-4009-4ce7-84ef-8a07fb3425bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:24.317708 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec03800-4009-4ce7-84ef-8a07fb3425bb admin admin] PATH_INFO: `/v3/projects/e28ef071ab9147e9a5b4b348ae34dfd4` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:24.318800 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec03800-4009-4ce7-84ef-8a07fb3425bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e28ef071ab9147e9a5b4b348ae34dfd4)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:24.320741 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec03800-4009-4ce7-84ef-8a07fb3425bb admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:24.383454 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1ec03800-4009-4ce7-84ef-8a07fb3425bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e28ef071ab9147e9a5b4b348ae34dfd4', 'request_id': 'req-1ec03800-4009-4ce7-84ef-8a07fb3425bb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:24.391253 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1ec03800-4009-4ce7-84ef-8a07fb3425bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e28ef071ab9147e9a5b4b348ae34dfd4', 'request_id': 'req-1ec03800-4009-4ce7-84ef-8a07fb3425bb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:24.403319 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1ec03800-4009-4ce7-84ef-8a07fb3425bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e28ef071ab9147e9a5b4b348ae34dfd4', 'request_id': 'req-1ec03800-4009-4ce7-84ef-8a07fb3425bb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:24.416216 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1ec03800-4009-4ce7-84ef-8a07fb3425bb admin admin] The token cache is being invalidate because project e28ef071ab9147e9a5b4b348ae34dfd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:14:24.416938 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1ec03800-4009-4ce7-84ef-8a07fb3425bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:24.417220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1ec03800-4009-4ce7-84ef-8a07fb3425bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:24.418740 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1135/2267] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:14:24 2022] DELETE /identity/v3/projects/e28ef071ab9147e9a5b4b348ae34dfd4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:14:24.423055 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2045e7e-6b36-44ec-a054-b475519ec69e service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:24.434348 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2045e7e-6b36-44ec-a054-b475519ec69e service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:24.443068 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:24.509689 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ff6a2-2722-467c-80d2-abbfc14e684e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:24.511445 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ff6a2-2722-467c-80d2-abbfc14e684e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:24.511847 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ff6a2-2722-467c-80d2-abbfc14e684e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:24.512205 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ff6a2-2722-467c-80d2-abbfc14e684e admin admin] PATH_INFO: `/v3/users/d4fbdde2812f4c0699120c9cb1fc432f` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:24.513701 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ff6a2-2722-467c-80d2-abbfc14e684e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4fbdde2812f4c0699120c9cb1fc432f)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:24.516328 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ff6a2-2722-467c-80d2-abbfc14e684e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:24.583351 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-015ff6a2-2722-467c-80d2-abbfc14e684e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4fbdde2812f4c0699120c9cb1fc432f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:24.596726 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-015ff6a2-2722-467c-80d2-abbfc14e684e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4fbdde2812f4c0699120c9cb1fc432f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:24.613251 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-015ff6a2-2722-467c-80d2-abbfc14e684e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4fbdde2812f4c0699120c9cb1fc432f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:24.614147 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-015ff6a2-2722-467c-80d2-abbfc14e684e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4fbdde2812f4c0699120c9cb1fc432f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:24.624732 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-015ff6a2-2722-467c-80d2-abbfc14e684e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4fbdde2812f4c0699120c9cb1fc432f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:24.646119 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1133/2268] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:14:24 2022] DELETE /identity/v3/users/d4fbdde2812f4c0699120c9cb1fc432f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:14:25.354315 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec03800-4009-4ce7-84ef-8a07fb3425bb admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:25.355840 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1ec03800-4009-4ce7-84ef-8a07fb3425bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:25.373173 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec03800-4009-4ce7-84ef-8a07fb3425bb admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:25.389240 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:25.447212 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a3bc5-1b18-4ed7-a478-2d17b295e428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:25.448376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a3bc5-1b18-4ed7-a478-2d17b295e428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:25.448654 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a3bc5-1b18-4ed7-a478-2d17b295e428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:25.448925 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a3bc5-1b18-4ed7-a478-2d17b295e428 admin admin] PATH_INFO: `/v3/projects/20a4e69a400d4f009cee0c526d1b9cd7` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:25.450095 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a3bc5-1b18-4ed7-a478-2d17b295e428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20a4e69a400d4f009cee0c526d1b9cd7)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:25.452022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a3bc5-1b18-4ed7-a478-2d17b295e428 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:25.511105 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a15a3bc5-1b18-4ed7-a478-2d17b295e428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20a4e69a400d4f009cee0c526d1b9cd7', 'request_id': 'req-a15a3bc5-1b18-4ed7-a478-2d17b295e428'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:25.517799 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a15a3bc5-1b18-4ed7-a478-2d17b295e428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20a4e69a400d4f009cee0c526d1b9cd7', 'request_id': 'req-a15a3bc5-1b18-4ed7-a478-2d17b295e428'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:25.525468 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a15a3bc5-1b18-4ed7-a478-2d17b295e428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20a4e69a400d4f009cee0c526d1b9cd7', 'request_id': 'req-a15a3bc5-1b18-4ed7-a478-2d17b295e428'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:25.536843 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a15a3bc5-1b18-4ed7-a478-2d17b295e428 admin admin] The token cache is being invalidate because project 20a4e69a400d4f009cee0c526d1b9cd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:14:25.537157 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a15a3bc5-1b18-4ed7-a478-2d17b295e428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:25.537792 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a15a3bc5-1b18-4ed7-a478-2d17b295e428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:25.539286 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1136/2269] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:14:25 2022] DELETE /identity/v3/projects/20a4e69a400d4f009cee0c526d1b9cd7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:14:25.544126 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dd65c-19a0-4b0c-91e6-64a5d208f556 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:25.544590 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dd65c-19a0-4b0c-91e6-64a5d208f556 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:25.544754 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dd65c-19a0-4b0c-91e6-64a5d208f556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:25.564293 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-a71dd65c-19a0-4b0c-91e6-64a5d208f556 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:25.565528 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a71dd65c-19a0-4b0c-91e6-64a5d208f556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:25.629446 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1134/2270] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:25.638672 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85edcd-1465-4628-89bc-d18110ed4403 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:25.638959 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85edcd-1465-4628-89bc-d18110ed4403 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:25.639239 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85edcd-1465-4628-89bc-d18110ed4403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:25.662167 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-fd85edcd-1465-4628-89bc-d18110ed4403 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:25.663571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fd85edcd-1465-4628-89bc-d18110ed4403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:25.672091 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1137/2271] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:14:25.676571 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71dd65c-19a0-4b0c-91e6-64a5d208f556 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:25.686953 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71dd65c-19a0-4b0c-91e6-64a5d208f556 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:25.692017 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0a525-a6fe-45f0-a25c-9c1ea6008b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:25.692604 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0a525-a6fe-45f0-a25c-9c1ea6008b3d admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:25.692879 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0a525-a6fe-45f0-a25c-9c1ea6008b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:25.693173 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0a525-a6fe-45f0-a25c-9c1ea6008b3d admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:25.693815 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0a525-a6fe-45f0-a25c-9c1ea6008b3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:14:25.694111 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0a525-a6fe-45f0-a25c-9c1ea6008b3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:25.695695 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0a525-a6fe-45f0-a25c-9c1ea6008b3d admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:25.707685 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1135/2272] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:14:25.711938 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd85edcd-1465-4628-89bc-d18110ed4403 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:25.722093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd85edcd-1465-4628-89bc-d18110ed4403 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:25.726828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315193d9-1e97-46af-827f-94617b34dba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:25.727485 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315193d9-1e97-46af-827f-94617b34dba0 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:25.727762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315193d9-1e97-46af-827f-94617b34dba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:25.728031 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315193d9-1e97-46af-827f-94617b34dba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:25.728675 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315193d9-1e97-46af-827f-94617b34dba0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:25.730611 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315193d9-1e97-46af-827f-94617b34dba0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:25.757251 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1138/2273] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:14:25 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:14:25.762114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0a525-a6fe-45f0-a25c-9c1ea6008b3d admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:25.771968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0a525-a6fe-45f0-a25c-9c1ea6008b3d admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:25.788809 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:25.831579 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014042ca-8fdb-4b67-95c6-a57ecbfcf01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:25.832174 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014042ca-8fdb-4b67-95c6-a57ecbfcf01c admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:25.832452 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014042ca-8fdb-4b67-95c6-a57ecbfcf01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:25.832724 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014042ca-8fdb-4b67-95c6-a57ecbfcf01c admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:25.833394 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014042ca-8fdb-4b67-95c6-a57ecbfcf01c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:25.835376 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014042ca-8fdb-4b67-95c6-a57ecbfcf01c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:25.859515 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1136/2274] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:14:25 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:14:25.863822 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315193d9-1e97-46af-827f-94617b34dba0 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:25.876542 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315193d9-1e97-46af-827f-94617b34dba0 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:25.882795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c227d9c-0eff-4e52-80fa-0208a520191e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:25.884122 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c227d9c-0eff-4e52-80fa-0208a520191e admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:25.884666 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c227d9c-0eff-4e52-80fa-0208a520191e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:25.885907 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c227d9c-0eff-4e52-80fa-0208a520191e admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:25.887181 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c227d9c-0eff-4e52-80fa-0208a520191e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:25.889341 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c227d9c-0eff-4e52-80fa-0208a520191e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:25.905381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1139/2275] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:14:25.906852 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014042ca-8fdb-4b67-95c6-a57ecbfcf01c admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:25.918154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014042ca-8fdb-4b67-95c6-a57ecbfcf01c admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:25.923578 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afa972-c03a-4ff6-86b1-907c949862d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:25.924177 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afa972-c03a-4ff6-86b1-907c949862d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:25.924555 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afa972-c03a-4ff6-86b1-907c949862d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:25.924811 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afa972-c03a-4ff6-86b1-907c949862d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:25.925954 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afa972-c03a-4ff6-86b1-907c949862d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:25.927860 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afa972-c03a-4ff6-86b1-907c949862d0 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:25.941486 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1137/2276] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:14:25.945819 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c227d9c-0eff-4e52-80fa-0208a520191e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:25.957348 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c227d9c-0eff-4e52-80fa-0208a520191e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:25.963451 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10193ed-be5d-4c39-940f-7ca90797e6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:25.963882 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10193ed-be5d-4c39-940f-7ca90797e6a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:25.964159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10193ed-be5d-4c39-940f-7ca90797e6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:25.964429 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10193ed-be5d-4c39-940f-7ca90797e6a0 admin admin] PATH_INFO: `/v3/projects/bc531dd8634149969600432c97c27bbc/users/64769b193b8a427c82854f20e2f35cdb/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:25.980247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10193ed-be5d-4c39-940f-7ca90797e6a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc531dd8634149969600432c97c27bbc, user_id=64769b193b8a427c82854f20e2f35cdb, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:25.984543 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10193ed-be5d-4c39-940f-7ca90797e6a0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:26.005325 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1140/2277] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:14:25 2022] PUT /identity/v3/projects/bc531dd8634149969600432c97c27bbc/users/64769b193b8a427c82854f20e2f35cdb/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:14:26.016362 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346e738-90d8-4ab0-bfa3-e01f0e4e5f28 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:26.016707 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346e738-90d8-4ab0-bfa3-e01f0e4e5f28 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:26.017121 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346e738-90d8-4ab0-bfa3-e01f0e4e5f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:26.052715 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-8346e738-90d8-4ab0-bfa3-e01f0e4e5f28 None None] MFA Rules not processed for user `64769b193b8a427c82854f20e2f35cdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:26.053983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8346e738-90d8-4ab0-bfa3-e01f0e4e5f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:26.165469 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1138/2278] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:14:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:26.170783 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10193ed-be5d-4c39-940f-7ca90797e6a0 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:26.235527 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:26.258511 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10193ed-be5d-4c39-940f-7ca90797e6a0 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:26.265744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d42c8-f173-4055-992f-5672237135e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:26.265744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d42c8-f173-4055-992f-5672237135e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:26.265744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d42c8-f173-4055-992f-5672237135e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:26.266061 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d42c8-f173-4055-992f-5672237135e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:26.266436 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d42c8-f173-4055-992f-5672237135e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:26.268363 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d42c8-f173-4055-992f-5672237135e5 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:26.299948 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1141/2279] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:14:26 2022] POST /identity/v3/projects => generated 369 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:14:26.304510 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346e738-90d8-4ab0-bfa3-e01f0e4e5f28 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:26.317285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346e738-90d8-4ab0-bfa3-e01f0e4e5f28 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:26.406362 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3106f-4002-4cbd-aaf1-00c5bf6df8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:26.407181 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3106f-4002-4cbd-aaf1-00c5bf6df8c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:26.407496 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3106f-4002-4cbd-aaf1-00c5bf6df8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:26.407830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3106f-4002-4cbd-aaf1-00c5bf6df8c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:26.408476 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3106f-4002-4cbd-aaf1-00c5bf6df8c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:26.410493 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3106f-4002-4cbd-aaf1-00c5bf6df8c9 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:26.446639 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1139/2280] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:14:26 2022] POST /identity/v3/users => generated 291 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:14:26.451160 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d42c8-f173-4055-992f-5672237135e5 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:26.468847 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d42c8-f173-4055-992f-5672237135e5 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:26.481996 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab470d7-4be4-4b53-82cd-e1816457bdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:26.482623 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab470d7-4be4-4b53-82cd-e1816457bdaa admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:26.482893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab470d7-4be4-4b53-82cd-e1816457bdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:26.483158 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab470d7-4be4-4b53-82cd-e1816457bdaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:26.490041 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab470d7-4be4-4b53-82cd-e1816457bdaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:26.493334 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab470d7-4be4-4b53-82cd-e1816457bdaa admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:26.545360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3106f-4002-4cbd-aaf1-00c5bf6df8c9 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:26.552394 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1142/2281] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:14:26.560055 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3106f-4002-4cbd-aaf1-00c5bf6df8c9 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:26.566749 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f0a57-5e24-4c9c-ab14-9f4f274bd082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:26.569693 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f0a57-5e24-4c9c-ab14-9f4f274bd082 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:26.570045 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f0a57-5e24-4c9c-ab14-9f4f274bd082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:26.570409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f0a57-5e24-4c9c-ab14-9f4f274bd082 admin admin] PATH_INFO: `/v3/projects/d73cec99a55c436ba93aea7c360fe8a2/users/b7eed8f491904755a1d0b399b21ad809/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:26.591067 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f0a57-5e24-4c9c-ab14-9f4f274bd082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d73cec99a55c436ba93aea7c360fe8a2, user_id=b7eed8f491904755a1d0b399b21ad809, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:26.594620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f0a57-5e24-4c9c-ab14-9f4f274bd082 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:26.598883 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:26.618594 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1140/2282] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:14:26 2022] PUT /identity/v3/projects/d73cec99a55c436ba93aea7c360fe8a2/users/b7eed8f491904755a1d0b399b21ad809/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:14:26.622916 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab470d7-4be4-4b53-82cd-e1816457bdaa admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:26.633650 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab470d7-4be4-4b53-82cd-e1816457bdaa admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:26.700278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12f4fd-c97e-408c-a28a-4069eef290c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:26.700926 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12f4fd-c97e-408c-a28a-4069eef290c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:26.701394 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12f4fd-c97e-408c-a28a-4069eef290c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:26.701707 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12f4fd-c97e-408c-a28a-4069eef290c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:26.702618 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12f4fd-c97e-408c-a28a-4069eef290c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:26.704351 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12f4fd-c97e-408c-a28a-4069eef290c9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:26.716016 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1143/2283] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:14:26.720190 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f0a57-5e24-4c9c-ab14-9f4f274bd082 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:26.731327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f0a57-5e24-4c9c-ab14-9f4f274bd082 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:26.736042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194cd819-53d7-4012-beac-baaad4c5e331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:26.736678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194cd819-53d7-4012-beac-baaad4c5e331 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:26.736951 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194cd819-53d7-4012-beac-baaad4c5e331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:26.737250 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194cd819-53d7-4012-beac-baaad4c5e331 admin admin] PATH_INFO: `/v3/projects/d73cec99a55c436ba93aea7c360fe8a2/users/b7eed8f491904755a1d0b399b21ad809/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:26.739121 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194cd819-53d7-4012-beac-baaad4c5e331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d73cec99a55c436ba93aea7c360fe8a2, user_id=b7eed8f491904755a1d0b399b21ad809, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:26.741768 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194cd819-53d7-4012-beac-baaad4c5e331 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:26.751850 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1141/2284] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:14:26 2022] PUT /identity/v3/projects/d73cec99a55c436ba93aea7c360fe8a2/users/b7eed8f491904755a1d0b399b21ad809/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:14:26.763082 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b758692-9522-4e63-a6c8-3a0b8efe5e32 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:26.763420 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b758692-9522-4e63-a6c8-3a0b8efe5e32 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:26.763929 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b758692-9522-4e63-a6c8-3a0b8efe5e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:26.797704 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-9b758692-9522-4e63-a6c8-3a0b8efe5e32 None None] MFA Rules not processed for user `b7eed8f491904755a1d0b399b21ad809`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:26.798938 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9b758692-9522-4e63-a6c8-3a0b8efe5e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:26.871744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1144/2285] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:14:26 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:26.882735 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194cd819-53d7-4012-beac-baaad4c5e331 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:26.884399 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-194cd819-53d7-4012-beac-baaad4c5e331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:26.955310 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194cd819-53d7-4012-beac-baaad4c5e331 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:26.958987 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ffaa5-5d19-43bb-9214-dd5c71941f85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:26.959596 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ffaa5-5d19-43bb-9214-dd5c71941f85 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:26.959870 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ffaa5-5d19-43bb-9214-dd5c71941f85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:26.960138 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ffaa5-5d19-43bb-9214-dd5c71941f85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:26.970128 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ffaa5-5d19-43bb-9214-dd5c71941f85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:26.971550 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ffaa5-5d19-43bb-9214-dd5c71941f85 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:26.981220 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1142/2286] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:14:26 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:14:28.378671 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b758692-9522-4e63-a6c8-3a0b8efe5e32 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:28.420483 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:28.443659 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b758692-9522-4e63-a6c8-3a0b8efe5e32 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:28.448233 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4a650-f28d-4e2e-a3c3-a67113ec69b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:28.448855 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4a650-f28d-4e2e-a3c3-a67113ec69b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:28.449166 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4a650-f28d-4e2e-a3c3-a67113ec69b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:28.449441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4a650-f28d-4e2e-a3c3-a67113ec69b1 admin admin] PATH_INFO: `/v3/users/64769b193b8a427c82854f20e2f35cdb` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:28.450554 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4a650-f28d-4e2e-a3c3-a67113ec69b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64769b193b8a427c82854f20e2f35cdb)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:28.452485 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4a650-f28d-4e2e-a3c3-a67113ec69b1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:28.497182 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-eec4a650-f28d-4e2e-a3c3-a67113ec69b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64769b193b8a427c82854f20e2f35cdb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:28.505484 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-eec4a650-f28d-4e2e-a3c3-a67113ec69b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64769b193b8a427c82854f20e2f35cdb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:28.517959 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-eec4a650-f28d-4e2e-a3c3-a67113ec69b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64769b193b8a427c82854f20e2f35cdb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:28.518598 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-eec4a650-f28d-4e2e-a3c3-a67113ec69b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64769b193b8a427c82854f20e2f35cdb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:28.525418 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-eec4a650-f28d-4e2e-a3c3-a67113ec69b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64769b193b8a427c82854f20e2f35cdb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:28.531532 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1145/2287] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:14:28 2022] DELETE /identity/v3/users/64769b193b8a427c82854f20e2f35cdb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:14:28.535955 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d4622-24e2-4bb9-bf99-a1e39fc5f054 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:28.536396 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d4622-24e2-4bb9-bf99-a1e39fc5f054 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:28.536526 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d4622-24e2-4bb9-bf99-a1e39fc5f054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:28.556407 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e67d4622-24e2-4bb9-bf99-a1e39fc5f054 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:28.557967 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e67d4622-24e2-4bb9-bf99-a1e39fc5f054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:28.617534 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1143/2288] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:28.627136 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4a650-f28d-4e2e-a3c3-a67113ec69b1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:28.628535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-eec4a650-f28d-4e2e-a3c3-a67113ec69b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:28.685721 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4a650-f28d-4e2e-a3c3-a67113ec69b1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:28.689412 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f467924-a6a3-4f76-be8a-6f124a6e5302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:28.690015 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f467924-a6a3-4f76-be8a-6f124a6e5302 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:28.690296 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f467924-a6a3-4f76-be8a-6f124a6e5302 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:28.690566 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f467924-a6a3-4f76-be8a-6f124a6e5302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:28.699721 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f467924-a6a3-4f76-be8a-6f124a6e5302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:28.701199 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f467924-a6a3-4f76-be8a-6f124a6e5302 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:28.710685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1146/2289] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:14:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:14:29.068327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d4622-24e2-4bb9-bf99-a1e39fc5f054 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:29.069832 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e67d4622-24e2-4bb9-bf99-a1e39fc5f054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:29.084848 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d4622-24e2-4bb9-bf99-a1e39fc5f054 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:29.090230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58952c9d-4147-4553-93ce-c78b4b17bc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:29.090978 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58952c9d-4147-4553-93ce-c78b4b17bc1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:29.091457 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58952c9d-4147-4553-93ce-c78b4b17bc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:29.091957 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58952c9d-4147-4553-93ce-c78b4b17bc1a admin admin] PATH_INFO: `/v3/projects/bc531dd8634149969600432c97c27bbc` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:29.093523 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58952c9d-4147-4553-93ce-c78b4b17bc1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc531dd8634149969600432c97c27bbc)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:29.097356 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58952c9d-4147-4553-93ce-c78b4b17bc1a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:29.148513 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-58952c9d-4147-4553-93ce-c78b4b17bc1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc531dd8634149969600432c97c27bbc', 'request_id': 'req-58952c9d-4147-4553-93ce-c78b4b17bc1a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:29.156786 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-58952c9d-4147-4553-93ce-c78b4b17bc1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc531dd8634149969600432c97c27bbc', 'request_id': 'req-58952c9d-4147-4553-93ce-c78b4b17bc1a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:29.162549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-58952c9d-4147-4553-93ce-c78b4b17bc1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc531dd8634149969600432c97c27bbc', 'request_id': 'req-58952c9d-4147-4553-93ce-c78b4b17bc1a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:29.173884 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-58952c9d-4147-4553-93ce-c78b4b17bc1a admin admin] The token cache is being invalidate because project bc531dd8634149969600432c97c27bbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:14:29.174213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-58952c9d-4147-4553-93ce-c78b4b17bc1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:29.174814 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-58952c9d-4147-4553-93ce-c78b4b17bc1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:29.176440 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1144/2290] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:14:29 2022] DELETE /identity/v3/projects/bc531dd8634149969600432c97c27bbc => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:14:29.180445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f467924-a6a3-4f76-be8a-6f124a6e5302 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:29.190277 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f467924-a6a3-4f76-be8a-6f124a6e5302 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:29.246101 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c3670-b3d9-4b92-97ce-e1670ed04722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:29.246717 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c3670-b3d9-4b92-97ce-e1670ed04722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:29.246991 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c3670-b3d9-4b92-97ce-e1670ed04722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:29.247259 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c3670-b3d9-4b92-97ce-e1670ed04722 admin admin] PATH_INFO: `/v3/users/b7eed8f491904755a1d0b399b21ad809` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:29.248362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c3670-b3d9-4b92-97ce-e1670ed04722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7eed8f491904755a1d0b399b21ad809)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:29.250290 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c3670-b3d9-4b92-97ce-e1670ed04722 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:29.251722 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:29.298825 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3c0c3670-b3d9-4b92-97ce-e1670ed04722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7eed8f491904755a1d0b399b21ad809'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:29.305719 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3c0c3670-b3d9-4b92-97ce-e1670ed04722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7eed8f491904755a1d0b399b21ad809'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:29.317905 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3c0c3670-b3d9-4b92-97ce-e1670ed04722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7eed8f491904755a1d0b399b21ad809'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:29.318547 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3c0c3670-b3d9-4b92-97ce-e1670ed04722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7eed8f491904755a1d0b399b21ad809'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:29.325994 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3c0c3670-b3d9-4b92-97ce-e1670ed04722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7eed8f491904755a1d0b399b21ad809'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:29.331939 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1147/2291] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:14:29 2022] DELETE /identity/v3/users/b7eed8f491904755a1d0b399b21ad809 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:14:29.605754 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58952c9d-4147-4553-93ce-c78b4b17bc1a admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:29.607295 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-58952c9d-4147-4553-93ce-c78b4b17bc1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:29.633673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58952c9d-4147-4553-93ce-c78b4b17bc1a admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:29.638125 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:29.692076 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb2ec9-0374-4aaf-a474-0febb478fe87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:29.692617 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb2ec9-0374-4aaf-a474-0febb478fe87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:29.692889 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb2ec9-0374-4aaf-a474-0febb478fe87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:29.693188 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb2ec9-0374-4aaf-a474-0febb478fe87 admin admin] PATH_INFO: `/v3/projects/d73cec99a55c436ba93aea7c360fe8a2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:29.694294 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb2ec9-0374-4aaf-a474-0febb478fe87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d73cec99a55c436ba93aea7c360fe8a2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:29.696183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb2ec9-0374-4aaf-a474-0febb478fe87 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:29.745622 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-cceb2ec9-0374-4aaf-a474-0febb478fe87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd73cec99a55c436ba93aea7c360fe8a2', 'request_id': 'req-cceb2ec9-0374-4aaf-a474-0febb478fe87'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:29.753412 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-cceb2ec9-0374-4aaf-a474-0febb478fe87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd73cec99a55c436ba93aea7c360fe8a2', 'request_id': 'req-cceb2ec9-0374-4aaf-a474-0febb478fe87'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:29.758956 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-cceb2ec9-0374-4aaf-a474-0febb478fe87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd73cec99a55c436ba93aea7c360fe8a2', 'request_id': 'req-cceb2ec9-0374-4aaf-a474-0febb478fe87'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:29.770397 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-cceb2ec9-0374-4aaf-a474-0febb478fe87 admin admin] The token cache is being invalidate because project d73cec99a55c436ba93aea7c360fe8a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:14:29.770682 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-cceb2ec9-0374-4aaf-a474-0febb478fe87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:29.771296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-cceb2ec9-0374-4aaf-a474-0febb478fe87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:29.772769 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1145/2292] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:14:29 2022] DELETE /identity/v3/projects/d73cec99a55c436ba93aea7c360fe8a2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:14:29.778301 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aece7a-5119-4333-86e9-3ec5b433b4bd None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:29.778763 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aece7a-5119-4333-86e9-3ec5b433b4bd None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:29.778856 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aece7a-5119-4333-86e9-3ec5b433b4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:29.799136 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e5aece7a-5119-4333-86e9-3ec5b433b4bd None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:29.800332 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e5aece7a-5119-4333-86e9-3ec5b433b4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:29.871745 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1148/2293] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:29.880585 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25c78e-7fa4-40a3-a87c-163265ad4248 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:29.880864 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25c78e-7fa4-40a3-a87c-163265ad4248 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:29.881165 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25c78e-7fa4-40a3-a87c-163265ad4248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:29.900900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-6f25c78e-7fa4-40a3-a87c-163265ad4248 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:29.902194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-6f25c78e-7fa4-40a3-a87c-163265ad4248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:29.910444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1146/2294] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:29.914505 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aece7a-5119-4333-86e9-3ec5b433b4bd None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:29.924837 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aece7a-5119-4333-86e9-3ec5b433b4bd None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:29.929592 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069a580-d9f1-4d12-bd8c-0f6ea92d1355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:29.930189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069a580-d9f1-4d12-bd8c-0f6ea92d1355 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:29.930466 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069a580-d9f1-4d12-bd8c-0f6ea92d1355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:29.930730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069a580-d9f1-4d12-bd8c-0f6ea92d1355 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:29.931362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069a580-d9f1-4d12-bd8c-0f6ea92d1355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:14:29.931678 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069a580-d9f1-4d12-bd8c-0f6ea92d1355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:29.933910 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069a580-d9f1-4d12-bd8c-0f6ea92d1355 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:29.945347 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1149/2295] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:14:29.951026 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25c78e-7fa4-40a3-a87c-163265ad4248 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:29.960351 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25c78e-7fa4-40a3-a87c-163265ad4248 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:29.965028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0600857-f117-44dd-8fee-ba57930bce84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:29.965871 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0600857-f117-44dd-8fee-ba57930bce84 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:29.965987 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0600857-f117-44dd-8fee-ba57930bce84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:29.966185 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0600857-f117-44dd-8fee-ba57930bce84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:29.966834 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0600857-f117-44dd-8fee-ba57930bce84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:29.968722 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0600857-f117-44dd-8fee-ba57930bce84 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:29.997626 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1147/2296] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:14:29 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:14:30.001891 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069a580-d9f1-4d12-bd8c-0f6ea92d1355 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:30.012650 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069a580-d9f1-4d12-bd8c-0f6ea92d1355 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:30.095597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293999a0-1a08-4973-bc04-9623a2d35ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:30.096537 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293999a0-1a08-4973-bc04-9623a2d35ddc admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:30.096812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293999a0-1a08-4973-bc04-9623a2d35ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:30.097078 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293999a0-1a08-4973-bc04-9623a2d35ddc admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:30.097742 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293999a0-1a08-4973-bc04-9623a2d35ddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:30.099691 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293999a0-1a08-4973-bc04-9623a2d35ddc admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:30.115504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:30.132116 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1150/2297] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:14:30 2022] POST /identity/v3/users => generated 285 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:14:30.149487 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0600857-f117-44dd-8fee-ba57930bce84 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:30.165775 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0600857-f117-44dd-8fee-ba57930bce84 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:30.173071 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce6cc9-fd7c-4e10-b262-767e9d8c69a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:30.173827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce6cc9-fd7c-4e10-b262-767e9d8c69a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:30.174206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce6cc9-fd7c-4e10-b262-767e9d8c69a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:30.174597 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce6cc9-fd7c-4e10-b262-767e9d8c69a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:30.175721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce6cc9-fd7c-4e10-b262-767e9d8c69a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:30.177228 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce6cc9-fd7c-4e10-b262-767e9d8c69a9 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:30.190916 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1148/2298] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:14:30.194752 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293999a0-1a08-4973-bc04-9623a2d35ddc admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:30.205963 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293999a0-1a08-4973-bc04-9623a2d35ddc admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:30.211275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b446b9f-9cc5-4672-8a25-1741d0b0db3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:30.212198 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b446b9f-9cc5-4672-8a25-1741d0b0db3a admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:30.212528 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b446b9f-9cc5-4672-8a25-1741d0b0db3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:30.212893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b446b9f-9cc5-4672-8a25-1741d0b0db3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:30.213804 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b446b9f-9cc5-4672-8a25-1741d0b0db3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:30.215411 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b446b9f-9cc5-4672-8a25-1741d0b0db3a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:30.226892 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1151/2299] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:14:30.231772 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce6cc9-fd7c-4e10-b262-767e9d8c69a9 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:30.246141 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce6cc9-fd7c-4e10-b262-767e9d8c69a9 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:30.252507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f299b0-345b-4a3d-8724-189ff0cf4fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:30.253388 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f299b0-345b-4a3d-8724-189ff0cf4fcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:30.253838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f299b0-345b-4a3d-8724-189ff0cf4fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:30.254176 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f299b0-345b-4a3d-8724-189ff0cf4fcf admin admin] PATH_INFO: `/v3/projects/7ce630fa2dd243e0bcf557951ed6c486/users/1d752b0942f242eb8f760ba31f777f83/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:30.281904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f299b0-345b-4a3d-8724-189ff0cf4fcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce630fa2dd243e0bcf557951ed6c486, user_id=1d752b0942f242eb8f760ba31f777f83, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:30.284712 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f299b0-345b-4a3d-8724-189ff0cf4fcf admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:30.304976 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1149/2300] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:14:30 2022] PUT /identity/v3/projects/7ce630fa2dd243e0bcf557951ed6c486/users/1d752b0942f242eb8f760ba31f777f83/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:14:30.315258 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d003110-7540-469c-922d-970bc507a5ac None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:30.315577 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d003110-7540-469c-922d-970bc507a5ac None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:30.315821 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d003110-7540-469c-922d-970bc507a5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:30.345539 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-6d003110-7540-469c-922d-970bc507a5ac None None] MFA Rules not processed for user `1d752b0942f242eb8f760ba31f777f83`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:30.346773 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6d003110-7540-469c-922d-970bc507a5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:30.446806 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1152/2301] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:14:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:30.458715 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f299b0-345b-4a3d-8724-189ff0cf4fcf admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:30.461043 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-77f299b0-345b-4a3d-8724-189ff0cf4fcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:30.501786 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:30.527025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f299b0-345b-4a3d-8724-189ff0cf4fcf admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:30.532144 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6a466-e9fc-472e-91c7-a2fa9a7576f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22959df6ef034036b5f6b3cda7918e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:30.532733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6a466-e9fc-472e-91c7-a2fa9a7576f1 service glance] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:30.533006 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6a466-e9fc-472e-91c7-a2fa9a7576f1 service glance] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:30.533301 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6a466-e9fc-472e-91c7-a2fa9a7576f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:30.543652 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6a466-e9fc-472e-91c7-a2fa9a7576f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:30.545303 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6a466-e9fc-472e-91c7-a2fa9a7576f1 service glance] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:30.555718 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1150/2302] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:14:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:14:31.754869 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c778c-49a4-4b96-a40f-c48d9616927d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:31.755349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c778c-49a4-4b96-a40f-c48d9616927d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:31.755783 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c778c-49a4-4b96-a40f-c48d9616927d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:31.785571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5c6c778c-49a4-4b96-a40f-c48d9616927d None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:31.787936 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5c6c778c-49a4-4b96-a40f-c48d9616927d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:31.854982 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1153/2303] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Sep 13 14:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:31.879918 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6a466-e9fc-472e-91c7-a2fa9a7576f1 service glance] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:31.881357 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-cde6a466-e9fc-472e-91c7-a2fa9a7576f1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:31.955305 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6a466-e9fc-472e-91c7-a2fa9a7576f1 service glance] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:31.960731 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f278c-9cc5-4391-95a5-db9babedc183 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:31.961353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f278c-9cc5-4391-95a5-db9babedc183 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:31.961627 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f278c-9cc5-4391-95a5-db9babedc183 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:31.961893 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f278c-9cc5-4391-95a5-db9babedc183 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:31.970534 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f278c-9cc5-4391-95a5-db9babedc183 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:31.972125 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f278c-9cc5-4391-95a5-db9babedc183 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:31.982374 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1151/2304] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:14:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:14:38.929412 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6754f-8417-424b-a688-877935ff9225 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:38.929995 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6754f-8417-424b-a688-877935ff9225 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:38.929995 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6754f-8417-424b-a688-877935ff9225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:38.950361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-feb6754f-8417-424b-a688-877935ff9225 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:38.951578 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-feb6754f-8417-424b-a688-877935ff9225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:38.959540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1154/2305] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Sep 13 14:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:38.982105 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f278c-9cc5-4391-95a5-db9babedc183 service nova] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:38.983830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-db7f278c-9cc5-4391-95a5-db9babedc183 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:38.999671 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f278c-9cc5-4391-95a5-db9babedc183 service nova] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:39.006342 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a398fd8-1ced-4acd-b53e-846a18870d94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:39.006955 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a398fd8-1ced-4acd-b53e-846a18870d94 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:39.007231 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a398fd8-1ced-4acd-b53e-846a18870d94 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:39.007499 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a398fd8-1ced-4acd-b53e-846a18870d94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:39.017263 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a398fd8-1ced-4acd-b53e-846a18870d94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:39.018832 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a398fd8-1ced-4acd-b53e-846a18870d94 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:39.028820 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1152/2306] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:14:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:14:42.525325 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604e13a-0ee3-4ff2-a2e3-83931dea9a0d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:42.525823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604e13a-0ee3-4ff2-a2e3-83931dea9a0d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:42.526633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604e13a-0ee3-4ff2-a2e3-83931dea9a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:42.547312 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5604e13a-0ee3-4ff2-a2e3-83931dea9a0d None None] MFA Rules not processed for user `0c41b4ecb17a43fdb05e586cce43b5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:42.548485 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5604e13a-0ee3-4ff2-a2e3-83931dea9a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:42.609046 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1155/2307] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 13 14:14:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:42.658371 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a398fd8-1ced-4acd-b53e-846a18870d94 service nova] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:42.659864 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-6a398fd8-1ced-4acd-b53e-846a18870d94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:42.732647 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a398fd8-1ced-4acd-b53e-846a18870d94 service nova] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:42.737795 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363bfde-a0c6-456c-9038-eb69f16ab005 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c27e930f604bd38634ca08e56cf8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:42.738464 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363bfde-a0c6-456c-9038-eb69f16ab005 service swift] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:42.738814 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363bfde-a0c6-456c-9038-eb69f16ab005 service swift] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:42.739080 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363bfde-a0c6-456c-9038-eb69f16ab005 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:42.749015 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363bfde-a0c6-456c-9038-eb69f16ab005 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:42.750622 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363bfde-a0c6-456c-9038-eb69f16ab005 service swift] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:42.759674 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1153/2308] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 13 14:14:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 14:14:43.276960 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184af367-8668-41ed-8387-70ab05924988 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:43.277392 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184af367-8668-41ed-8387-70ab05924988 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:43.277591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184af367-8668-41ed-8387-70ab05924988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:43.298543 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-184af367-8668-41ed-8387-70ab05924988 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:43.299805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-184af367-8668-41ed-8387-70ab05924988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:43.308246 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1156/2309] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Sep 13 14:14:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:43.645069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363bfde-a0c6-456c-9038-eb69f16ab005 service swift] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:43.658577 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363bfde-a0c6-456c-9038-eb69f16ab005 service swift] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:43.664963 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ff7f1-0d4e-4f40-934f-1083b006b002 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:43.665602 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ff7f1-0d4e-4f40-934f-1083b006b002 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:43.665878 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ff7f1-0d4e-4f40-934f-1083b006b002 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:43.666171 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ff7f1-0d4e-4f40-934f-1083b006b002 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:43.678593 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ff7f1-0d4e-4f40-934f-1083b006b002 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:43.680827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ff7f1-0d4e-4f40-934f-1083b006b002 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:43.696353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1154/2310] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:14:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:14:46.333162 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184af367-8668-41ed-8387-70ab05924988 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:46.334668 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-184af367-8668-41ed-8387-70ab05924988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:46.348481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184af367-8668-41ed-8387-70ab05924988 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:46.354077 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ead95-896d-42d4-9dff-17bd1b917e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:46.355324 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ead95-896d-42d4-9dff-17bd1b917e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:46.355695 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ead95-896d-42d4-9dff-17bd1b917e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:46.356017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ead95-896d-42d4-9dff-17bd1b917e89 admin admin] PATH_INFO: `/v3/users/e26fc979637c4110beab76f1f26e5918` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:46.357273 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ead95-896d-42d4-9dff-17bd1b917e89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e26fc979637c4110beab76f1f26e5918)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:46.359280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ead95-896d-42d4-9dff-17bd1b917e89 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:46.361193 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:46.415586 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-6d8ead95-896d-42d4-9dff-17bd1b917e89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e26fc979637c4110beab76f1f26e5918'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:46.425971 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-6d8ead95-896d-42d4-9dff-17bd1b917e89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e26fc979637c4110beab76f1f26e5918'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:46.442703 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-6d8ead95-896d-42d4-9dff-17bd1b917e89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e26fc979637c4110beab76f1f26e5918'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:46.443820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-6d8ead95-896d-42d4-9dff-17bd1b917e89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e26fc979637c4110beab76f1f26e5918'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:46.452226 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-6d8ead95-896d-42d4-9dff-17bd1b917e89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e26fc979637c4110beab76f1f26e5918'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:46.458354 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1157/2311] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:14:46 2022] DELETE /identity/v3/users/e26fc979637c4110beab76f1f26e5918 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:14:46.462730 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b14f0f-26e1-42f3-af48-b8288e10228d None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:46.463243 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b14f0f-26e1-42f3-af48-b8288e10228d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:46.463243 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b14f0f-26e1-42f3-af48-b8288e10228d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:46.484747 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e6b14f0f-26e1-42f3-af48-b8288e10228d None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:46.486018 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e6b14f0f-26e1-42f3-af48-b8288e10228d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:46.506831 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:46.555299 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1155/2312] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:14:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:46.574958 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ead95-896d-42d4-9dff-17bd1b917e89 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:46.576633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6d8ead95-896d-42d4-9dff-17bd1b917e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:46.643839 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ead95-896d-42d4-9dff-17bd1b917e89 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:46.647925 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657f1a7-c576-48be-84be-c9aea3f1af64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:46.648790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657f1a7-c576-48be-84be-c9aea3f1af64 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:46.649296 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657f1a7-c576-48be-84be-c9aea3f1af64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:46.649578 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657f1a7-c576-48be-84be-c9aea3f1af64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:46.662329 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657f1a7-c576-48be-84be-c9aea3f1af64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:46.662666 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657f1a7-c576-48be-84be-c9aea3f1af64 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:46.674026 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1158/2313] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:14:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:14:47.015042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b14f0f-26e1-42f3-af48-b8288e10228d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:47.016682 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e6b14f0f-26e1-42f3-af48-b8288e10228d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:47.036617 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b14f0f-26e1-42f3-af48-b8288e10228d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:47.043694 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b0307-1e6b-4cbf-a86b-2a151a7bcc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:47.044530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b0307-1e6b-4cbf-a86b-2a151a7bcc91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:47.044881 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b0307-1e6b-4cbf-a86b-2a151a7bcc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:47.045192 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b0307-1e6b-4cbf-a86b-2a151a7bcc91 admin admin] PATH_INFO: `/v3/projects/e1dc299bd30a41ad9d5a56d0d8406920` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:47.046685 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b0307-1e6b-4cbf-a86b-2a151a7bcc91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1dc299bd30a41ad9d5a56d0d8406920)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:47.048964 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b0307-1e6b-4cbf-a86b-2a151a7bcc91 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:47.200001 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-cf3b0307-1e6b-4cbf-a86b-2a151a7bcc91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1dc299bd30a41ad9d5a56d0d8406920', 'request_id': 'req-cf3b0307-1e6b-4cbf-a86b-2a151a7bcc91'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:47.228586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-cf3b0307-1e6b-4cbf-a86b-2a151a7bcc91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1dc299bd30a41ad9d5a56d0d8406920', 'request_id': 'req-cf3b0307-1e6b-4cbf-a86b-2a151a7bcc91'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:47.242732 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-cf3b0307-1e6b-4cbf-a86b-2a151a7bcc91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1dc299bd30a41ad9d5a56d0d8406920', 'request_id': 'req-cf3b0307-1e6b-4cbf-a86b-2a151a7bcc91'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:47.258401 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-cf3b0307-1e6b-4cbf-a86b-2a151a7bcc91 admin admin] The token cache is being invalidate because project e1dc299bd30a41ad9d5a56d0d8406920 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:14:47.258691 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-cf3b0307-1e6b-4cbf-a86b-2a151a7bcc91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:47.259467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-cf3b0307-1e6b-4cbf-a86b-2a151a7bcc91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:14:47.262013 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1156/2314] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:14:47 2022] DELETE /identity/v3/projects/e1dc299bd30a41ad9d5a56d0d8406920 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:14:47.267714 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd5437-2e6f-4874-8a31-3c9c0bfa2b90 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:47.268268 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd5437-2e6f-4874-8a31-3c9c0bfa2b90 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:47.268937 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd5437-2e6f-4874-8a31-3c9c0bfa2b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:47.301006 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-9bcd5437-2e6f-4874-8a31-3c9c0bfa2b90 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:47.302412 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9bcd5437-2e6f-4874-8a31-3c9c0bfa2b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:47.402025 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1159/2315] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:14:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:47.407440 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c46aa-73cc-485e-b51d-f86ed0dd9854 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:47.408594 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c46aa-73cc-485e-b51d-f86ed0dd9854 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:47.408892 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c46aa-73cc-485e-b51d-f86ed0dd9854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:47.446940 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-301c46aa-73cc-485e-b51d-f86ed0dd9854 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:47.448578 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-301c46aa-73cc-485e-b51d-f86ed0dd9854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:47.481314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1157/2316] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:14:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:47.483477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd5437-2e6f-4874-8a31-3c9c0bfa2b90 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:47.500480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd5437-2e6f-4874-8a31-3c9c0bfa2b90 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:47.507015 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23349aee-3daf-4844-b965-0398da72e096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:47.507581 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23349aee-3daf-4844-b965-0398da72e096 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:47.507856 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23349aee-3daf-4844-b965-0398da72e096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:47.508255 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23349aee-3daf-4844-b965-0398da72e096 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:47.509191 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23349aee-3daf-4844-b965-0398da72e096 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:14:47.509415 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23349aee-3daf-4844-b965-0398da72e096 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:47.512045 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23349aee-3daf-4844-b965-0398da72e096 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:47.533432 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1160/2317] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:14:47.535292 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c46aa-73cc-485e-b51d-f86ed0dd9854 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:47.547464 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c46aa-73cc-485e-b51d-f86ed0dd9854 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:47.556299 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3f92d-0dc1-4ae3-80d7-1a600cf16a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:47.557007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3f92d-0dc1-4ae3-80d7-1a600cf16a6c admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:47.557959 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3f92d-0dc1-4ae3-80d7-1a600cf16a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:47.558231 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3f92d-0dc1-4ae3-80d7-1a600cf16a6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:47.561431 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3f92d-0dc1-4ae3-80d7-1a600cf16a6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:47.564824 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3f92d-0dc1-4ae3-80d7-1a600cf16a6c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:47.603733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1158/2318] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:14:47 2022] POST /identity/v3/projects => generated 363 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:14:47.605615 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23349aee-3daf-4844-b965-0398da72e096 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:47.620459 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23349aee-3daf-4844-b965-0398da72e096 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:47.633413 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:47.710049 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff4159-4acf-4177-ba9d-a3bb90b81a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:47.710664 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff4159-4acf-4177-ba9d-a3bb90b81a8e admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:47.710946 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff4159-4acf-4177-ba9d-a3bb90b81a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:47.711360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff4159-4acf-4177-ba9d-a3bb90b81a8e admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:47.712644 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff4159-4acf-4177-ba9d-a3bb90b81a8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:47.716773 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff4159-4acf-4177-ba9d-a3bb90b81a8e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:47.758496 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1161/2319] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:14:47 2022] POST /identity/v3/users => generated 282 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:14:47.762812 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3f92d-0dc1-4ae3-80d7-1a600cf16a6c admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:47.778019 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3f92d-0dc1-4ae3-80d7-1a600cf16a6c admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:47.783467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43033dc-3690-48e1-b81b-94898d7707a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:47.784083 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43033dc-3690-48e1-b81b-94898d7707a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:47.784361 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43033dc-3690-48e1-b81b-94898d7707a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:47.784633 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43033dc-3690-48e1-b81b-94898d7707a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:47.785313 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43033dc-3690-48e1-b81b-94898d7707a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:47.787498 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43033dc-3690-48e1-b81b-94898d7707a4 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:47.804821 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1159/2320] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:14:47.809051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff4159-4acf-4177-ba9d-a3bb90b81a8e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:47.829328 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff4159-4acf-4177-ba9d-a3bb90b81a8e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:47.836912 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc30503-e86d-4ed0-9eb8-50e3461ed166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:47.837945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc30503-e86d-4ed0-9eb8-50e3461ed166 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:47.838232 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc30503-e86d-4ed0-9eb8-50e3461ed166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:47.838960 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc30503-e86d-4ed0-9eb8-50e3461ed166 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:47.839980 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc30503-e86d-4ed0-9eb8-50e3461ed166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:47.842210 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc30503-e86d-4ed0-9eb8-50e3461ed166 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:47.858611 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1162/2321] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:14:47.862636 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43033dc-3690-48e1-b81b-94898d7707a4 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:47.876753 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43033dc-3690-48e1-b81b-94898d7707a4 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:47.889541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5ade5-be14-470a-b580-6bc01c678c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:47.891146 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5ade5-be14-470a-b580-6bc01c678c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:47.891146 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5ade5-be14-470a-b580-6bc01c678c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:47.891146 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5ade5-be14-470a-b580-6bc01c678c53 admin admin] PATH_INFO: `/v3/projects/560a7e5f94f24f2586721fabaf66cde4/users/bea634471fee441695f9d481a6c32616/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:47.911850 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5ade5-be14-470a-b580-6bc01c678c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=560a7e5f94f24f2586721fabaf66cde4, user_id=bea634471fee441695f9d481a6c32616, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:47.914601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5ade5-be14-470a-b580-6bc01c678c53 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:47.933137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1160/2322] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:14:47 2022] PUT /identity/v3/projects/560a7e5f94f24f2586721fabaf66cde4/users/bea634471fee441695f9d481a6c32616/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:14:47.941268 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe663ef-850c-4bb9-9677-90eb3a70ff26 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:47.942176 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe663ef-850c-4bb9-9677-90eb3a70ff26 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:47.942625 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe663ef-850c-4bb9-9677-90eb3a70ff26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:47.983354 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-bfe663ef-850c-4bb9-9677-90eb3a70ff26 None None] MFA Rules not processed for user `bea634471fee441695f9d481a6c32616`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:47.984781 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-bfe663ef-850c-4bb9-9677-90eb3a70ff26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:48.057775 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1163/2323] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:14:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:48.069540 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5ade5-be14-470a-b580-6bc01c678c53 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:48.071279 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a4f5ade5-be14-470a-b580-6bc01c678c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:48.119601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:48.132003 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5ade5-be14-470a-b580-6bc01c678c53 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:48.136210 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa0b07-d179-48be-8de9-301e4c49189c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:48.136809 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa0b07-d179-48be-8de9-301e4c49189c service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:48.137085 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa0b07-d179-48be-8de9-301e4c49189c service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:48.137385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa0b07-d179-48be-8de9-301e4c49189c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:48.145714 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa0b07-d179-48be-8de9-301e4c49189c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:48.147132 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa0b07-d179-48be-8de9-301e4c49189c service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:48.156944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1161/2324] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:14:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:14:50.550623 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f225d-25eb-404a-aff4-6a45775320c6 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:50.551530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f225d-25eb-404a-aff4-6a45775320c6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:50.551530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f225d-25eb-404a-aff4-6a45775320c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:50.609321 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-817f225d-25eb-404a-aff4-6a45775320c6 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:50.609321 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-817f225d-25eb-404a-aff4-6a45775320c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:50.736364 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1164/2325] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Sep 13 14:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:50.768733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa0b07-d179-48be-8de9-301e4c49189c service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:50.771204 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-80fa0b07-d179-48be-8de9-301e4c49189c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:50.941605 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa0b07-d179-48be-8de9-301e4c49189c service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:50.949813 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e54596-48d3-4c3b-bd4d-d2479c9c8be9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:50.950520 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e54596-48d3-4c3b-bd4d-d2479c9c8be9 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:50.950909 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e54596-48d3-4c3b-bd4d-d2479c9c8be9 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:50.951291 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e54596-48d3-4c3b-bd4d-d2479c9c8be9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:50.961276 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e54596-48d3-4c3b-bd4d-d2479c9c8be9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:50.962927 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e54596-48d3-4c3b-bd4d-d2479c9c8be9 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:50.974865 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1162/2326] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:14:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:14:52.045188 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36a4c7-8b4d-4893-83d8-a09a8201b1b1 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:52.045728 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36a4c7-8b4d-4893-83d8-a09a8201b1b1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:52.046110 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36a4c7-8b4d-4893-83d8-a09a8201b1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:52.067253 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-2a36a4c7-8b4d-4893-83d8-a09a8201b1b1 None None] MFA Rules not processed for user `8dd5ec91cd29468f97cb3045c12b819f`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:52.068481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2a36a4c7-8b4d-4893-83d8-a09a8201b1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:52.080753 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:52.125129 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1165/2327] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:14:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:55.872026 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41643a-2453-4504-8f93-d3f880ccdc0b None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:55.873022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41643a-2453-4504-8f93-d3f880ccdc0b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:55.873445 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41643a-2453-4504-8f93-d3f880ccdc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:55.899788 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-5d41643a-2453-4504-8f93-d3f880ccdc0b None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:14:55.902004 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5d41643a-2453-4504-8f93-d3f880ccdc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:55.911567 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1163/2328] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Sep 13 14:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:14:55.934572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36a4c7-8b4d-4893-83d8-a09a8201b1b1 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:14:55.936152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2a36a4c7-8b4d-4893-83d8-a09a8201b1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:14:55.955889 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36a4c7-8b4d-4893-83d8-a09a8201b1b1 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:14:55.962686 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6052c4-b4fb-4b58-87b0-f4bfcbe24657 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:14:55.963333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6052c4-b4fb-4b58-87b0-f4bfcbe24657 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:14:55.963612 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6052c4-b4fb-4b58-87b0-f4bfcbe24657 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:14:55.963906 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6052c4-b4fb-4b58-87b0-f4bfcbe24657 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:14:55.974449 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6052c4-b4fb-4b58-87b0-f4bfcbe24657 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:14:55.976090 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6052c4-b4fb-4b58-87b0-f4bfcbe24657 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:14:55.999553 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1166/2329] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:14:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:15:00.235269 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb31b4-4c45-4b1d-9731-2880b42dde77 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:00.235904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb31b4-4c45-4b1d-9731-2880b42dde77 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:00.236152 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb31b4-4c45-4b1d-9731-2880b42dde77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:00.260146 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-63bb31b4-4c45-4b1d-9731-2880b42dde77 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:15:00.262000 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-63bb31b4-4c45-4b1d-9731-2880b42dde77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:00.270639 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1164/2330] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Sep 13 14:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:15:00.305274 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6052c4-b4fb-4b58-87b0-f4bfcbe24657 service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:00.317334 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6052c4-b4fb-4b58-87b0-f4bfcbe24657 service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:00.322912 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d3ec9-2bb3-4096-a36c-c16836e6b467 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:00.323506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d3ec9-2bb3-4096-a36c-c16836e6b467 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:00.323788 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d3ec9-2bb3-4096-a36c-c16836e6b467 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:00.324064 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d3ec9-2bb3-4096-a36c-c16836e6b467 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:00.333947 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d3ec9-2bb3-4096-a36c-c16836e6b467 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:00.335580 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d3ec9-2bb3-4096-a36c-c16836e6b467 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:00.347950 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1167/2331] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:15:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:15:09.227499 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb31b4-4c45-4b1d-9731-2880b42dde77 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:09.229631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-63bb31b4-4c45-4b1d-9731-2880b42dde77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:09.243917 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb31b4-4c45-4b1d-9731-2880b42dde77 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:09.248681 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52eca1-7387-4341-9ecf-ea5ce330bbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:09.249360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52eca1-7387-4341-9ecf-ea5ce330bbc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:09.249636 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52eca1-7387-4341-9ecf-ea5ce330bbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:09.249903 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52eca1-7387-4341-9ecf-ea5ce330bbc1 admin admin] PATH_INFO: `/v3/users/1d752b0942f242eb8f760ba31f777f83` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:09.251250 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52eca1-7387-4341-9ecf-ea5ce330bbc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d752b0942f242eb8f760ba31f777f83)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:09.253835 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52eca1-7387-4341-9ecf-ea5ce330bbc1 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:09.485925 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2f52eca1-7387-4341-9ecf-ea5ce330bbc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d752b0942f242eb8f760ba31f777f83'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:09.507179 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2f52eca1-7387-4341-9ecf-ea5ce330bbc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d752b0942f242eb8f760ba31f777f83'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:09.530323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2f52eca1-7387-4341-9ecf-ea5ce330bbc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d752b0942f242eb8f760ba31f777f83'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:09.531126 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2f52eca1-7387-4341-9ecf-ea5ce330bbc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d752b0942f242eb8f760ba31f777f83'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:09.538795 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2f52eca1-7387-4341-9ecf-ea5ce330bbc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d752b0942f242eb8f760ba31f777f83'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:09.547124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1165/2332] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:15:09 2022] DELETE /identity/v3/users/1d752b0942f242eb8f760ba31f777f83 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:15:09.551690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eced9e-3ef3-45d7-9daa-063e01017b2c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:09.552350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eced9e-3ef3-45d7-9daa-063e01017b2c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:09.552350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eced9e-3ef3-45d7-9daa-063e01017b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:09.572939 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-61eced9e-3ef3-45d7-9daa-063e01017b2c None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:15:09.574206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-61eced9e-3ef3-45d7-9daa-063e01017b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:09.656383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1168/2333] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:15:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:15:09.666452 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52eca1-7387-4341-9ecf-ea5ce330bbc1 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:09.667967 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2f52eca1-7387-4341-9ecf-ea5ce330bbc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:09.723953 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:09.760655 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52eca1-7387-4341-9ecf-ea5ce330bbc1 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:09.764686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020934b3-747a-4e93-9aa4-2ad42b3b9fa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:09.765410 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020934b3-747a-4e93-9aa4-2ad42b3b9fa0 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:09.765771 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020934b3-747a-4e93-9aa4-2ad42b3b9fa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:09.766046 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020934b3-747a-4e93-9aa4-2ad42b3b9fa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:09.777108 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020934b3-747a-4e93-9aa4-2ad42b3b9fa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:09.778583 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020934b3-747a-4e93-9aa4-2ad42b3b9fa0 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:09.800505 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1166/2334] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:15:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:15:10.380250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eced9e-3ef3-45d7-9daa-063e01017b2c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:10.382477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-61eced9e-3ef3-45d7-9daa-063e01017b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:10.420802 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eced9e-3ef3-45d7-9daa-063e01017b2c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:10.436346 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03594d2-86ac-40b4-a8c3-a7428edd85c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:10.436997 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03594d2-86ac-40b4-a8c3-a7428edd85c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:10.437301 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03594d2-86ac-40b4-a8c3-a7428edd85c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:10.439264 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03594d2-86ac-40b4-a8c3-a7428edd85c0 admin admin] PATH_INFO: `/v3/projects/7ce630fa2dd243e0bcf557951ed6c486` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:10.445377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03594d2-86ac-40b4-a8c3-a7428edd85c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ce630fa2dd243e0bcf557951ed6c486)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:10.447566 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03594d2-86ac-40b4-a8c3-a7428edd85c0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:10.525155 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a03594d2-86ac-40b4-a8c3-a7428edd85c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ce630fa2dd243e0bcf557951ed6c486', 'request_id': 'req-a03594d2-86ac-40b4-a8c3-a7428edd85c0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:10.535091 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a03594d2-86ac-40b4-a8c3-a7428edd85c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ce630fa2dd243e0bcf557951ed6c486', 'request_id': 'req-a03594d2-86ac-40b4-a8c3-a7428edd85c0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:10.546504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a03594d2-86ac-40b4-a8c3-a7428edd85c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ce630fa2dd243e0bcf557951ed6c486', 'request_id': 'req-a03594d2-86ac-40b4-a8c3-a7428edd85c0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:10.567627 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a03594d2-86ac-40b4-a8c3-a7428edd85c0 admin admin] The token cache is being invalidate because project 7ce630fa2dd243e0bcf557951ed6c486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:15:10.568564 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a03594d2-86ac-40b4-a8c3-a7428edd85c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:10.573166 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a03594d2-86ac-40b4-a8c3-a7428edd85c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:10.575220 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1169/2335] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:15:10 2022] DELETE /identity/v3/projects/7ce630fa2dd243e0bcf557951ed6c486 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:15:10.580735 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891280c-e928-4ed1-8836-833db10d0eef None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:10.581796 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891280c-e928-4ed1-8836-833db10d0eef None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:10.582374 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891280c-e928-4ed1-8836-833db10d0eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:10.634167 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e891280c-e928-4ed1-8836-833db10d0eef None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:15:10.636933 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e891280c-e928-4ed1-8836-833db10d0eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:10.735928 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1167/2336] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:15:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:15:10.745222 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6f310-37f0-455f-8c75-6610b9e030dc None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:10.745537 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6f310-37f0-455f-8c75-6610b9e030dc None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:10.745829 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6f310-37f0-455f-8c75-6610b9e030dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:10.776999 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-83e6f310-37f0-455f-8c75-6610b9e030dc None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:15:10.778656 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-83e6f310-37f0-455f-8c75-6610b9e030dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:10.794170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1170/2337] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:15:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:15:10.798402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891280c-e928-4ed1-8836-833db10d0eef None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:10.814732 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891280c-e928-4ed1-8836-833db10d0eef None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:10.820140 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d26a35-a5f5-479a-955a-84372d3b99be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:10.820722 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d26a35-a5f5-479a-955a-84372d3b99be admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:10.821116 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d26a35-a5f5-479a-955a-84372d3b99be admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:10.821408 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d26a35-a5f5-479a-955a-84372d3b99be admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:10.822233 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d26a35-a5f5-479a-955a-84372d3b99be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:15:10.822804 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d26a35-a5f5-479a-955a-84372d3b99be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:10.824524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d26a35-a5f5-479a-955a-84372d3b99be admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:10.842010 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1168/2338] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:15:10.846673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6f310-37f0-455f-8c75-6610b9e030dc None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:10.861057 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6f310-37f0-455f-8c75-6610b9e030dc None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:10.867615 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52b51b-7e9f-4438-bf4a-fa5ec2d6bda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:10.868804 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52b51b-7e9f-4438-bf4a-fa5ec2d6bda1 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:10.869805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52b51b-7e9f-4438-bf4a-fa5ec2d6bda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:10.870080 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52b51b-7e9f-4438-bf4a-fa5ec2d6bda1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:10.871167 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52b51b-7e9f-4438-bf4a-fa5ec2d6bda1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:10.873367 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52b51b-7e9f-4438-bf4a-fa5ec2d6bda1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:10.887972 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:10.910719 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1171/2339] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:15:10 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:15:10.915168 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d26a35-a5f5-479a-955a-84372d3b99be admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:10.928519 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d26a35-a5f5-479a-955a-84372d3b99be admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:11.054496 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f25e8-70d9-4efa-8ce3-2aeacd79ccbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:11.055415 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f25e8-70d9-4efa-8ce3-2aeacd79ccbc admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:11.055684 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f25e8-70d9-4efa-8ce3-2aeacd79ccbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:11.056475 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f25e8-70d9-4efa-8ce3-2aeacd79ccbc admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:11.058303 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f25e8-70d9-4efa-8ce3-2aeacd79ccbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:11.060530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f25e8-70d9-4efa-8ce3-2aeacd79ccbc admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:11.095734 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1169/2340] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:15:10 2022] POST /identity/v3/users => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:15:11.096301 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52b51b-7e9f-4438-bf4a-fa5ec2d6bda1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:11.117715 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52b51b-7e9f-4438-bf4a-fa5ec2d6bda1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:11.123405 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f011fb8-0ebb-4457-a7b4-b8ef5907fc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:11.124667 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f011fb8-0ebb-4457-a7b4-b8ef5907fc9e admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:11.124667 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f011fb8-0ebb-4457-a7b4-b8ef5907fc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:11.124667 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f011fb8-0ebb-4457-a7b4-b8ef5907fc9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:11.125872 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f011fb8-0ebb-4457-a7b4-b8ef5907fc9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:11.127486 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f011fb8-0ebb-4457-a7b4-b8ef5907fc9e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:11.142262 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1172/2341] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:15:11.147438 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f25e8-70d9-4efa-8ce3-2aeacd79ccbc admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:11.162355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f25e8-70d9-4efa-8ce3-2aeacd79ccbc admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:11.168511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5cfff-e278-4b3a-9148-b83eee20dbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:11.169150 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5cfff-e278-4b3a-9148-b83eee20dbb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:11.169435 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5cfff-e278-4b3a-9148-b83eee20dbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:11.169707 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5cfff-e278-4b3a-9148-b83eee20dbb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:11.170411 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5cfff-e278-4b3a-9148-b83eee20dbb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:11.174495 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5cfff-e278-4b3a-9148-b83eee20dbb8 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:11.194705 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1170/2342] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:15:11.200216 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f011fb8-0ebb-4457-a7b4-b8ef5907fc9e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:11.216596 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f011fb8-0ebb-4457-a7b4-b8ef5907fc9e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:11.235607 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467f709-bb33-47e2-9744-bc9036ceabfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:11.239786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467f709-bb33-47e2-9744-bc9036ceabfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:11.240315 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467f709-bb33-47e2-9744-bc9036ceabfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:11.242844 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467f709-bb33-47e2-9744-bc9036ceabfc admin admin] PATH_INFO: `/v3/projects/beb7e234b5914ef1bd5f1da0386f4c51/users/30dc3eb1518e4284ad3c88e4eb52e494/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:11.269919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467f709-bb33-47e2-9744-bc9036ceabfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=beb7e234b5914ef1bd5f1da0386f4c51, user_id=30dc3eb1518e4284ad3c88e4eb52e494, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:11.272787 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467f709-bb33-47e2-9744-bc9036ceabfc admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:11.303185 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1173/2343] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:15:11 2022] PUT /identity/v3/projects/beb7e234b5914ef1bd5f1da0386f4c51/users/30dc3eb1518e4284ad3c88e4eb52e494/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:15:11.314233 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805723f-56ca-4812-9344-a5b5ac4cc6a6 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:11.314518 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805723f-56ca-4812-9344-a5b5ac4cc6a6 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:11.314796 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805723f-56ca-4812-9344-a5b5ac4cc6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:11.346093 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-b805723f-56ca-4812-9344-a5b5ac4cc6a6 None None] MFA Rules not processed for user `30dc3eb1518e4284ad3c88e4eb52e494`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:15:11.347331 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b805723f-56ca-4812-9344-a5b5ac4cc6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:11.380798 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:11.428432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1171/2344] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:15:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:15:11.439565 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467f709-bb33-47e2-9744-bc9036ceabfc admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:11.442313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f467f709-bb33-47e2-9744-bc9036ceabfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:11.528754 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467f709-bb33-47e2-9744-bc9036ceabfc admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:11.536115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65031818-3488-4cd9-8c4b-fa0431761b50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:11.537238 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65031818-3488-4cd9-8c4b-fa0431761b50 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:11.537735 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65031818-3488-4cd9-8c4b-fa0431761b50 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:11.538189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65031818-3488-4cd9-8c4b-fa0431761b50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:11.554673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65031818-3488-4cd9-8c4b-fa0431761b50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:11.556181 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65031818-3488-4cd9-8c4b-fa0431761b50 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:11.566764 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1174/2345] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:15:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:15:12.410580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905992a-9721-4143-b114-cf77272767d5 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:12.411080 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905992a-9721-4143-b114-cf77272767d5 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:12.411080 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905992a-9721-4143-b114-cf77272767d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:12.433040 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-1905992a-9721-4143-b114-cf77272767d5 None None] MFA Rules not processed for user `0c41b4ecb17a43fdb05e586cce43b5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:15:12.434501 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1905992a-9721-4143-b114-cf77272767d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:12.513294 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1172/2346] 10.222.0.26 () {58 vars in 967 bytes} [Tue Sep 13 14:15:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:15:12.516299 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65031818-3488-4cd9-8c4b-fa0431761b50 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:12.517822 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-65031818-3488-4cd9-8c4b-fa0431761b50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:12.621153 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65031818-3488-4cd9-8c4b-fa0431761b50 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:12.639662 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339f8d3-20ec-4fef-9549-ccfecce3d31e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c27e930f604bd38634ca08e56cf8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:12.640292 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339f8d3-20ec-4fef-9549-ccfecce3d31e service swift] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:12.640568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339f8d3-20ec-4fef-9549-ccfecce3d31e service swift] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:12.640834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339f8d3-20ec-4fef-9549-ccfecce3d31e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:12.650045 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d339f8d3-20ec-4fef-9549-ccfecce3d31e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:12.651994 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d339f8d3-20ec-4fef-9549-ccfecce3d31e service swift] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:12.660719 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1175/2347] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 13 14:15:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 14:15:12.976371 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee2eaa-8ffc-4cb8-9224-78aa637d2d58 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:12.976870 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee2eaa-8ffc-4cb8-9224-78aa637d2d58 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:12.977648 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee2eaa-8ffc-4cb8-9224-78aa637d2d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:13.000873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-89ee2eaa-8ffc-4cb8-9224-78aa637d2d58 None None] MFA Rules not processed for user `30dc3eb1518e4284ad3c88e4eb52e494`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:15:13.002215 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-89ee2eaa-8ffc-4cb8-9224-78aa637d2d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:13.014119 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1173/2348] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:15:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:15:14.743678 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339f8d3-20ec-4fef-9549-ccfecce3d31e service swift] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:14.745862 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d339f8d3-20ec-4fef-9549-ccfecce3d31e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:14.795727 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:14.812393 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339f8d3-20ec-4fef-9549-ccfecce3d31e service swift] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:14.817195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf93f9-817e-47ca-b77a-bdd81e020dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:14.817833 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf93f9-817e-47ca-b77a-bdd81e020dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:14.818113 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf93f9-817e-47ca-b77a-bdd81e020dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:14.818383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf93f9-817e-47ca-b77a-bdd81e020dc8 admin admin] PATH_INFO: `/v3/users/33d7e0d80ad14191ab2f7f386d4c7ac3` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:14.819511 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf93f9-817e-47ca-b77a-bdd81e020dc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33d7e0d80ad14191ab2f7f386d4c7ac3)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:14.821485 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf93f9-817e-47ca-b77a-bdd81e020dc8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:14.870423 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bbbf93f9-817e-47ca-b77a-bdd81e020dc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33d7e0d80ad14191ab2f7f386d4c7ac3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:14.878452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bbbf93f9-817e-47ca-b77a-bdd81e020dc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33d7e0d80ad14191ab2f7f386d4c7ac3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:14.892525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bbbf93f9-817e-47ca-b77a-bdd81e020dc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33d7e0d80ad14191ab2f7f386d4c7ac3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:14.893258 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bbbf93f9-817e-47ca-b77a-bdd81e020dc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33d7e0d80ad14191ab2f7f386d4c7ac3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:14.901111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bbbf93f9-817e-47ca-b77a-bdd81e020dc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33d7e0d80ad14191ab2f7f386d4c7ac3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:14.909839 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1176/2349] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:15:14 2022] DELETE /identity/v3/users/33d7e0d80ad14191ab2f7f386d4c7ac3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:15:15.091206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee2eaa-8ffc-4cb8-9224-78aa637d2d58 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:15.104332 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee2eaa-8ffc-4cb8-9224-78aa637d2d58 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:15.163558 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e588bf-1f0f-4f21-ad90-7965522d1051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:15.164196 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e588bf-1f0f-4f21-ad90-7965522d1051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:15.164475 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e588bf-1f0f-4f21-ad90-7965522d1051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:15.164774 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e588bf-1f0f-4f21-ad90-7965522d1051 admin admin] PATH_INFO: `/v3/projects/ee75c4ccbd914216aed02d1b289fb727` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:15.165995 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e588bf-1f0f-4f21-ad90-7965522d1051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee75c4ccbd914216aed02d1b289fb727)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:15.167917 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e588bf-1f0f-4f21-ad90-7965522d1051 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:15.216361 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-88e588bf-1f0f-4f21-ad90-7965522d1051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee75c4ccbd914216aed02d1b289fb727', 'request_id': 'req-88e588bf-1f0f-4f21-ad90-7965522d1051'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:15.223462 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-88e588bf-1f0f-4f21-ad90-7965522d1051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee75c4ccbd914216aed02d1b289fb727', 'request_id': 'req-88e588bf-1f0f-4f21-ad90-7965522d1051'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:15.229309 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-88e588bf-1f0f-4f21-ad90-7965522d1051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee75c4ccbd914216aed02d1b289fb727', 'request_id': 'req-88e588bf-1f0f-4f21-ad90-7965522d1051'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:15.236741 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:15.242274 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-88e588bf-1f0f-4f21-ad90-7965522d1051 admin admin] The token cache is being invalidate because project ee75c4ccbd914216aed02d1b289fb727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:15:15.242715 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-88e588bf-1f0f-4f21-ad90-7965522d1051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:15.244376 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-88e588bf-1f0f-4f21-ad90-7965522d1051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:15.245924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1174/2350] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:15:15 2022] DELETE /identity/v3/projects/ee75c4ccbd914216aed02d1b289fb727 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:15:24.906258 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=31,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:25.246953 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:25.486707 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc1615-34f7-43cb-9d59-7099368a9798 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:25.487069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc1615-34f7-43cb-9d59-7099368a9798 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:25.487548 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc1615-34f7-43cb-9d59-7099368a9798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:25.514566 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-8edc1615-34f7-43cb-9d59-7099368a9798 None None] MFA Rules not processed for user `4c0e15bafe7c4085b65eb9f1e7fe7aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:15:25.515851 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8edc1615-34f7-43cb-9d59-7099368a9798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:25.586477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1177/2351] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:15:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:15:28.197857 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e588bf-1f0f-4f21-ad90-7965522d1051 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:28.200522 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-88e588bf-1f0f-4f21-ad90-7965522d1051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:28.292958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e588bf-1f0f-4f21-ad90-7965522d1051 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:28.301558 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd63a10-a045-4d30-be66-886812290635 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311397bfe2c04569852fca0cfcdbad66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:28.302184 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd63a10-a045-4d30-be66-886812290635 service placement] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:28.302464 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd63a10-a045-4d30-be66-886812290635 service placement] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:28.302734 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd63a10-a045-4d30-be66-886812290635 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:28.304478 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0cd63a10-a045-4d30-be66-886812290635 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:28.317620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd63a10-a045-4d30-be66-886812290635 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:28.318914 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd63a10-a045-4d30-be66-886812290635 service placement] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:28.337953 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1175/2352] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:15:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:15:30.563131 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fe7aa-231e-40f2-96cd-c92e359c098f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:30.563704 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fe7aa-231e-40f2-96cd-c92e359c098f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:30.563704 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fe7aa-231e-40f2-96cd-c92e359c098f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:30.589591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-138fe7aa-231e-40f2-96cd-c92e359c098f None None] MFA Rules not processed for user `c8289ecbf04143b1a136f876b1467c67`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:15:30.591029 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-138fe7aa-231e-40f2-96cd-c92e359c098f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:30.659362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1178/2353] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:15:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:15:34.944106 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd63a10-a045-4d30-be66-886812290635 service placement] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:34.945607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0cd63a10-a045-4d30-be66-886812290635 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:35.025848 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd63a10-a045-4d30-be66-886812290635 service placement] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:35.031148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e79086-a231-474a-9371-1864c83ee17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:35.031801 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e79086-a231-474a-9371-1864c83ee17d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:35.032265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e79086-a231-474a-9371-1864c83ee17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:35.032535 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e79086-a231-474a-9371-1864c83ee17d admin admin] PATH_INFO: `/v3/users/bea634471fee441695f9d481a6c32616` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:35.033811 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e79086-a231-474a-9371-1864c83ee17d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bea634471fee441695f9d481a6c32616)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:35.036069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e79086-a231-474a-9371-1864c83ee17d admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:35.106837 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-86e79086-a231-474a-9371-1864c83ee17d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bea634471fee441695f9d481a6c32616'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:35.117336 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-86e79086-a231-474a-9371-1864c83ee17d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bea634471fee441695f9d481a6c32616'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:35.131874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-86e79086-a231-474a-9371-1864c83ee17d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bea634471fee441695f9d481a6c32616'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:35.132701 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-86e79086-a231-474a-9371-1864c83ee17d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bea634471fee441695f9d481a6c32616'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:35.141572 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-86e79086-a231-474a-9371-1864c83ee17d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bea634471fee441695f9d481a6c32616'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:35.148090 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1176/2354] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:15:34 2022] DELETE /identity/v3/users/bea634471fee441695f9d481a6c32616 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:15:35.153381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226a983-d0cd-486e-87f2-e6716d2eae3e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:35.153815 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226a983-d0cd-486e-87f2-e6716d2eae3e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:35.153908 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226a983-d0cd-486e-87f2-e6716d2eae3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:35.174094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-1226a983-d0cd-486e-87f2-e6716d2eae3e None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:15:35.175341 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1226a983-d0cd-486e-87f2-e6716d2eae3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:35.261379 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1179/2355] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:15:35.282466 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e79086-a231-474a-9371-1864c83ee17d admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:35.284043 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-86e79086-a231-474a-9371-1864c83ee17d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:35.297933 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:35.350544 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e79086-a231-474a-9371-1864c83ee17d admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:35.354397 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c12821-4e37-48b5-8f1d-06315bf8826f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:35.355001 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c12821-4e37-48b5-8f1d-06315bf8826f service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:35.355281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c12821-4e37-48b5-8f1d-06315bf8826f service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:35.355553 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c12821-4e37-48b5-8f1d-06315bf8826f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:35.365146 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c12821-4e37-48b5-8f1d-06315bf8826f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:35.366613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c12821-4e37-48b5-8f1d-06315bf8826f service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:35.376922 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1177/2356] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:15:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:15:36.028428 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226a983-d0cd-486e-87f2-e6716d2eae3e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:36.030312 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1226a983-d0cd-486e-87f2-e6716d2eae3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:36.049062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226a983-d0cd-486e-87f2-e6716d2eae3e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:36.053870 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5b656-fbea-4691-9202-fa795658e07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:36.054682 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5b656-fbea-4691-9202-fa795658e07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:36.055138 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5b656-fbea-4691-9202-fa795658e07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:36.056476 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5b656-fbea-4691-9202-fa795658e07a admin admin] PATH_INFO: `/v3/projects/560a7e5f94f24f2586721fabaf66cde4` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:36.058252 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac5b656-fbea-4691-9202-fa795658e07a admin admin] RBAC: Authorizing `identity:delete_project(project_id=560a7e5f94f24f2586721fabaf66cde4)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:36.060687 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac5b656-fbea-4691-9202-fa795658e07a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:36.112785 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:36.116501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2ac5b656-fbea-4691-9202-fa795658e07a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '560a7e5f94f24f2586721fabaf66cde4', 'request_id': 'req-2ac5b656-fbea-4691-9202-fa795658e07a'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:36.128056 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2ac5b656-fbea-4691-9202-fa795658e07a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '560a7e5f94f24f2586721fabaf66cde4', 'request_id': 'req-2ac5b656-fbea-4691-9202-fa795658e07a'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:36.137551 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2ac5b656-fbea-4691-9202-fa795658e07a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '560a7e5f94f24f2586721fabaf66cde4', 'request_id': 'req-2ac5b656-fbea-4691-9202-fa795658e07a'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:36.149865 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2ac5b656-fbea-4691-9202-fa795658e07a admin admin] The token cache is being invalidate because project 560a7e5f94f24f2586721fabaf66cde4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:15:36.150236 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2ac5b656-fbea-4691-9202-fa795658e07a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:36.151522 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2ac5b656-fbea-4691-9202-fa795658e07a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:36.153019 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1180/2357] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:15:36 2022] DELETE /identity/v3/projects/560a7e5f94f24f2586721fabaf66cde4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:15:40.259608 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf33030-90da-4d9a-acb1-8c21296ca8a3 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:40.260127 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf33030-90da-4d9a-acb1-8c21296ca8a3 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:40.260127 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf33030-90da-4d9a-acb1-8c21296ca8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:40.278980 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-bbf33030-90da-4d9a-acb1-8c21296ca8a3 None None] MFA Rules not processed for user `0c41b4ecb17a43fdb05e586cce43b5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:15:40.280408 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-bbf33030-90da-4d9a-acb1-8c21296ca8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:40.349475 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1178/2358] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 13 14:15:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:15:40.362896 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5b656-fbea-4691-9202-fa795658e07a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:40.364682 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2ac5b656-fbea-4691-9202-fa795658e07a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:40.449871 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5b656-fbea-4691-9202-fa795658e07a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:40.455569 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c9027-fb49-4dd4-91a6-c6ca51dcb5a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c27e930f604bd38634ca08e56cf8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:40.456203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c9027-fb49-4dd4-91a6-c6ca51dcb5a7 service swift] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:40.456482 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c9027-fb49-4dd4-91a6-c6ca51dcb5a7 service swift] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:40.456755 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c9027-fb49-4dd4-91a6-c6ca51dcb5a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:40.468893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c9027-fb49-4dd4-91a6-c6ca51dcb5a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:40.471104 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c9027-fb49-4dd4-91a6-c6ca51dcb5a7 service swift] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:40.480051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1181/2359] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 13 14:15:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 14:15:40.987811 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e908b9a-b4ef-423d-8fd3-01c9350b3894 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:40.988094 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e908b9a-b4ef-423d-8fd3-01c9350b3894 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:40.988365 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e908b9a-b4ef-423d-8fd3-01c9350b3894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:41.007190 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-2e908b9a-b4ef-423d-8fd3-01c9350b3894 None None] MFA Rules not processed for user `0c41b4ecb17a43fdb05e586cce43b5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:15:41.008296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2e908b9a-b4ef-423d-8fd3-01c9350b3894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:41.015668 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1179/2360] 10.222.0.26 () {58 vars in 967 bytes} [Tue Sep 13 14:15:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:15:41.028825 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c9027-fb49-4dd4-91a6-c6ca51dcb5a7 service swift] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:41.039623 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c9027-fb49-4dd4-91a6-c6ca51dcb5a7 service swift] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:41.045329 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c1d78-7e1f-49a0-9a4c-bd13eebe52be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c27e930f604bd38634ca08e56cf8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:41.045918 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c1d78-7e1f-49a0-9a4c-bd13eebe52be service swift] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:41.046195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c1d78-7e1f-49a0-9a4c-bd13eebe52be service swift] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:41.046465 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c1d78-7e1f-49a0-9a4c-bd13eebe52be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:41.054951 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c1d78-7e1f-49a0-9a4c-bd13eebe52be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:41.056593 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c1d78-7e1f-49a0-9a4c-bd13eebe52be service swift] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:41.065685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1182/2361] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 13 14:15:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 14:15:41.331241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97af38-dc01-45ec-b22d-b073501d6ed2 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:41.331693 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97af38-dc01-45ec-b22d-b073501d6ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:41.331829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97af38-dc01-45ec-b22d-b073501d6ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:41.351190 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-dc97af38-dc01-45ec-b22d-b073501d6ed2 None None] MFA Rules not processed for user `0c41b4ecb17a43fdb05e586cce43b5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:15:41.352424 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-dc97af38-dc01-45ec-b22d-b073501d6ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:41.359775 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1180/2362] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 13 14:15:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:15:41.371408 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c1d78-7e1f-49a0-9a4c-bd13eebe52be service swift] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:41.382049 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c1d78-7e1f-49a0-9a4c-bd13eebe52be service swift] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:41.387870 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342329b6-c839-4866-b34a-667846f0a572 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c27e930f604bd38634ca08e56cf8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:41.388462 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342329b6-c839-4866-b34a-667846f0a572 service swift] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:41.388735 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342329b6-c839-4866-b34a-667846f0a572 service swift] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:41.389018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342329b6-c839-4866-b34a-667846f0a572 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:41.396917 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342329b6-c839-4866-b34a-667846f0a572 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:41.398519 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342329b6-c839-4866-b34a-667846f0a572 service swift] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:41.407247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1183/2363] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 13 14:15:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 14:15:41.732824 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d65c7-c092-45c2-b850-244ccaad826d None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:41.733120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d65c7-c092-45c2-b850-244ccaad826d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:41.733417 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d65c7-c092-45c2-b850-244ccaad826d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:41.753042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-988d65c7-c092-45c2-b850-244ccaad826d None None] MFA Rules not processed for user `0c41b4ecb17a43fdb05e586cce43b5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:15:41.754862 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-988d65c7-c092-45c2-b850-244ccaad826d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:41.763193 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1181/2364] 10.222.0.26 () {58 vars in 967 bytes} [Tue Sep 13 14:15:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:15:41.779905 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342329b6-c839-4866-b34a-667846f0a572 service swift] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:41.790738 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342329b6-c839-4866-b34a-667846f0a572 service swift] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:41.795853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cb804-491f-483b-85ac-e29cdfd47c08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c27e930f604bd38634ca08e56cf8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:41.796547 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cb804-491f-483b-85ac-e29cdfd47c08 service swift] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:41.796841 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cb804-491f-483b-85ac-e29cdfd47c08 service swift] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:41.797140 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cb804-491f-483b-85ac-e29cdfd47c08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:41.806201 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0cb804-491f-483b-85ac-e29cdfd47c08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:41.807806 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0cb804-491f-483b-85ac-e29cdfd47c08 service swift] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:41.816030 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1184/2365] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 13 14:15:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 14:15:43.942775 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d65c7-c092-45c2-b850-244ccaad826d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:43.945660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-988d65c7-c092-45c2-b850-244ccaad826d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:44.022472 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d65c7-c092-45c2-b850-244ccaad826d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:44.027528 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a2b76-2e95-4a96-bc06-cd4dff5e96ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:44.028150 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a2b76-2e95-4a96-bc06-cd4dff5e96ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:44.028420 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a2b76-2e95-4a96-bc06-cd4dff5e96ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:44.028709 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a2b76-2e95-4a96-bc06-cd4dff5e96ac admin admin] PATH_INFO: `/v3/users/30dc3eb1518e4284ad3c88e4eb52e494` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:44.030129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a2b76-2e95-4a96-bc06-cd4dff5e96ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=30dc3eb1518e4284ad3c88e4eb52e494)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:44.032147 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a2b76-2e95-4a96-bc06-cd4dff5e96ac admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:44.075092 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:44.081692 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d92a2b76-2e95-4a96-bc06-cd4dff5e96ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30dc3eb1518e4284ad3c88e4eb52e494'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:44.089473 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d92a2b76-2e95-4a96-bc06-cd4dff5e96ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30dc3eb1518e4284ad3c88e4eb52e494'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:44.101635 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d92a2b76-2e95-4a96-bc06-cd4dff5e96ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30dc3eb1518e4284ad3c88e4eb52e494'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:44.102267 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d92a2b76-2e95-4a96-bc06-cd4dff5e96ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30dc3eb1518e4284ad3c88e4eb52e494'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:44.109261 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d92a2b76-2e95-4a96-bc06-cd4dff5e96ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30dc3eb1518e4284ad3c88e4eb52e494'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:44.115063 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1182/2366] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:15:43 2022] DELETE /identity/v3/users/30dc3eb1518e4284ad3c88e4eb52e494 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:15:44.119447 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c754d-1ca9-4f2b-8ee0-b4540003edb1 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:44.119900 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c754d-1ca9-4f2b-8ee0-b4540003edb1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:44.120006 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c754d-1ca9-4f2b-8ee0-b4540003edb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:44.139422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-871c754d-1ca9-4f2b-8ee0-b4540003edb1 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:15:44.140625 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-871c754d-1ca9-4f2b-8ee0-b4540003edb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:44.198584 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1185/2367] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:15:44.208007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a2b76-2e95-4a96-bc06-cd4dff5e96ac admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:44.209416 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d92a2b76-2e95-4a96-bc06-cd4dff5e96ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:44.269330 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a2b76-2e95-4a96-bc06-cd4dff5e96ac admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:44.273044 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337cd4f-6557-45f6-954b-c1c5b964d8dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:44.273672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337cd4f-6557-45f6-954b-c1c5b964d8dd service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:44.273945 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337cd4f-6557-45f6-954b-c1c5b964d8dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:44.274227 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337cd4f-6557-45f6-954b-c1c5b964d8dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:44.284916 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337cd4f-6557-45f6-954b-c1c5b964d8dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:44.286401 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337cd4f-6557-45f6-954b-c1c5b964d8dd service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:44.296028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1183/2368] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:15:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 14:15:44.467038 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c754d-1ca9-4f2b-8ee0-b4540003edb1 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:44.468507 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-871c754d-1ca9-4f2b-8ee0-b4540003edb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:44.484149 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c754d-1ca9-4f2b-8ee0-b4540003edb1 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:44.488931 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442de39-d0ca-4168-93e1-748043da0621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:44.489703 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442de39-d0ca-4168-93e1-748043da0621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:44.489870 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442de39-d0ca-4168-93e1-748043da0621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:44.490135 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442de39-d0ca-4168-93e1-748043da0621 admin admin] PATH_INFO: `/v3/projects/beb7e234b5914ef1bd5f1da0386f4c51` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:44.491257 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442de39-d0ca-4168-93e1-748043da0621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beb7e234b5914ef1bd5f1da0386f4c51)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:44.493976 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442de39-d0ca-4168-93e1-748043da0621 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:44.515627 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:44.542475 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9442de39-d0ca-4168-93e1-748043da0621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beb7e234b5914ef1bd5f1da0386f4c51', 'request_id': 'req-9442de39-d0ca-4168-93e1-748043da0621'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:44.549636 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9442de39-d0ca-4168-93e1-748043da0621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beb7e234b5914ef1bd5f1da0386f4c51', 'request_id': 'req-9442de39-d0ca-4168-93e1-748043da0621'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:44.557804 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9442de39-d0ca-4168-93e1-748043da0621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beb7e234b5914ef1bd5f1da0386f4c51', 'request_id': 'req-9442de39-d0ca-4168-93e1-748043da0621'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:44.568383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9442de39-d0ca-4168-93e1-748043da0621 admin admin] The token cache is being invalidate because project beb7e234b5914ef1bd5f1da0386f4c51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:15:44.568673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9442de39-d0ca-4168-93e1-748043da0621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:44.569342 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9442de39-d0ca-4168-93e1-748043da0621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:15:44.570823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1186/2369] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:15:44 2022] DELETE /identity/v3/projects/beb7e234b5914ef1bd5f1da0386f4c51 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:15:44.576304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6d818-d6c6-4e96-99b0-bbcf3f5f6d22 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:44.576578 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6d818-d6c6-4e96-99b0-bbcf3f5f6d22 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:44.576840 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6d818-d6c6-4e96-99b0-bbcf3f5f6d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:44.595718 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-31e6d818-d6c6-4e96-99b0-bbcf3f5f6d22 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:15:44.596887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-31e6d818-d6c6-4e96-99b0-bbcf3f5f6d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:44.676315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1184/2370] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:15:44.684665 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f7713-7c64-413b-a273-d5c0149336a1 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:44.684951 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f7713-7c64-413b-a273-d5c0149336a1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:44.685260 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f7713-7c64-413b-a273-d5c0149336a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:44.710708 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ba3f7713-7c64-413b-a273-d5c0149336a1 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:15:44.712472 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ba3f7713-7c64-413b-a273-d5c0149336a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:44.726572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1187/2371] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:15:44.730902 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6d818-d6c6-4e96-99b0-bbcf3f5f6d22 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:44.744597 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6d818-d6c6-4e96-99b0-bbcf3f5f6d22 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:44.753931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac8a0c-48f0-43b6-bf11-9d6f925c2360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:44.754562 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac8a0c-48f0-43b6-bf11-9d6f925c2360 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:44.754841 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac8a0c-48f0-43b6-bf11-9d6f925c2360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:44.757480 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac8a0c-48f0-43b6-bf11-9d6f925c2360 admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:44.758321 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac8a0c-48f0-43b6-bf11-9d6f925c2360 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:15:44.758694 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac8a0c-48f0-43b6-bf11-9d6f925c2360 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:44.760877 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac8a0c-48f0-43b6-bf11-9d6f925c2360 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:44.776000 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1185/2372] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:15:44.780523 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f7713-7c64-413b-a273-d5c0149336a1 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:44.790218 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f7713-7c64-413b-a273-d5c0149336a1 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:44.795360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49dccc-bb5b-4cb1-92f6-0484fb090af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:44.795954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49dccc-bb5b-4cb1-92f6-0484fb090af5 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:44.796228 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49dccc-bb5b-4cb1-92f6-0484fb090af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:44.796495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49dccc-bb5b-4cb1-92f6-0484fb090af5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:44.797147 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49dccc-bb5b-4cb1-92f6-0484fb090af5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:44.799042 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49dccc-bb5b-4cb1-92f6-0484fb090af5 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:44.827677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1188/2373] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:15:44 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:15:44.831954 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac8a0c-48f0-43b6-bf11-9d6f925c2360 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:44.841873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac8a0c-48f0-43b6-bf11-9d6f925c2360 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:44.898171 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:44.914621 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee985107-39d3-4fa6-835d-a1c0946740de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:44.915739 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee985107-39d3-4fa6-835d-a1c0946740de admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:44.916011 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee985107-39d3-4fa6-835d-a1c0946740de admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:44.916275 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee985107-39d3-4fa6-835d-a1c0946740de admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:44.916913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee985107-39d3-4fa6-835d-a1c0946740de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:44.918928 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee985107-39d3-4fa6-835d-a1c0946740de admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:44.940901 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1186/2374] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:15:44 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:15:44.944866 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49dccc-bb5b-4cb1-92f6-0484fb090af5 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:44.955073 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49dccc-bb5b-4cb1-92f6-0484fb090af5 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:44.959673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06011d2d-4937-4c33-9109-9d7b72292d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:44.960264 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06011d2d-4937-4c33-9109-9d7b72292d8d admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:44.960537 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06011d2d-4937-4c33-9109-9d7b72292d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:44.960859 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06011d2d-4937-4c33-9109-9d7b72292d8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:44.961477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06011d2d-4937-4c33-9109-9d7b72292d8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:44.963098 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06011d2d-4937-4c33-9109-9d7b72292d8d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:44.973144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1189/2375] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:15:44.977142 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee985107-39d3-4fa6-835d-a1c0946740de admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:44.987687 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee985107-39d3-4fa6-835d-a1c0946740de admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:44.992366 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fd908-9e43-4b6e-b384-71c56e745cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:44.993920 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fd908-9e43-4b6e-b384-71c56e745cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:44.994422 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fd908-9e43-4b6e-b384-71c56e745cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:44.994731 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fd908-9e43-4b6e-b384-71c56e745cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:44.995848 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fd908-9e43-4b6e-b384-71c56e745cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:44.997467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fd908-9e43-4b6e-b384-71c56e745cc3 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:45.008018 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1187/2376] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:15:45.012050 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06011d2d-4937-4c33-9109-9d7b72292d8d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:45.022091 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06011d2d-4937-4c33-9109-9d7b72292d8d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:45.026814 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3393a-aee6-47c2-b0cb-8bbf7801f8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:45.027458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3393a-aee6-47c2-b0cb-8bbf7801f8af admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:45.027741 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3393a-aee6-47c2-b0cb-8bbf7801f8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:45.028017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3393a-aee6-47c2-b0cb-8bbf7801f8af admin admin] PATH_INFO: `/v3/projects/f8169711db1b4916bb18371fd09fb29f/users/85c7977a6ebe41b09eba731a6e3eb9fb/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:45.043128 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3393a-aee6-47c2-b0cb-8bbf7801f8af admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8169711db1b4916bb18371fd09fb29f, user_id=85c7977a6ebe41b09eba731a6e3eb9fb, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:45.045835 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3393a-aee6-47c2-b0cb-8bbf7801f8af admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:45.060558 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1190/2377] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:15:45 2022] PUT /identity/v3/projects/f8169711db1b4916bb18371fd09fb29f/users/85c7977a6ebe41b09eba731a6e3eb9fb/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:15:45.065402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57acc2-60d1-4015-ba6e-fb70f05a565f None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:45.065724 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57acc2-60d1-4015-ba6e-fb70f05a565f None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:45.065995 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57acc2-60d1-4015-ba6e-fb70f05a565f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:45.085000 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-ff57acc2-60d1-4015-ba6e-fb70f05a565f None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:15:45.086505 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ff57acc2-60d1-4015-ba6e-fb70f05a565f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:45.147862 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1188/2378] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:15:45.157853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3393a-aee6-47c2-b0cb-8bbf7801f8af admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:45.159591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-10b3393a-aee6-47c2-b0cb-8bbf7801f8af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:45.217968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3393a-aee6-47c2-b0cb-8bbf7801f8af admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:45.221673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710df68-8f9c-44b2-be39-4819acefe0cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:45.222272 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710df68-8f9c-44b2-be39-4819acefe0cc service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:45.222545 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710df68-8f9c-44b2-be39-4819acefe0cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:45.222860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710df68-8f9c-44b2-be39-4819acefe0cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:45.232487 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710df68-8f9c-44b2-be39-4819acefe0cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:45.233925 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710df68-8f9c-44b2-be39-4819acefe0cc service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:45.243278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1191/2379] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:15:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:15:49.734733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4197ef6-8e13-4f9c-a323-23f02bd42de9 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:49.735287 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4197ef6-8e13-4f9c-a323-23f02bd42de9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:49.735582 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4197ef6-8e13-4f9c-a323-23f02bd42de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:49.782789 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-b4197ef6-8e13-4f9c-a323-23f02bd42de9 None None] MFA Rules not processed for user `0c41b4ecb17a43fdb05e586cce43b5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:15:49.784210 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b4197ef6-8e13-4f9c-a323-23f02bd42de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:49.897007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1189/2380] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 13 14:15:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:15:49.927285 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710df68-8f9c-44b2-be39-4819acefe0cc service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:49.930199 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1710df68-8f9c-44b2-be39-4819acefe0cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:49.961329 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d623156-3d7b-42e8-b4f3-6ab27125cf0a None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:49.962377 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d623156-3d7b-42e8-b4f3-6ab27125cf0a None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:49.962658 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d623156-3d7b-42e8-b4f3-6ab27125cf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:50.007984 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-2d623156-3d7b-42e8-b4f3-6ab27125cf0a None None] MFA Rules not processed for user `85c7977a6ebe41b09eba731a6e3eb9fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:15:50.010700 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2d623156-3d7b-42e8-b4f3-6ab27125cf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:50.011741 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:50.063973 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710df68-8f9c-44b2-be39-4819acefe0cc service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:50.070637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0761b3-6d0d-4a0e-a005-943d21b15246 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c27e930f604bd38634ca08e56cf8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:50.070637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0761b3-6d0d-4a0e-a005-943d21b15246 service swift] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:50.070637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0761b3-6d0d-4a0e-a005-943d21b15246 service swift] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:50.070637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0761b3-6d0d-4a0e-a005-943d21b15246 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:50.089743 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0761b3-6d0d-4a0e-a005-943d21b15246 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:50.095816 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0761b3-6d0d-4a0e-a005-943d21b15246 service swift] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:50.105570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1192/2381] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 13 14:15:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 14:15:50.188367 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:50.197816 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1190/2382] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:15:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:15:50.203973 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0761b3-6d0d-4a0e-a005-943d21b15246 service swift] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:50.219976 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0761b3-6d0d-4a0e-a005-943d21b15246 service swift] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:50.240630 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db50615-6584-4aec-8c24-35f4a306e1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:50.241652 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db50615-6584-4aec-8c24-35f4a306e1a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:50.242127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db50615-6584-4aec-8c24-35f4a306e1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:50.243424 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db50615-6584-4aec-8c24-35f4a306e1a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:50.244850 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db50615-6584-4aec-8c24-35f4a306e1a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:50.247546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db50615-6584-4aec-8c24-35f4a306e1a3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:50.291939 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1193/2383] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:15:50 2022] POST /identity/v3/projects => generated 383 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:15:50.296995 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d623156-3d7b-42e8-b4f3-6ab27125cf0a None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:50.316924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d623156-3d7b-42e8-b4f3-6ab27125cf0a None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:50.437533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eccec8-cea4-45c5-bb4d-6f33d550c068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:50.438191 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eccec8-cea4-45c5-bb4d-6f33d550c068 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:50.438594 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eccec8-cea4-45c5-bb4d-6f33d550c068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:50.438871 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eccec8-cea4-45c5-bb4d-6f33d550c068 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:50.439522 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eccec8-cea4-45c5-bb4d-6f33d550c068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:50.442055 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eccec8-cea4-45c5-bb4d-6f33d550c068 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:50.490788 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1191/2384] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:15:50 2022] POST /identity/v3/users => generated 298 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:15:50.491614 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db50615-6584-4aec-8c24-35f4a306e1a3 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:50.521878 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db50615-6584-4aec-8c24-35f4a306e1a3 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:50.534096 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2092ec-9c99-423c-a97e-f886c9e6ff08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:50.535172 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2092ec-9c99-423c-a97e-f886c9e6ff08 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:50.535792 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2092ec-9c99-423c-a97e-f886c9e6ff08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:50.536212 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2092ec-9c99-423c-a97e-f886c9e6ff08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:50.537814 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2092ec-9c99-423c-a97e-f886c9e6ff08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:50.539981 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2092ec-9c99-423c-a97e-f886c9e6ff08 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:50.558537 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1194/2385] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:15:50.562540 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eccec8-cea4-45c5-bb4d-6f33d550c068 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:50.582281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eccec8-cea4-45c5-bb4d-6f33d550c068 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:50.591697 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3857baf-ae36-477a-8c94-7b687d8624c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:50.592689 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3857baf-ae36-477a-8c94-7b687d8624c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:50.593063 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3857baf-ae36-477a-8c94-7b687d8624c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:50.593456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3857baf-ae36-477a-8c94-7b687d8624c3 admin admin] PATH_INFO: `/v3/projects/33814c523f03442b8d0c219a75d0d4b8/users/8bd12cb47cbf44c3a32454ae1e10f02a/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:50.646091 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3857baf-ae36-477a-8c94-7b687d8624c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33814c523f03442b8d0c219a75d0d4b8, user_id=8bd12cb47cbf44c3a32454ae1e10f02a, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:50.648125 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3857baf-ae36-477a-8c94-7b687d8624c3 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:50.673361 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1192/2386] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:15:50 2022] PUT /identity/v3/projects/33814c523f03442b8d0c219a75d0d4b8/users/8bd12cb47cbf44c3a32454ae1e10f02a/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:15:50.678280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2092ec-9c99-423c-a97e-f886c9e6ff08 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:50.692666 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2092ec-9c99-423c-a97e-f886c9e6ff08 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:50.795878 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb51ea4-e6ea-4c17-953a-9d7053b5161e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:50.796499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb51ea4-e6ea-4c17-953a-9d7053b5161e admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:50.796781 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb51ea4-e6ea-4c17-953a-9d7053b5161e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:50.797051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb51ea4-e6ea-4c17-953a-9d7053b5161e admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:50.797817 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb51ea4-e6ea-4c17-953a-9d7053b5161e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:50.800610 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb51ea4-e6ea-4c17-953a-9d7053b5161e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:50.824249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1195/2387] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:15:50.826016 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3857baf-ae36-477a-8c94-7b687d8624c3 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:50.863183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3857baf-ae36-477a-8c94-7b687d8624c3 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:50.868797 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738b585-0770-4e7a-8d95-363b612b09ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:50.869531 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738b585-0770-4e7a-8d95-363b612b09ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:50.869832 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738b585-0770-4e7a-8d95-363b612b09ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:50.870062 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738b585-0770-4e7a-8d95-363b612b09ac admin admin] PATH_INFO: `/v3/projects/33814c523f03442b8d0c219a75d0d4b8/users/8bd12cb47cbf44c3a32454ae1e10f02a/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:50.872686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738b585-0770-4e7a-8d95-363b612b09ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=33814c523f03442b8d0c219a75d0d4b8, user_id=8bd12cb47cbf44c3a32454ae1e10f02a, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:50.875743 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738b585-0770-4e7a-8d95-363b612b09ac admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:50.910075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1193/2388] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:15:50 2022] PUT /identity/v3/projects/33814c523f03442b8d0c219a75d0d4b8/users/8bd12cb47cbf44c3a32454ae1e10f02a/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:15:51.849112 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d87aa-c1da-4dbd-a874-9797e5ce37e2 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:51.849686 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d87aa-c1da-4dbd-a874-9797e5ce37e2 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:51.849954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d87aa-c1da-4dbd-a874-9797e5ce37e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:51.890814 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ca7d87aa-c1da-4dbd-a874-9797e5ce37e2 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:15:51.892964 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ca7d87aa-c1da-4dbd-a874-9797e5ce37e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:52.000520 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1196/2389] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Sep 13 14:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:15:52.032993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738b585-0770-4e7a-8d95-363b612b09ac admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:52.034919 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7738b585-0770-4e7a-8d95-363b612b09ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:52.243240 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738b585-0770-4e7a-8d95-363b612b09ac admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:52.275670 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500f968-79af-4865-87f9-e10e87240c76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:52.277084 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500f968-79af-4865-87f9-e10e87240c76 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:52.277383 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500f968-79af-4865-87f9-e10e87240c76 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:52.277649 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500f968-79af-4865-87f9-e10e87240c76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:52.303123 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500f968-79af-4865-87f9-e10e87240c76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:52.304917 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500f968-79af-4865-87f9-e10e87240c76 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:52.348660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1194/2390] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:15:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 14:15:56.322301 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f5737-ffe8-471a-91ca-22f66c0e50df None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:56.322866 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f5737-ffe8-471a-91ca-22f66c0e50df None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:56.322866 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f5737-ffe8-471a-91ca-22f66c0e50df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:56.353954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ae8f5737-ffe8-471a-91ca-22f66c0e50df None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:15:56.355681 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ae8f5737-ffe8-471a-91ca-22f66c0e50df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:56.386969 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1197/2391] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Sep 13 14:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:15:56.417164 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500f968-79af-4865-87f9-e10e87240c76 service nova] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:56.418930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0500f968-79af-4865-87f9-e10e87240c76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:56.447493 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500f968-79af-4865-87f9-e10e87240c76 service nova] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:56.459457 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747a01a-218d-4085-b1e8-249daf49ada9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:56.460853 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747a01a-218d-4085-b1e8-249daf49ada9 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:56.462228 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747a01a-218d-4085-b1e8-249daf49ada9 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:56.462745 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747a01a-218d-4085-b1e8-249daf49ada9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:56.481803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747a01a-218d-4085-b1e8-249daf49ada9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:56.484079 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747a01a-218d-4085-b1e8-249daf49ada9 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:56.511168 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1195/2392] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:15:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:15:58.011682 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684acf3-61cf-40a3-b05b-691cc4fe5739 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:58.012898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684acf3-61cf-40a3-b05b-691cc4fe5739 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:58.013366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684acf3-61cf-40a3-b05b-691cc4fe5739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:58.110486 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b684acf3-61cf-40a3-b05b-691cc4fe5739 None None] MFA Rules not processed for user `8bd12cb47cbf44c3a32454ae1e10f02a`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:15:58.112455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b684acf3-61cf-40a3-b05b-691cc4fe5739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:58.167194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:58.282215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1198/2393] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:15:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:15:58.302024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747a01a-218d-4085-b1e8-249daf49ada9 service nova] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:58.302024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e747a01a-218d-4085-b1e8-249daf49ada9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:58.359483 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:58.425448 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747a01a-218d-4085-b1e8-249daf49ada9 service nova] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:58.445582 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f8cdd-528e-4dc9-b16b-d174c9e1442c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22959df6ef034036b5f6b3cda7918e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:58.447163 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f8cdd-528e-4dc9-b16b-d174c9e1442c service glance] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:58.447499 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f8cdd-528e-4dc9-b16b-d174c9e1442c service glance] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:58.447838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f8cdd-528e-4dc9-b16b-d174c9e1442c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:58.525037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f8cdd-528e-4dc9-b16b-d174c9e1442c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:58.526616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f8cdd-528e-4dc9-b16b-d174c9e1442c service glance] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:58.543205 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1196/2394] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:15:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:15:58.772640 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefa06b-a4c6-415c-a6eb-f866be521d73 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:58.773225 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefa06b-a4c6-415c-a6eb-f866be521d73 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:58.773663 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefa06b-a4c6-415c-a6eb-f866be521d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:58.800081 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-bbefa06b-a4c6-415c-a6eb-f866be521d73 None None] MFA Rules not processed for user `0c41b4ecb17a43fdb05e586cce43b5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:15:58.801809 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-bbefa06b-a4c6-415c-a6eb-f866be521d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:15:58.881772 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1199/2395] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 13 14:15:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:15:58.900960 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f8cdd-528e-4dc9-b16b-d174c9e1442c service glance] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:15:59.017627 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f8cdd-528e-4dc9-b16b-d174c9e1442c service glance] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:15:59.024626 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba798279-6434-40a0-8647-80a2334cd42c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c27e930f604bd38634ca08e56cf8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:15:59.025492 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba798279-6434-40a0-8647-80a2334cd42c service swift] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:15:59.025910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba798279-6434-40a0-8647-80a2334cd42c service swift] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:15:59.026297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba798279-6434-40a0-8647-80a2334cd42c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:15:59.047292 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba798279-6434-40a0-8647-80a2334cd42c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:15:59.050074 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba798279-6434-40a0-8647-80a2334cd42c service swift] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:15:59.064694 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1197/2396] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 13 14:15:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 14:16:00.576994 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e2c68-99e2-42e5-b23d-34088d43c3c4 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:16:00.577626 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e2c68-99e2-42e5-b23d-34088d43c3c4 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:16:00.577626 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e2c68-99e2-42e5-b23d-34088d43c3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:16:00.614687 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-2a0e2c68-99e2-42e5-b23d-34088d43c3c4 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:16:00.616448 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2a0e2c68-99e2-42e5-b23d-34088d43c3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:16:00.625846 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1200/2397] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Sep 13 14:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:16:00.653730 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba798279-6434-40a0-8647-80a2334cd42c service swift] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:16:00.675400 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba798279-6434-40a0-8647-80a2334cd42c service swift] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:16:00.702913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ba826-a960-4182-a7d2-62e78b0b1e13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:16:00.703679 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ba826-a960-4182-a7d2-62e78b0b1e13 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:16:00.704017 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ba826-a960-4182-a7d2-62e78b0b1e13 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:16:00.704357 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ba826-a960-4182-a7d2-62e78b0b1e13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:16:00.722611 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ba826-a960-4182-a7d2-62e78b0b1e13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:16:00.725958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ba826-a960-4182-a7d2-62e78b0b1e13 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:16:00.757445 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1198/2398] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:16:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:16:04.999339 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc00703-6024-48e4-9c30-e3a6d21f1dac None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:16:04.999971 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc00703-6024-48e4-9c30-e3a6d21f1dac None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:16:04.999971 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc00703-6024-48e4-9c30-e3a6d21f1dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:16:05.057643 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-4cc00703-6024-48e4-9c30-e3a6d21f1dac None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:16:05.059181 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4cc00703-6024-48e4-9c30-e3a6d21f1dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:16:05.080604 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1201/2399] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Sep 13 14:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:16:05.106706 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ba826-a960-4182-a7d2-62e78b0b1e13 service nova] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:16:05.125088 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ba826-a960-4182-a7d2-62e78b0b1e13 service nova] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:16:05.131709 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29dfbb-1ced-4f79-bc98-e4c98ba59d3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:16:05.132440 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29dfbb-1ced-4f79-bc98-e4c98ba59d3e service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:16:05.132827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29dfbb-1ced-4f79-bc98-e4c98ba59d3e service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:16:05.134413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29dfbb-1ced-4f79-bc98-e4c98ba59d3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:16:05.143009 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29dfbb-1ced-4f79-bc98-e4c98ba59d3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:16:05.144805 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29dfbb-1ced-4f79-bc98-e4c98ba59d3e service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:16:05.184891 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1199/2400] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:16:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:16:09.932094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d3295-f57b-4b2e-bce9-1ac21ed95736 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:16:09.932677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d3295-f57b-4b2e-bce9-1ac21ed95736 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:16:09.932677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d3295-f57b-4b2e-bce9-1ac21ed95736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:16:09.951125 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-985d3295-f57b-4b2e-bce9-1ac21ed95736 None None] MFA Rules not processed for user `85c7977a6ebe41b09eba731a6e3eb9fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:16:09.952300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-985d3295-f57b-4b2e-bce9-1ac21ed95736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:16:09.958992 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1202/2401] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:16:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:16:10.304844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6834f40-93d7-4005-9947-d6b8c190f4b6 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:16:10.305316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6834f40-93d7-4005-9947-d6b8c190f4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:16:10.305451 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6834f40-93d7-4005-9947-d6b8c190f4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:16:10.327460 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-f6834f40-93d7-4005-9947-d6b8c190f4b6 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:16:10.328672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f6834f40-93d7-4005-9947-d6b8c190f4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:16:10.337152 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1200/2402] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Sep 13 14:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:16:10.365143 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d3295-f57b-4b2e-bce9-1ac21ed95736 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:16:10.377889 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d3295-f57b-4b2e-bce9-1ac21ed95736 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:16:10.384171 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0d75f-5da0-410b-8a71-5064405ab1a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:16:10.384865 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0d75f-5da0-410b-8a71-5064405ab1a3 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:16:10.385318 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0d75f-5da0-410b-8a71-5064405ab1a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:16:10.385541 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0d75f-5da0-410b-8a71-5064405ab1a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:16:10.395165 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0d75f-5da0-410b-8a71-5064405ab1a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:16:10.396784 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0d75f-5da0-410b-8a71-5064405ab1a3 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:16:10.407370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1203/2403] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:16:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:16:12.850431 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d56fc-bba7-4ad7-a35f-279e5afb03ec None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:16:12.850967 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d56fc-bba7-4ad7-a35f-279e5afb03ec None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:16:12.851124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d56fc-bba7-4ad7-a35f-279e5afb03ec None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:16:12.853187 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1201/2404] 10.222.0.26 () {54 vars in 921 bytes} [Tue Sep 13 14:16:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:16:12.864379 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d104ac2-6a0e-4562-81c7-23368dcec087 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:16:12.865024 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d104ac2-6a0e-4562-81c7-23368dcec087 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:16:12.865024 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d104ac2-6a0e-4562-81c7-23368dcec087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:16:12.885546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-1d104ac2-6a0e-4562-81c7-23368dcec087 None None] MFA Rules not processed for user `1b3533d0a24e4e7bbf5c7137d3511b13`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:16:12.886746 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1d104ac2-6a0e-4562-81c7-23368dcec087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:16:12.896104 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1204/2405] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Sep 13 14:16:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:16:12.908479 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d56fc-bba7-4ad7-a35f-279e5afb03ec None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:16:12.910273 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b34d56fc-bba7-4ad7-a35f-279e5afb03ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:16:12.924273 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d56fc-bba7-4ad7-a35f-279e5afb03ec None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:16:12.928369 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad49564-270f-4992-aa93-aab10654591e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22959df6ef034036b5f6b3cda7918e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:16:12.928989 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49564-270f-4992-aa93-aab10654591e service glance] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:16:12.929480 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49564-270f-4992-aa93-aab10654591e service glance] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:16:12.930338 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49564-270f-4992-aa93-aab10654591e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:16:12.942679 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad49564-270f-4992-aa93-aab10654591e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:16:12.944037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad49564-270f-4992-aa93-aab10654591e service glance] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:16:12.954802 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1202/2406] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:16:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 14:16:13.021575 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69cdb2-64be-4475-a93e-ad254885fa96 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:16:13.021852 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69cdb2-64be-4475-a93e-ad254885fa96 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:16:13.022115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69cdb2-64be-4475-a93e-ad254885fa96 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:16:13.023993 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1205/2407] 10.222.0.26 () {54 vars in 921 bytes} [Tue Sep 13 14:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:16:13.028608 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ef863-5be9-44db-bab6-c56f832f6a1f None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:16:13.028894 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ef863-5be9-44db-bab6-c56f832f6a1f None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:16:13.029475 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ef863-5be9-44db-bab6-c56f832f6a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:16:13.049740 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-157ef863-5be9-44db-bab6-c56f832f6a1f None None] MFA Rules not processed for user `cb992cf1a7a445119262b567ce345181`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:16:13.050945 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-157ef863-5be9-44db-bab6-c56f832f6a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:16:13.068053 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:16:13.103484 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1203/2408] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Sep 13 14:16:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:16:13.115166 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69cdb2-64be-4475-a93e-ad254885fa96 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:16:13.116971 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0b69cdb2-64be-4475-a93e-ad254885fa96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:16:13.130699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69cdb2-64be-4475-a93e-ad254885fa96 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:16:13.134336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1be26-7cec-4d24-8849-422cebcf9ec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:16:13.134916 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1be26-7cec-4d24-8849-422cebcf9ec7 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:16:13.135192 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1be26-7cec-4d24-8849-422cebcf9ec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:16:13.135459 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1be26-7cec-4d24-8849-422cebcf9ec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:16:13.142490 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1be26-7cec-4d24-8849-422cebcf9ec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:16:13.144188 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1be26-7cec-4d24-8849-422cebcf9ec7 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:16:13.152463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1206/2409] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:16:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:16:13.236507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50605d-f408-4561-8357-d25c97acd67d None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:16:13.236791 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50605d-f408-4561-8357-d25c97acd67d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:16:13.237059 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50605d-f408-4561-8357-d25c97acd67d None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:16:13.238446 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1204/2410] 10.222.0.26 () {54 vars in 921 bytes} [Tue Sep 13 14:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:16:13.243267 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312ae1f-4e7d-4a45-9477-146a6b5fd456 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:16:13.243566 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312ae1f-4e7d-4a45-9477-146a6b5fd456 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:16:13.243856 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312ae1f-4e7d-4a45-9477-146a6b5fd456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:16:13.263119 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a312ae1f-4e7d-4a45-9477-146a6b5fd456 None None] MFA Rules not processed for user `1b3533d0a24e4e7bbf5c7137d3511b13`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:16:13.264298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a312ae1f-4e7d-4a45-9477-146a6b5fd456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:16:13.273940 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1207/2411] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Sep 13 14:16:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:16:13.284386 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50605d-f408-4561-8357-d25c97acd67d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:16:13.296169 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50605d-f408-4561-8357-d25c97acd67d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:16:13.299712 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066b15c-aeef-4e13-a821-dd59e58bc990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:16:13.300314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066b15c-aeef-4e13-a821-dd59e58bc990 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:16:13.300586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066b15c-aeef-4e13-a821-dd59e58bc990 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:16:13.300853 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066b15c-aeef-4e13-a821-dd59e58bc990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:16:13.311953 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066b15c-aeef-4e13-a821-dd59e58bc990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:16:13.313443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066b15c-aeef-4e13-a821-dd59e58bc990 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:16:13.324826 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1205/2412] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:16:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:16:14.872246 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4613e1-976d-41f0-a41e-c3fc7f137d10 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:16:14.872755 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4613e1-976d-41f0-a41e-c3fc7f137d10 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:16:14.872755 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4613e1-976d-41f0-a41e-c3fc7f137d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:16:14.894010 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-0f4613e1-976d-41f0-a41e-c3fc7f137d10 None None] MFA Rules not processed for user `0c41b4ecb17a43fdb05e586cce43b5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:16:14.895217 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0f4613e1-976d-41f0-a41e-c3fc7f137d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:16:14.902649 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1208/2413] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 13 14:16:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:16:14.915806 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066b15c-aeef-4e13-a821-dd59e58bc990 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:16:14.927292 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066b15c-aeef-4e13-a821-dd59e58bc990 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:16:14.933343 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24878b7-2c71-45a3-816f-0df257a4697b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c27e930f604bd38634ca08e56cf8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:16:14.933949 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24878b7-2c71-45a3-816f-0df257a4697b service swift] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:16:14.934232 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24878b7-2c71-45a3-816f-0df257a4697b service swift] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:16:14.934511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24878b7-2c71-45a3-816f-0df257a4697b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:16:14.942982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24878b7-2c71-45a3-816f-0df257a4697b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:16:14.944580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24878b7-2c71-45a3-816f-0df257a4697b service swift] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:16:14.953189 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1206/2414] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 13 14:16:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 14:16:24.888749 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=74 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:16:24.949689 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=25 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:16:39.474643 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd836f-c38d-4abf-9b3f-ebe54237b004 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:16:39.475126 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd836f-c38d-4abf-9b3f-ebe54237b004 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:16:39.475126 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd836f-c38d-4abf-9b3f-ebe54237b004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:16:39.495961 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-41dd836f-c38d-4abf-9b3f-ebe54237b004 None None] MFA Rules not processed for user `0c41b4ecb17a43fdb05e586cce43b5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:16:39.497219 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-41dd836f-c38d-4abf-9b3f-ebe54237b004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:16:39.504736 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1209/2415] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 13 14:16:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:16:39.521735 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24878b7-2c71-45a3-816f-0df257a4697b service swift] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:16:39.534005 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24878b7-2c71-45a3-816f-0df257a4697b service swift] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:16:39.539215 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020ffe0-6779-4044-afb2-c2e1058f286d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c27e930f604bd38634ca08e56cf8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:16:39.540380 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020ffe0-6779-4044-afb2-c2e1058f286d service swift] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:16:39.540652 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020ffe0-6779-4044-afb2-c2e1058f286d service swift] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:16:39.540912 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020ffe0-6779-4044-afb2-c2e1058f286d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:16:39.550420 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020ffe0-6779-4044-afb2-c2e1058f286d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:16:39.552026 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020ffe0-6779-4044-afb2-c2e1058f286d service swift] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:16:39.560214 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1207/2416] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 13 14:16:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 14:16:49.490711 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:16:49.556877 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=6 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:17:04.583970 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20243c9-d5e1-4bc2-b156-424f38761016 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:17:04.584480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20243c9-d5e1-4bc2-b156-424f38761016 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:17:04.584480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20243c9-d5e1-4bc2-b156-424f38761016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:17:04.610575 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c20243c9-d5e1-4bc2-b156-424f38761016 None None] MFA Rules not processed for user `0c41b4ecb17a43fdb05e586cce43b5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:17:04.611905 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c20243c9-d5e1-4bc2-b156-424f38761016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:17:04.620703 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1210/2417] 10.222.0.26 () {58 vars in 967 bytes} [Tue Sep 13 14:17:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:17:04.675948 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020ffe0-6779-4044-afb2-c2e1058f286d service swift] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:17:04.697670 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020ffe0-6779-4044-afb2-c2e1058f286d service swift] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:17:04.712769 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcc869-7bf0-4306-badc-77dfba0f51d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c27e930f604bd38634ca08e56cf8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:17:04.729316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcc869-7bf0-4306-badc-77dfba0f51d0 service swift] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:17:04.729316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcc869-7bf0-4306-badc-77dfba0f51d0 service swift] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:17:04.729316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcc869-7bf0-4306-badc-77dfba0f51d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:17:04.747690 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcc869-7bf0-4306-badc-77dfba0f51d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:17:04.749860 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcc869-7bf0-4306-badc-77dfba0f51d0 service swift] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:17:04.760670 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1208/2418] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 13 14:17:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 14:17:06.718595 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20243c9-d5e1-4bc2-b156-424f38761016 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:17:06.728432 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20243c9-d5e1-4bc2-b156-424f38761016 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:17:06.732008 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651832e4-2777-4332-9989-2788b6992592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:17:06.732599 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651832e4-2777-4332-9989-2788b6992592 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:17:06.732874 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651832e4-2777-4332-9989-2788b6992592 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:17:06.733176 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651832e4-2777-4332-9989-2788b6992592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:17:06.742623 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651832e4-2777-4332-9989-2788b6992592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:17:06.744112 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651832e4-2777-4332-9989-2788b6992592 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:17:06.753405 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1211/2419] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:17:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:17:14.756311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=6 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:17:16.749223 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=9 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:17:18.260082 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcc869-7bf0-4306-badc-77dfba0f51d0 service swift] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:17:18.261682 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-cfdcc869-7bf0-4306-badc-77dfba0f51d0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:17:18.275184 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcc869-7bf0-4306-badc-77dfba0f51d0 service swift] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:17:18.279956 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abb0e8-4a06-4853-ab79-5e4b41291472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:17:18.280566 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abb0e8-4a06-4853-ab79-5e4b41291472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:17:18.280838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abb0e8-4a06-4853-ab79-5e4b41291472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:17:18.281127 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abb0e8-4a06-4853-ab79-5e4b41291472 admin admin] PATH_INFO: `/v3/users/4c0e15bafe7c4085b65eb9f1e7fe7aa6` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:17:18.282225 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abb0e8-4a06-4853-ab79-5e4b41291472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c0e15bafe7c4085b65eb9f1e7fe7aa6)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:17:18.284159 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abb0e8-4a06-4853-ab79-5e4b41291472 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:17:18.329777 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-79abb0e8-4a06-4853-ab79-5e4b41291472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c0e15bafe7c4085b65eb9f1e7fe7aa6'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:17:18.338038 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-79abb0e8-4a06-4853-ab79-5e4b41291472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c0e15bafe7c4085b65eb9f1e7fe7aa6'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:17:18.351298 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-79abb0e8-4a06-4853-ab79-5e4b41291472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c0e15bafe7c4085b65eb9f1e7fe7aa6'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:17:18.351953 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-79abb0e8-4a06-4853-ab79-5e4b41291472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c0e15bafe7c4085b65eb9f1e7fe7aa6'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:17:18.358859 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-79abb0e8-4a06-4853-ab79-5e4b41291472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c0e15bafe7c4085b65eb9f1e7fe7aa6'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:17:18.364654 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1209/2420] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:17:18 2022] DELETE /identity/v3/users/4c0e15bafe7c4085b65eb9f1e7fe7aa6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:17:18.539470 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651832e4-2777-4332-9989-2788b6992592 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:17:18.550153 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651832e4-2777-4332-9989-2788b6992592 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:17:18.607913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad656a-3b06-480b-a917-27e1ded2dd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:17:18.608535 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad656a-3b06-480b-a917-27e1ded2dd67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:17:18.608809 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad656a-3b06-480b-a917-27e1ded2dd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:17:18.609074 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad656a-3b06-480b-a917-27e1ded2dd67 admin admin] PATH_INFO: `/v3/projects/6435fc86f8b44d3fa9b0417d7bd61433` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:17:18.610239 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad656a-3b06-480b-a917-27e1ded2dd67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6435fc86f8b44d3fa9b0417d7bd61433)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:17:18.612172 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad656a-3b06-480b-a917-27e1ded2dd67 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:17:18.658752 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-46ad656a-3b06-480b-a917-27e1ded2dd67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6435fc86f8b44d3fa9b0417d7bd61433', 'request_id': 'req-46ad656a-3b06-480b-a917-27e1ded2dd67'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:17:18.665526 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-46ad656a-3b06-480b-a917-27e1ded2dd67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6435fc86f8b44d3fa9b0417d7bd61433', 'request_id': 'req-46ad656a-3b06-480b-a917-27e1ded2dd67'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:17:18.673315 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-46ad656a-3b06-480b-a917-27e1ded2dd67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6435fc86f8b44d3fa9b0417d7bd61433', 'request_id': 'req-46ad656a-3b06-480b-a917-27e1ded2dd67'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:17:18.684905 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-46ad656a-3b06-480b-a917-27e1ded2dd67 admin admin] The token cache is being invalidate because project 6435fc86f8b44d3fa9b0417d7bd61433 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:17:18.685285 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-46ad656a-3b06-480b-a917-27e1ded2dd67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:17:18.685936 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-46ad656a-3b06-480b-a917-27e1ded2dd67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:17:18.687526 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1212/2421] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:17:18 2022] DELETE /identity/v3/projects/6435fc86f8b44d3fa9b0417d7bd61433 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:17:19.345330 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2966433-abbf-46c5-aefa-5450b7d262db None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:17:19.345821 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2966433-abbf-46c5-aefa-5450b7d262db None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:17:19.345922 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2966433-abbf-46c5-aefa-5450b7d262db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:17:19.367101 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-c2966433-abbf-46c5-aefa-5450b7d262db None None] MFA Rules not processed for user `8dd5ec91cd29468f97cb3045c12b819f`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:17:19.368341 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c2966433-abbf-46c5-aefa-5450b7d262db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:17:19.423534 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1210/2422] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:17:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:17:19.521306 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad656a-3b06-480b-a917-27e1ded2dd67 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:17:19.522727 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-46ad656a-3b06-480b-a917-27e1ded2dd67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:17:19.578444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad656a-3b06-480b-a917-27e1ded2dd67 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:17:19.582047 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82318f8c-4801-4387-a0ff-6db7cabf223e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:17:19.582641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82318f8c-4801-4387-a0ff-6db7cabf223e service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:17:19.582918 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82318f8c-4801-4387-a0ff-6db7cabf223e service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:17:19.583188 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82318f8c-4801-4387-a0ff-6db7cabf223e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:17:19.584890 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-82318f8c-4801-4387-a0ff-6db7cabf223e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:17:19.630111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:17:19.658360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82318f8c-4801-4387-a0ff-6db7cabf223e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:17:19.659849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82318f8c-4801-4387-a0ff-6db7cabf223e service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:17:19.671227 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1213/2423] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:17:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:17:21.133657 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2966433-abbf-46c5-aefa-5450b7d262db None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:17:21.135130 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c2966433-abbf-46c5-aefa-5450b7d262db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:17:21.193359 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2966433-abbf-46c5-aefa-5450b7d262db None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:17:21.196842 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178960f-884c-47d1-9ab6-413e12c2314f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:17:21.197464 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178960f-884c-47d1-9ab6-413e12c2314f service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:17:21.197737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178960f-884c-47d1-9ab6-413e12c2314f service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:17:21.197997 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178960f-884c-47d1-9ab6-413e12c2314f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:17:21.199662 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2178960f-884c-47d1-9ab6-413e12c2314f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:17:21.212890 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178960f-884c-47d1-9ab6-413e12c2314f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:17:21.214323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178960f-884c-47d1-9ab6-413e12c2314f service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:17:21.224910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1211/2424] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:17:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:17:29.666466 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=13 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:17:31.220234 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=80,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:17:37.445635 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82318f8c-4801-4387-a0ff-6db7cabf223e service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:17:37.455548 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82318f8c-4801-4387-a0ff-6db7cabf223e service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:17:37.459910 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915398fc-1de5-4c70-a80f-fe52b71dbe7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:17:37.460812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915398fc-1de5-4c70-a80f-fe52b71dbe7e service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:17:37.461287 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915398fc-1de5-4c70-a80f-fe52b71dbe7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:17:37.461768 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915398fc-1de5-4c70-a80f-fe52b71dbe7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:17:37.463618 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-915398fc-1de5-4c70-a80f-fe52b71dbe7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:17:37.526418 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915398fc-1de5-4c70-a80f-fe52b71dbe7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:17:37.527876 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915398fc-1de5-4c70-a80f-fe52b71dbe7e service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:17:37.538222 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1214/2425] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:17:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:17:38.430644 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bfc68-8756-4459-92dd-cb692db2a46e None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:17:38.431150 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bfc68-8756-4459-92dd-cb692db2a46e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:17:38.431244 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bfc68-8756-4459-92dd-cb692db2a46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:17:38.450928 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-f76bfc68-8756-4459-92dd-cb692db2a46e None None] MFA Rules not processed for user `c8289ecbf04143b1a136f876b1467c67`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:17:38.452128 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f76bfc68-8756-4459-92dd-cb692db2a46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:17:38.458950 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1212/2426] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:17:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:17:47.533217 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=28 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:17:48.445842 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:17:49.536115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915398fc-1de5-4c70-a80f-fe52b71dbe7e service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:17:49.544993 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915398fc-1de5-4c70-a80f-fe52b71dbe7e service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:17:49.548723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb626d7-8062-42a9-9f2a-4127aa6f8cb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:17:49.549358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb626d7-8062-42a9-9f2a-4127aa6f8cb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:17:49.549634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb626d7-8062-42a9-9f2a-4127aa6f8cb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:17:49.549905 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb626d7-8062-42a9-9f2a-4127aa6f8cb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:17:49.551638 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9eb626d7-8062-42a9-9f2a-4127aa6f8cb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:17:49.561579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb626d7-8062-42a9-9f2a-4127aa6f8cb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:17:49.563008 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb626d7-8062-42a9-9f2a-4127aa6f8cb2 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:17:49.571686 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1215/2427] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:17:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:17:59.567581 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=6 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:18:12.702625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bfc68-8756-4459-92dd-cb692db2a46e None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:18:12.704075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f76bfc68-8756-4459-92dd-cb692db2a46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:18:12.721053 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bfc68-8756-4459-92dd-cb692db2a46e None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:18:12.726567 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b4e0f-3769-4eb7-87f1-6f7c54ae731c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:18:12.727153 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b4e0f-3769-4eb7-87f1-6f7c54ae731c service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:18:12.727430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b4e0f-3769-4eb7-87f1-6f7c54ae731c service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:18:12.727698 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b4e0f-3769-4eb7-87f1-6f7c54ae731c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:18:12.729406 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-034b4e0f-3769-4eb7-87f1-6f7c54ae731c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:18:12.792100 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b4e0f-3769-4eb7-87f1-6f7c54ae731c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:18:12.793765 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b4e0f-3769-4eb7-87f1-6f7c54ae731c service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:18:12.804195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1213/2428] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:18:12 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:18:17.545180 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb626d7-8062-42a9-9f2a-4127aa6f8cb2 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:18:17.560074 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb626d7-8062-42a9-9f2a-4127aa6f8cb2 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:18:17.566552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92702ff-b2d5-42b2-90aa-358726967c7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:18:17.567242 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92702ff-b2d5-42b2-90aa-358726967c7f service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:18:17.567609 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92702ff-b2d5-42b2-90aa-358726967c7f service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:18:17.567953 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92702ff-b2d5-42b2-90aa-358726967c7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:18:17.569878 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e92702ff-b2d5-42b2-90aa-358726967c7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:18:17.584162 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92702ff-b2d5-42b2-90aa-358726967c7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:18:17.585877 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92702ff-b2d5-42b2-90aa-358726967c7f service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:18:17.599162 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1216/2429] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:18:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:18:20.977472 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57887f6e-4c0f-43f5-9e46-2af4b8f65de3 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:18:20.977963 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57887f6e-4c0f-43f5-9e46-2af4b8f65de3 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:18:20.978070 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57887f6e-4c0f-43f5-9e46-2af4b8f65de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:18:20.996786 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-57887f6e-4c0f-43f5-9e46-2af4b8f65de3 None None] MFA Rules not processed for user `a06ffa78739345039aff49f6fb524b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:18:20.998121 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-57887f6e-4c0f-43f5-9e46-2af4b8f65de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:18:21.004831 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1214/2430] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:18:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:18:21.307086 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92702ff-b2d5-42b2-90aa-358726967c7f service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:18:21.316569 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92702ff-b2d5-42b2-90aa-358726967c7f service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:18:21.320154 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bdbfeb-df99-4d5d-bbf3-f2b1b4effa1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:18:21.320745 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdbfeb-df99-4d5d-bbf3-f2b1b4effa1f service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:18:21.321019 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdbfeb-df99-4d5d-bbf3-f2b1b4effa1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:18:21.321864 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdbfeb-df99-4d5d-bbf3-f2b1b4effa1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:18:21.323607 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c7bdbfeb-df99-4d5d-bbf3-f2b1b4effa1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:18:21.333361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bdbfeb-df99-4d5d-bbf3-f2b1b4effa1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:18:21.334999 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bdbfeb-df99-4d5d-bbf3-f2b1b4effa1f service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:18:21.343128 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1217/2431] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:18:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:18:21.667759 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57887f6e-4c0f-43f5-9e46-2af4b8f65de3 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:18:21.669369 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-57887f6e-4c0f-43f5-9e46-2af4b8f65de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:18:21.740385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57887f6e-4c0f-43f5-9e46-2af4b8f65de3 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:18:21.745560 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4473f25-4ba7-4808-8c39-c183eee9df2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311397bfe2c04569852fca0cfcdbad66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:18:21.746161 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4473f25-4ba7-4808-8c39-c183eee9df2d service placement] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:18:21.746437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4473f25-4ba7-4808-8c39-c183eee9df2d service placement] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:18:21.746706 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4473f25-4ba7-4808-8c39-c183eee9df2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:18:21.748425 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e4473f25-4ba7-4808-8c39-c183eee9df2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:18:21.759982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4473f25-4ba7-4808-8c39-c183eee9df2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:18:21.761571 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4473f25-4ba7-4808-8c39-c183eee9df2d service placement] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:18:21.771222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1215/2432] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:18:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:18:24.188179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bdbfeb-df99-4d5d-bbf3-f2b1b4effa1f service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:18:24.198205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bdbfeb-df99-4d5d-bbf3-f2b1b4effa1f service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:18:24.202359 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bf3e6-f6c9-4056-a9ac-b166f64d771e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:18:24.202957 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bf3e6-f6c9-4056-a9ac-b166f64d771e service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:18:24.203258 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bf3e6-f6c9-4056-a9ac-b166f64d771e service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:18:24.203553 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bf3e6-f6c9-4056-a9ac-b166f64d771e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:18:24.205276 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-bc1bf3e6-f6c9-4056-a9ac-b166f64d771e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:18:24.217248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bf3e6-f6c9-4056-a9ac-b166f64d771e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:18:24.218691 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bf3e6-f6c9-4056-a9ac-b166f64d771e service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:18:24.228657 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1218/2433] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:18:24 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 14:18:31.767105 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=63 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:18:34.223456 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=18 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:18:35.538703 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4473f25-4ba7-4808-8c39-c183eee9df2d service placement] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:18:35.540270 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e4473f25-4ba7-4808-8c39-c183eee9df2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:18:35.557992 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4473f25-4ba7-4808-8c39-c183eee9df2d service placement] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:18:35.564741 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a37550-15e9-4d07-9dd0-62d5273de760 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:18:35.565400 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a37550-15e9-4d07-9dd0-62d5273de760 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:18:35.565738 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a37550-15e9-4d07-9dd0-62d5273de760 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:18:35.566185 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a37550-15e9-4d07-9dd0-62d5273de760 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:18:35.568020 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d0a37550-15e9-4d07-9dd0-62d5273de760 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:18:35.582553 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a37550-15e9-4d07-9dd0-62d5273de760 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:18:35.585028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a37550-15e9-4d07-9dd0-62d5273de760 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:18:35.597367 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1216/2434] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:18:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:18:39.722328 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bf3e6-f6c9-4056-a9ac-b166f64d771e service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:18:39.741745 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bf3e6-f6c9-4056-a9ac-b166f64d771e service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:18:39.748879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f493d-7d40-432c-8150-079691c19595 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:18:39.749844 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f493d-7d40-432c-8150-079691c19595 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:18:39.750278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f493d-7d40-432c-8150-079691c19595 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:18:39.750725 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f493d-7d40-432c-8150-079691c19595 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:18:39.752963 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0d0f493d-7d40-432c-8150-079691c19595 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:18:39.767144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f493d-7d40-432c-8150-079691c19595 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:18:39.768790 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f493d-7d40-432c-8150-079691c19595 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:18:39.781042 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1219/2435] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:18:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:18:45.593526 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=6 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:18:47.046623 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a37550-15e9-4d07-9dd0-62d5273de760 service nova] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:18:47.048068 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d0a37550-15e9-4d07-9dd0-62d5273de760 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:18:47.059466 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a37550-15e9-4d07-9dd0-62d5273de760 service nova] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:18:47.063022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333117ca-a1c6-46f0-ac4b-f24b2ada7218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:18:47.063609 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333117ca-a1c6-46f0-ac4b-f24b2ada7218 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:18:47.063884 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333117ca-a1c6-46f0-ac4b-f24b2ada7218 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:18:47.064153 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333117ca-a1c6-46f0-ac4b-f24b2ada7218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:18:47.065851 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-333117ca-a1c6-46f0-ac4b-f24b2ada7218 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:18:47.128478 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333117ca-a1c6-46f0-ac4b-f24b2ada7218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:18:47.130025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333117ca-a1c6-46f0-ac4b-f24b2ada7218 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:18:47.140042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1217/2436] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:18:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:18:49.775765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=6 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:18:50.300397 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f493d-7d40-432c-8150-079691c19595 service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:18:50.315054 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f493d-7d40-432c-8150-079691c19595 service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:18:50.320688 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b1878-31d2-49eb-9388-7ac0c7172b82 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311397bfe2c04569852fca0cfcdbad66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:18:50.321565 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b1878-31d2-49eb-9388-7ac0c7172b82 service placement] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:18:50.321916 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b1878-31d2-49eb-9388-7ac0c7172b82 service placement] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:18:50.322279 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b1878-31d2-49eb-9388-7ac0c7172b82 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:18:50.324436 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-df1b1878-31d2-49eb-9388-7ac0c7172b82 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:18:50.337519 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b1878-31d2-49eb-9388-7ac0c7172b82 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:18:50.339815 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b1878-31d2-49eb-9388-7ac0c7172b82 service placement] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:18:50.351059 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1220/2437] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:18:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:18:50.365081 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333117ca-a1c6-46f0-ac4b-f24b2ada7218 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:18:50.367154 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-333117ca-a1c6-46f0-ac4b-f24b2ada7218 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:18:50.382149 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333117ca-a1c6-46f0-ac4b-f24b2ada7218 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:18:50.390862 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39705a-b9e4-4e90-87d3-d6edbc98c77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:18:50.391673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39705a-b9e4-4e90-87d3-d6edbc98c77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:18:50.392080 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39705a-b9e4-4e90-87d3-d6edbc98c77b admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:18:50.392420 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39705a-b9e4-4e90-87d3-d6edbc98c77b admin admin] PATH_INFO: `/v3/users/8dd5ec91cd29468f97cb3045c12b819f` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:18:50.393817 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39705a-b9e4-4e90-87d3-d6edbc98c77b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dd5ec91cd29468f97cb3045c12b819f)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:18:50.395825 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39705a-b9e4-4e90-87d3-d6edbc98c77b admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:18:50.446492 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-0e39705a-b9e4-4e90-87d3-d6edbc98c77b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dd5ec91cd29468f97cb3045c12b819f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:18:50.453645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-0e39705a-b9e4-4e90-87d3-d6edbc98c77b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dd5ec91cd29468f97cb3045c12b819f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:18:50.465998 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-0e39705a-b9e4-4e90-87d3-d6edbc98c77b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dd5ec91cd29468f97cb3045c12b819f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:18:50.466653 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-0e39705a-b9e4-4e90-87d3-d6edbc98c77b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dd5ec91cd29468f97cb3045c12b819f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:18:50.473543 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-0e39705a-b9e4-4e90-87d3-d6edbc98c77b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dd5ec91cd29468f97cb3045c12b819f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:18:50.480127 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1218/2438] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:18:50 2022] DELETE /identity/v3/users/8dd5ec91cd29468f97cb3045c12b819f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:18:50.651479 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b1878-31d2-49eb-9388-7ac0c7172b82 service placement] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:18:50.664343 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b1878-31d2-49eb-9388-7ac0c7172b82 service placement] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:18:50.724610 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5137a-c48f-42b5-8235-4dd6ccc23cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:18:50.725265 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5137a-c48f-42b5-8235-4dd6ccc23cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:18:50.725547 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5137a-c48f-42b5-8235-4dd6ccc23cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:18:50.725815 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5137a-c48f-42b5-8235-4dd6ccc23cef admin admin] PATH_INFO: `/v3/projects/f86e4ed6a55148d29b303b6dc146392a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:18:50.726904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5137a-c48f-42b5-8235-4dd6ccc23cef admin admin] RBAC: Authorizing `identity:delete_project(project_id=f86e4ed6a55148d29b303b6dc146392a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:18:50.728970 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5137a-c48f-42b5-8235-4dd6ccc23cef admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:18:50.774678 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-10b5137a-c48f-42b5-8235-4dd6ccc23cef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f86e4ed6a55148d29b303b6dc146392a', 'request_id': 'req-10b5137a-c48f-42b5-8235-4dd6ccc23cef'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:18:50.781794 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-10b5137a-c48f-42b5-8235-4dd6ccc23cef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f86e4ed6a55148d29b303b6dc146392a', 'request_id': 'req-10b5137a-c48f-42b5-8235-4dd6ccc23cef'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:18:50.789121 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-10b5137a-c48f-42b5-8235-4dd6ccc23cef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f86e4ed6a55148d29b303b6dc146392a', 'request_id': 'req-10b5137a-c48f-42b5-8235-4dd6ccc23cef'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:18:50.800404 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-10b5137a-c48f-42b5-8235-4dd6ccc23cef admin admin] The token cache is being invalidate because project f86e4ed6a55148d29b303b6dc146392a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:18:50.800775 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-10b5137a-c48f-42b5-8235-4dd6ccc23cef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:18:50.801329 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-10b5137a-c48f-42b5-8235-4dd6ccc23cef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:18:50.802898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1221/2439] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:18:50 2022] DELETE /identity/v3/projects/f86e4ed6a55148d29b303b6dc146392a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:18:50.808102 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5affd-2e7b-4861-9ee9-5dc94a9a480b None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:18:50.808803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5affd-2e7b-4861-9ee9-5dc94a9a480b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:18:50.808803 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5affd-2e7b-4861-9ee9-5dc94a9a480b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:18:50.830262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-a8d5affd-2e7b-4861-9ee9-5dc94a9a480b None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:18:50.831396 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a8d5affd-2e7b-4861-9ee9-5dc94a9a480b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:18:50.891763 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1219/2440] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:18:50.899558 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7738b3a-f702-4b87-9e85-6edb7fde2c1d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:18:50.899840 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7738b3a-f702-4b87-9e85-6edb7fde2c1d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:18:50.900109 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7738b3a-f702-4b87-9e85-6edb7fde2c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:18:50.922321 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a7738b3a-f702-4b87-9e85-6edb7fde2c1d None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:18:50.923552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a7738b3a-f702-4b87-9e85-6edb7fde2c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:18:50.934564 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1222/2441] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:18:50.935994 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5affd-2e7b-4861-9ee9-5dc94a9a480b None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:18:50.945931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5affd-2e7b-4861-9ee9-5dc94a9a480b None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:18:50.951016 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06950ab8-93f4-4729-a12e-99aaf35c0341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:18:50.951599 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06950ab8-93f4-4729-a12e-99aaf35c0341 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:18:50.951876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06950ab8-93f4-4729-a12e-99aaf35c0341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:18:50.952147 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06950ab8-93f4-4729-a12e-99aaf35c0341 admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:18:50.952824 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06950ab8-93f4-4729-a12e-99aaf35c0341 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:18:50.953650 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06950ab8-93f4-4729-a12e-99aaf35c0341 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:18:50.954734 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06950ab8-93f4-4729-a12e-99aaf35c0341 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:18:50.956193 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:18:50.968655 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1220/2442] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:18:50.972905 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7738b3a-f702-4b87-9e85-6edb7fde2c1d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:18:50.982228 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7738b3a-f702-4b87-9e85-6edb7fde2c1d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:18:50.986966 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc04825-ede8-4908-b54c-a65eda6ea857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:18:50.987550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc04825-ede8-4908-b54c-a65eda6ea857 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:18:50.987827 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc04825-ede8-4908-b54c-a65eda6ea857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:18:50.988097 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc04825-ede8-4908-b54c-a65eda6ea857 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:18:50.988726 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc04825-ede8-4908-b54c-a65eda6ea857 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:18:50.990747 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc04825-ede8-4908-b54c-a65eda6ea857 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:18:51.017661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1223/2443] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:18:50 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:18:51.021751 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06950ab8-93f4-4729-a12e-99aaf35c0341 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:18:51.032536 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06950ab8-93f4-4729-a12e-99aaf35c0341 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:18:51.088753 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468511b-1354-4f4e-9252-b5ff5d8da5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:18:51.089317 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468511b-1354-4f4e-9252-b5ff5d8da5ff admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:18:51.089598 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468511b-1354-4f4e-9252-b5ff5d8da5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:18:51.089870 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468511b-1354-4f4e-9252-b5ff5d8da5ff admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:18:51.090506 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468511b-1354-4f4e-9252-b5ff5d8da5ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:18:51.092441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468511b-1354-4f4e-9252-b5ff5d8da5ff admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:18:51.112196 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1221/2444] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:18:51 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:18:51.116337 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc04825-ede8-4908-b54c-a65eda6ea857 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:18:51.127268 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc04825-ede8-4908-b54c-a65eda6ea857 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:18:51.131959 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003806e-a305-4eae-9f32-c03b644037e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:18:51.132553 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003806e-a305-4eae-9f32-c03b644037e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:18:51.132832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003806e-a305-4eae-9f32-c03b644037e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:18:51.133121 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003806e-a305-4eae-9f32-c03b644037e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:18:51.133770 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003806e-a305-4eae-9f32-c03b644037e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:18:51.135964 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003806e-a305-4eae-9f32-c03b644037e8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:18:51.146239 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1224/2445] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:18:51.150056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468511b-1354-4f4e-9252-b5ff5d8da5ff admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:18:51.160130 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468511b-1354-4f4e-9252-b5ff5d8da5ff admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:18:51.164704 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9417f-8834-449c-a2d2-45112c064eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:18:51.165321 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9417f-8834-449c-a2d2-45112c064eae admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:18:51.165603 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9417f-8834-449c-a2d2-45112c064eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:18:51.165874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9417f-8834-449c-a2d2-45112c064eae admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:18:51.166633 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9417f-8834-449c-a2d2-45112c064eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:18:51.168211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9417f-8834-449c-a2d2-45112c064eae admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:18:51.179713 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1222/2446] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:18:51.184381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003806e-a305-4eae-9f32-c03b644037e8 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:18:51.195518 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003806e-a305-4eae-9f32-c03b644037e8 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:18:51.200813 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf602ea-ef6d-4f27-89cd-1b1b0882aea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:18:51.201514 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf602ea-ef6d-4f27-89cd-1b1b0882aea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:18:51.201789 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf602ea-ef6d-4f27-89cd-1b1b0882aea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:18:51.202056 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf602ea-ef6d-4f27-89cd-1b1b0882aea8 admin admin] PATH_INFO: `/v3/projects/8a9c6d7e987f4eeaae50d21d9f34ba56/users/5b7bb09021514c2e81eee138657d8682/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:18:51.216178 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf602ea-ef6d-4f27-89cd-1b1b0882aea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a9c6d7e987f4eeaae50d21d9f34ba56, user_id=5b7bb09021514c2e81eee138657d8682, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:18:51.218852 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf602ea-ef6d-4f27-89cd-1b1b0882aea8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:18:51.230904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1225/2447] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:18:51 2022] PUT /identity/v3/projects/8a9c6d7e987f4eeaae50d21d9f34ba56/users/5b7bb09021514c2e81eee138657d8682/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:18:51.235883 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be38e7d-8046-491b-92f0-d544e9d16d8d None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:18:51.236195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be38e7d-8046-491b-92f0-d544e9d16d8d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:18:51.236472 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be38e7d-8046-491b-92f0-d544e9d16d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:18:51.255974 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-6be38e7d-8046-491b-92f0-d544e9d16d8d None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:18:51.257236 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-6be38e7d-8046-491b-92f0-d544e9d16d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:18:51.316749 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1223/2448] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:18:51.327071 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf602ea-ef6d-4f27-89cd-1b1b0882aea8 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:18:51.328759 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1bf602ea-ef6d-4f27-89cd-1b1b0882aea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:18:51.343108 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:18:51.387405 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf602ea-ef6d-4f27-89cd-1b1b0882aea8 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:18:51.391119 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdce74-dcc9-4e8e-8530-00cebf36e264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:18:51.391708 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdce74-dcc9-4e8e-8530-00cebf36e264 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:18:51.391981 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdce74-dcc9-4e8e-8530-00cebf36e264 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:18:51.392248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdce74-dcc9-4e8e-8530-00cebf36e264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:18:51.402057 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdce74-dcc9-4e8e-8530-00cebf36e264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:18:51.403474 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdce74-dcc9-4e8e-8530-00cebf36e264 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:18:51.412951 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1226/2449] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:18:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:18:55.543327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b870d9-a7f3-40e3-9602-e606c81925bc None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:18:55.543777 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b870d9-a7f3-40e3-9602-e606c81925bc None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:18:55.543876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b870d9-a7f3-40e3-9602-e606c81925bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:18:55.578061 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-f2b870d9-a7f3-40e3-9602-e606c81925bc None None] MFA Rules not processed for user `5b7bb09021514c2e81eee138657d8682`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:18:55.579296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f2b870d9-a7f3-40e3-9602-e606c81925bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:18:55.651318 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1224/2450] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:18:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:18:55.666830 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdce74-dcc9-4e8e-8530-00cebf36e264 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:18:55.668322 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8dcdce74-dcc9-4e8e-8530-00cebf36e264 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:18:55.745496 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdce74-dcc9-4e8e-8530-00cebf36e264 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:18:55.751085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e464d6b-1364-43e4-8ed8-c871f7702127 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:18:55.751700 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e464d6b-1364-43e4-8ed8-c871f7702127 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:18:55.751983 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e464d6b-1364-43e4-8ed8-c871f7702127 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:18:55.752251 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e464d6b-1364-43e4-8ed8-c871f7702127 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:18:55.761307 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e464d6b-1364-43e4-8ed8-c871f7702127 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:18:55.762952 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e464d6b-1364-43e4-8ed8-c871f7702127 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:18:55.772543 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1227/2451] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:18:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:18:57.024150 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287edcad-4642-417c-afc6-8895c3ed447b None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:18:57.024619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287edcad-4642-417c-afc6-8895c3ed447b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:18:57.024790 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287edcad-4642-417c-afc6-8895c3ed447b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:18:57.033420 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:18:57.047604 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-287edcad-4642-417c-afc6-8895c3ed447b None None] MFA Rules not processed for user `5b7bb09021514c2e81eee138657d8682`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:18:57.049238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-287edcad-4642-417c-afc6-8895c3ed447b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:18:57.057850 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1225/2452] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:18:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:18:57.379238 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e464d6b-1364-43e4-8ed8-c871f7702127 service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:18:57.380562 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9e464d6b-1364-43e4-8ed8-c871f7702127 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:18:57.392971 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e464d6b-1364-43e4-8ed8-c871f7702127 service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:18:57.396601 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7179c7-478c-4bce-b9e3-653693b592df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:18:57.397219 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7179c7-478c-4bce-b9e3-653693b592df service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:18:57.397500 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7179c7-478c-4bce-b9e3-653693b592df service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:18:57.397766 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7179c7-478c-4bce-b9e3-653693b592df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:18:57.399603 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-be7179c7-478c-4bce-b9e3-653693b592df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:18:57.410627 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7179c7-478c-4bce-b9e3-653693b592df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:18:57.412050 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7179c7-478c-4bce-b9e3-653693b592df service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:18:57.420883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1228/2453] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:18:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:19:07.045293 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:19:07.417155 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=60 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:19:21.008025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a876e7-3fb3-414d-a876-a36d78438e45 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:19:21.008509 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a876e7-3fb3-414d-a876-a36d78438e45 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:19:21.008610 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a876e7-3fb3-414d-a876-a36d78438e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:19:21.028078 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-69a876e7-3fb3-414d-a876-a36d78438e45 None None] MFA Rules not processed for user `c8289ecbf04143b1a136f876b1467c67`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:19:21.029308 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-69a876e7-3fb3-414d-a876-a36d78438e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:19:21.083724 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1226/2454] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:19:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:19:31.077049 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=25 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:19:58.153411 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e0d5e-14b7-4d93-9fb7-d7a25ffacc43 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:19:58.153898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e0d5e-14b7-4d93-9fb7-d7a25ffacc43 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:19:58.153996 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e0d5e-14b7-4d93-9fb7-d7a25ffacc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:19:58.173273 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-1f7e0d5e-14b7-4d93-9fb7-d7a25ffacc43 None None] MFA Rules not processed for user `0c41b4ecb17a43fdb05e586cce43b5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:19:58.174470 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1f7e0d5e-14b7-4d93-9fb7-d7a25ffacc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:19:58.228498 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1229/2455] 10.222.0.26 () {58 vars in 967 bytes} [Tue Sep 13 14:19:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:19:58.273859 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a876e7-3fb3-414d-a876-a36d78438e45 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:19:58.275277 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-69a876e7-3fb3-414d-a876-a36d78438e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:19:58.344359 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a876e7-3fb3-414d-a876-a36d78438e45 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:19:58.349486 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00684184-8979-4fd9-bd5c-48b052de30f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c27e930f604bd38634ca08e56cf8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:19:58.350077 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00684184-8979-4fd9-bd5c-48b052de30f4 service swift] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:19:58.350351 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00684184-8979-4fd9-bd5c-48b052de30f4 service swift] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:19:58.350619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00684184-8979-4fd9-bd5c-48b052de30f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:19:58.360418 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00684184-8979-4fd9-bd5c-48b052de30f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:19:58.362687 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00684184-8979-4fd9-bd5c-48b052de30f4 service swift] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:19:58.371569 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1227/2456] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 13 14:19:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 14:20:01.747512 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e0d5e-14b7-4d93-9fb7-d7a25ffacc43 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:20:01.749049 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1f7e0d5e-14b7-4d93-9fb7-d7a25ffacc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:20:01.834353 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e0d5e-14b7-4d93-9fb7-d7a25ffacc43 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:20:01.841591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb1b1c-1779-42b7-8944-64dbc4225765 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311397bfe2c04569852fca0cfcdbad66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:20:01.842305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb1b1c-1779-42b7-8944-64dbc4225765 service placement] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:20:01.842656 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb1b1c-1779-42b7-8944-64dbc4225765 service placement] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:20:01.842995 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb1b1c-1779-42b7-8944-64dbc4225765 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:20:01.844839 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-24fb1b1c-1779-42b7-8944-64dbc4225765 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:20:01.858577 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb1b1c-1779-42b7-8944-64dbc4225765 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:20:01.860360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb1b1c-1779-42b7-8944-64dbc4225765 service placement] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:20:01.878401 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1230/2457] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:20:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:20:04.684150 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00684184-8979-4fd9-bd5c-48b052de30f4 service swift] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:20:04.685817 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-00684184-8979-4fd9-bd5c-48b052de30f4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:20:04.707810 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00684184-8979-4fd9-bd5c-48b052de30f4 service swift] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:20:04.712632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44008c-f3ad-4019-bf00-6d7a7d235a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:20:04.713393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44008c-f3ad-4019-bf00-6d7a7d235a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:20:04.713674 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44008c-f3ad-4019-bf00-6d7a7d235a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:20:04.713942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44008c-f3ad-4019-bf00-6d7a7d235a46 admin admin] PATH_INFO: `/v3/users/85c7977a6ebe41b09eba731a6e3eb9fb` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:20:04.715090 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44008c-f3ad-4019-bf00-6d7a7d235a46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85c7977a6ebe41b09eba731a6e3eb9fb)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:20:04.717073 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44008c-f3ad-4019-bf00-6d7a7d235a46 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:20:04.765673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-9c44008c-f3ad-4019-bf00-6d7a7d235a46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85c7977a6ebe41b09eba731a6e3eb9fb'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:20:04.772767 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-9c44008c-f3ad-4019-bf00-6d7a7d235a46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85c7977a6ebe41b09eba731a6e3eb9fb'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:20:04.784804 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-9c44008c-f3ad-4019-bf00-6d7a7d235a46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85c7977a6ebe41b09eba731a6e3eb9fb'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:20:04.785449 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-9c44008c-f3ad-4019-bf00-6d7a7d235a46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85c7977a6ebe41b09eba731a6e3eb9fb'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:20:04.792197 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-9c44008c-f3ad-4019-bf00-6d7a7d235a46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85c7977a6ebe41b09eba731a6e3eb9fb'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:20:04.797999 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1228/2458] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:20:04 2022] DELETE /identity/v3/users/85c7977a6ebe41b09eba731a6e3eb9fb => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:20:04.974032 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb1b1c-1779-42b7-8944-64dbc4225765 service placement] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:20:04.985466 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb1b1c-1779-42b7-8944-64dbc4225765 service placement] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:20:05.041970 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc753e54-9d2d-46da-a7bf-97e29dc1fdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:20:05.043031 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc753e54-9d2d-46da-a7bf-97e29dc1fdfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:20:05.043312 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc753e54-9d2d-46da-a7bf-97e29dc1fdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:20:05.043587 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc753e54-9d2d-46da-a7bf-97e29dc1fdfd admin admin] PATH_INFO: `/v3/projects/f8169711db1b4916bb18371fd09fb29f` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:20:05.044702 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc753e54-9d2d-46da-a7bf-97e29dc1fdfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8169711db1b4916bb18371fd09fb29f)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:20:05.046665 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc753e54-9d2d-46da-a7bf-97e29dc1fdfd admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:20:05.085002 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:20:05.094848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-dc753e54-9d2d-46da-a7bf-97e29dc1fdfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8169711db1b4916bb18371fd09fb29f', 'request_id': 'req-dc753e54-9d2d-46da-a7bf-97e29dc1fdfd'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:20:05.101159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-dc753e54-9d2d-46da-a7bf-97e29dc1fdfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8169711db1b4916bb18371fd09fb29f', 'request_id': 'req-dc753e54-9d2d-46da-a7bf-97e29dc1fdfd'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:20:05.108773 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-dc753e54-9d2d-46da-a7bf-97e29dc1fdfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8169711db1b4916bb18371fd09fb29f', 'request_id': 'req-dc753e54-9d2d-46da-a7bf-97e29dc1fdfd'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:20:05.118953 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-dc753e54-9d2d-46da-a7bf-97e29dc1fdfd admin admin] The token cache is being invalidate because project f8169711db1b4916bb18371fd09fb29f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:20:05.119236 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-dc753e54-9d2d-46da-a7bf-97e29dc1fdfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:20:05.119853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-dc753e54-9d2d-46da-a7bf-97e29dc1fdfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:20:05.121955 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1231/2459] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:20:04 2022] DELETE /identity/v3/projects/f8169711db1b4916bb18371fd09fb29f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:20:05.126469 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44008c-f3ad-4019-bf00-6d7a7d235a46 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:20:05.127991 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-9c44008c-f3ad-4019-bf00-6d7a7d235a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:20:05.142606 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44008c-f3ad-4019-bf00-6d7a7d235a46 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:20:05.202811 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb24a2-0c0b-4934-afd3-0161a5c242e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:20:05.203428 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb24a2-0c0b-4934-afd3-0161a5c242e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:20:05.203708 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb24a2-0c0b-4934-afd3-0161a5c242e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:20:05.203971 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb24a2-0c0b-4934-afd3-0161a5c242e2 admin admin] PATH_INFO: `/v3/users/8bd12cb47cbf44c3a32454ae1e10f02a` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:20:05.205074 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb24a2-0c0b-4934-afd3-0161a5c242e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bd12cb47cbf44c3a32454ae1e10f02a)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:20:05.207010 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb24a2-0c0b-4934-afd3-0161a5c242e2 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:20:05.209253 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:20:05.256222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-4bbb24a2-0c0b-4934-afd3-0161a5c242e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bd12cb47cbf44c3a32454ae1e10f02a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:20:05.263090 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-4bbb24a2-0c0b-4934-afd3-0161a5c242e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bd12cb47cbf44c3a32454ae1e10f02a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:20:05.275045 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-4bbb24a2-0c0b-4934-afd3-0161a5c242e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bd12cb47cbf44c3a32454ae1e10f02a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:20:05.275783 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-4bbb24a2-0c0b-4934-afd3-0161a5c242e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bd12cb47cbf44c3a32454ae1e10f02a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:20:05.283696 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-4bbb24a2-0c0b-4934-afd3-0161a5c242e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bd12cb47cbf44c3a32454ae1e10f02a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:20:05.289593 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1229/2460] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:20:05 2022] DELETE /identity/v3/users/8bd12cb47cbf44c3a32454ae1e10f02a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:20:05.460691 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc753e54-9d2d-46da-a7bf-97e29dc1fdfd admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:20:05.462191 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-dc753e54-9d2d-46da-a7bf-97e29dc1fdfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:20:05.476928 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc753e54-9d2d-46da-a7bf-97e29dc1fdfd admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:20:05.535443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de091eb-d942-45c0-8ff0-cf3a7acf5754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:20:05.536066 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de091eb-d942-45c0-8ff0-cf3a7acf5754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:20:05.536338 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de091eb-d942-45c0-8ff0-cf3a7acf5754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:20:05.536604 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de091eb-d942-45c0-8ff0-cf3a7acf5754 admin admin] PATH_INFO: `/v3/projects/33814c523f03442b8d0c219a75d0d4b8` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:20:05.537697 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de091eb-d942-45c0-8ff0-cf3a7acf5754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33814c523f03442b8d0c219a75d0d4b8)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:20:05.539591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de091eb-d942-45c0-8ff0-cf3a7acf5754 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:20:05.584810 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8de091eb-d942-45c0-8ff0-cf3a7acf5754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33814c523f03442b8d0c219a75d0d4b8', 'request_id': 'req-8de091eb-d942-45c0-8ff0-cf3a7acf5754'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:20:05.590918 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8de091eb-d942-45c0-8ff0-cf3a7acf5754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33814c523f03442b8d0c219a75d0d4b8', 'request_id': 'req-8de091eb-d942-45c0-8ff0-cf3a7acf5754'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:20:05.597958 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8de091eb-d942-45c0-8ff0-cf3a7acf5754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33814c523f03442b8d0c219a75d0d4b8', 'request_id': 'req-8de091eb-d942-45c0-8ff0-cf3a7acf5754'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:20:05.608914 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8de091eb-d942-45c0-8ff0-cf3a7acf5754 admin admin] The token cache is being invalidate because project 33814c523f03442b8d0c219a75d0d4b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:20:05.609227 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8de091eb-d942-45c0-8ff0-cf3a7acf5754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:20:05.609845 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8de091eb-d942-45c0-8ff0-cf3a7acf5754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:20:05.611294 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1232/2461] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:20:05 2022] DELETE /identity/v3/projects/33814c523f03442b8d0c219a75d0d4b8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:20:15.286128 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=25,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:20:15.606046 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=62,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:20:27.230899 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3e4b8-6e5d-4692-b35d-faf77d071cb6 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:20:27.231420 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3e4b8-6e5d-4692-b35d-faf77d071cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:20:27.231521 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3e4b8-6e5d-4692-b35d-faf77d071cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:20:27.274917 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-12d3e4b8-6e5d-4692-b35d-faf77d071cb6 None None] MFA Rules not processed for user `0c41b4ecb17a43fdb05e586cce43b5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:20:27.276704 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-12d3e4b8-6e5d-4692-b35d-faf77d071cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:20:27.357303 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1230/2462] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 13 14:20:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:20:27.369997 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de091eb-d942-45c0-8ff0-cf3a7acf5754 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:20:27.371385 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8de091eb-d942-45c0-8ff0-cf3a7acf5754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:20:27.470799 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de091eb-d942-45c0-8ff0-cf3a7acf5754 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:20:27.475964 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe29f0-9a95-4d68-8252-ac008890e2d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c27e930f604bd38634ca08e56cf8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:20:27.476566 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe29f0-9a95-4d68-8252-ac008890e2d0 service swift] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:20:27.476843 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe29f0-9a95-4d68-8252-ac008890e2d0 service swift] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:20:27.477137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe29f0-9a95-4d68-8252-ac008890e2d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:20:27.485904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe29f0-9a95-4d68-8252-ac008890e2d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:20:27.487490 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe29f0-9a95-4d68-8252-ac008890e2d0 service swift] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:20:27.495507 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1233/2463] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 13 14:20:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 14:20:28.689432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3e4b8-6e5d-4692-b35d-faf77d071cb6 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:20:28.691263 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-12d3e4b8-6e5d-4692-b35d-faf77d071cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:20:28.833219 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3e4b8-6e5d-4692-b35d-faf77d071cb6 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:20:28.839540 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884525d-80bf-49ed-a2b7-3adc7cfdc414 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311397bfe2c04569852fca0cfcdbad66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:20:28.840440 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884525d-80bf-49ed-a2b7-3adc7cfdc414 service placement] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:20:28.840715 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884525d-80bf-49ed-a2b7-3adc7cfdc414 service placement] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:20:28.840982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884525d-80bf-49ed-a2b7-3adc7cfdc414 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:20:28.843577 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d884525d-80bf-49ed-a2b7-3adc7cfdc414 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:20:28.864070 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884525d-80bf-49ed-a2b7-3adc7cfdc414 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:20:28.865720 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884525d-80bf-49ed-a2b7-3adc7cfdc414 service placement] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:20:28.877065 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1231/2464] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:20:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:20:37.492262 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=43 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:20:38.871836 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=86 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:20:41.807273 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45716b-cc09-429d-9537-5fa63ae44a44 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:20:41.807837 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45716b-cc09-429d-9537-5fa63ae44a44 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:20:41.807837 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45716b-cc09-429d-9537-5fa63ae44a44 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:20:41.809191 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1234/2465] 10.222.0.26 () {54 vars in 921 bytes} [Tue Sep 13 14:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:20:41.820686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a3254-c942-4578-ab46-23c519443543 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:20:41.821219 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a3254-c942-4578-ab46-23c519443543 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:20:41.821381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a3254-c942-4578-ab46-23c519443543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:20:41.867656 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-765a3254-c942-4578-ab46-23c519443543 None None] MFA Rules not processed for user `1b3533d0a24e4e7bbf5c7137d3511b13`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:20:41.868934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-765a3254-c942-4578-ab46-23c519443543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:20:41.948068 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1232/2466] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Sep 13 14:20:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:20:41.959411 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45716b-cc09-429d-9537-5fa63ae44a44 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:20:41.961128 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fe45716b-cc09-429d-9537-5fa63ae44a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:20:42.024598 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45716b-cc09-429d-9537-5fa63ae44a44 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:20:42.028068 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2dd50-7360-4f84-b45b-bc23945e26c2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22959df6ef034036b5f6b3cda7918e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:20:42.028664 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2dd50-7360-4f84-b45b-bc23945e26c2 service glance] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:20:42.028939 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2dd50-7360-4f84-b45b-bc23945e26c2 service glance] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:20:42.029241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2dd50-7360-4f84-b45b-bc23945e26c2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:20:42.039897 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2dd50-7360-4f84-b45b-bc23945e26c2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:20:42.041341 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2dd50-7360-4f84-b45b-bc23945e26c2 service glance] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:20:42.052219 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1235/2467] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:20:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:20:42.119519 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51017f45-c815-4ca4-ac98-656f7687334a None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:20:42.119804 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51017f45-c815-4ca4-ac98-656f7687334a None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:20:42.120076 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51017f45-c815-4ca4-ac98-656f7687334a None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:20:42.121747 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1233/2468] 10.222.0.26 () {54 vars in 921 bytes} [Tue Sep 13 14:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:20:42.126462 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b1911-7f7e-48ba-8ee8-c5fff055769e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:20:42.126745 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b1911-7f7e-48ba-8ee8-c5fff055769e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:20:42.127012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b1911-7f7e-48ba-8ee8-c5fff055769e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:20:42.158660 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-376b1911-7f7e-48ba-8ee8-c5fff055769e None None] MFA Rules not processed for user `cb992cf1a7a445119262b567ce345181`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:20:42.159851 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-376b1911-7f7e-48ba-8ee8-c5fff055769e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:20:42.222343 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1236/2469] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Sep 13 14:20:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:20:42.235055 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51017f45-c815-4ca4-ac98-656f7687334a None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:20:42.236841 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-51017f45-c815-4ca4-ac98-656f7687334a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:20:42.250648 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51017f45-c815-4ca4-ac98-656f7687334a None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:20:42.254236 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a0e3d-e399-428f-b231-25d582850bf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:20:42.254821 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a0e3d-e399-428f-b231-25d582850bf6 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:20:42.255099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a0e3d-e399-428f-b231-25d582850bf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:20:42.255413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a0e3d-e399-428f-b231-25d582850bf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:20:42.262458 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a0e3d-e399-428f-b231-25d582850bf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:20:42.263879 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a0e3d-e399-428f-b231-25d582850bf6 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:20:42.272120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1234/2470] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:20:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:20:42.353925 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e168f-92b5-43c0-8e4f-09ecb7e4e08a None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:20:42.354214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e168f-92b5-43c0-8e4f-09ecb7e4e08a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:20:42.354502 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e168f-92b5-43c0-8e4f-09ecb7e4e08a None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:20:42.355874 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1237/2471] 10.222.0.26 () {54 vars in 921 bytes} [Tue Sep 13 14:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:20:42.362150 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ac07f-1b38-41e8-ad8c-61b460570c8b None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:20:42.362414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ac07f-1b38-41e8-ad8c-61b460570c8b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:20:42.362686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ac07f-1b38-41e8-ad8c-61b460570c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:20:42.383861 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-b47ac07f-1b38-41e8-ad8c-61b460570c8b None None] MFA Rules not processed for user `1b3533d0a24e4e7bbf5c7137d3511b13`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:20:42.385061 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b47ac07f-1b38-41e8-ad8c-61b460570c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:20:42.394985 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1235/2472] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Sep 13 14:20:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:20:42.405889 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e168f-92b5-43c0-8e4f-09ecb7e4e08a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:20:42.418435 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e168f-92b5-43c0-8e4f-09ecb7e4e08a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:20:42.423716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81f693-24a2-4c61-aace-0c4eccfa8c2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:20:42.424613 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81f693-24a2-4c61-aace-0c4eccfa8c2c service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:20:42.425051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81f693-24a2-4c61-aace-0c4eccfa8c2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:20:42.425515 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81f693-24a2-4c61-aace-0c4eccfa8c2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:20:42.437334 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81f693-24a2-4c61-aace-0c4eccfa8c2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:20:42.438771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81f693-24a2-4c61-aace-0c4eccfa8c2c service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:20:42.449809 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1238/2473] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:20:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 14:20:44.471615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f25119-434c-49c9-898f-dbeabec5c672 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:20:44.472062 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f25119-434c-49c9-898f-dbeabec5c672 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:20:44.472176 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f25119-434c-49c9-898f-dbeabec5c672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:20:44.491476 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-46f25119-434c-49c9-898f-dbeabec5c672 None None] MFA Rules not processed for user `0c41b4ecb17a43fdb05e586cce43b5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:20:44.492663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-46f25119-434c-49c9-898f-dbeabec5c672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:20:44.500345 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1236/2474] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Sep 13 14:20:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:20:44.512164 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81f693-24a2-4c61-aace-0c4eccfa8c2c service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:20:44.523292 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81f693-24a2-4c61-aace-0c4eccfa8c2c service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:20:44.528233 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a5209-00d7-4c24-b14b-c35d268455e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c27e930f604bd38634ca08e56cf8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:20:44.528815 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a5209-00d7-4c24-b14b-c35d268455e6 service swift] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:20:44.529123 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a5209-00d7-4c24-b14b-c35d268455e6 service swift] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:20:44.529508 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a5209-00d7-4c24-b14b-c35d268455e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:20:44.537705 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a5209-00d7-4c24-b14b-c35d268455e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:20:44.539274 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a5209-00d7-4c24-b14b-c35d268455e6 service swift] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:20:44.547796 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1239/2475] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 13 14:20:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 14:20:54.486060 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=56 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:20:54.543941 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=70 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:04.572441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c8c3d-0e44-4fd4-b501-9f4b9b7f4538 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:04.572928 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c8c3d-0e44-4fd4-b501-9f4b9b7f4538 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:04.573032 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c8c3d-0e44-4fd4-b501-9f4b9b7f4538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:04.593550 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-678c8c3d-0e44-4fd4-b501-9f4b9b7f4538 None None] MFA Rules not processed for user `0c41b4ecb17a43fdb05e586cce43b5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:04.594944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-678c8c3d-0e44-4fd4-b501-9f4b9b7f4538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:04.602678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1237/2476] 10.222.0.26 () {58 vars in 967 bytes} [Tue Sep 13 14:21:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:04.625715 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a5209-00d7-4c24-b14b-c35d268455e6 service swift] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:04.636466 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a5209-00d7-4c24-b14b-c35d268455e6 service swift] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:04.642202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855674ec-42d4-466c-9ae4-3a65ae625773 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c27e930f604bd38634ca08e56cf8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:04.642791 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855674ec-42d4-466c-9ae4-3a65ae625773 service swift] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:04.643068 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855674ec-42d4-466c-9ae4-3a65ae625773 service swift] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:04.643506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855674ec-42d4-466c-9ae4-3a65ae625773 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:04.653139 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855674ec-42d4-466c-9ae4-3a65ae625773 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:04.655506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855674ec-42d4-466c-9ae4-3a65ae625773 service swift] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:04.663418 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1240/2477] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Sep 13 14:21:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 14:21:14.587461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:14.660204 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=6 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:15.039318 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c8c3d-0e44-4fd4-b501-9f4b9b7f4538 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:15.048793 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c8c3d-0e44-4fd4-b501-9f4b9b7f4538 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:15.052432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede32f9-e699-4d2b-a4d3-74825a50a678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:15.053018 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede32f9-e699-4d2b-a4d3-74825a50a678 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:15.053369 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede32f9-e699-4d2b-a4d3-74825a50a678 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:15.053644 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede32f9-e699-4d2b-a4d3-74825a50a678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:15.055357 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1ede32f9-e699-4d2b-a4d3-74825a50a678 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:15.138891 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede32f9-e699-4d2b-a4d3-74825a50a678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:15.140264 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede32f9-e699-4d2b-a4d3-74825a50a678 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:15.159749 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1238/2478] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:21:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:21:18.247120 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855674ec-42d4-466c-9ae4-3a65ae625773 service swift] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:18.248838 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-855674ec-42d4-466c-9ae4-3a65ae625773 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:18.264019 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855674ec-42d4-466c-9ae4-3a65ae625773 service swift] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:18.268655 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef80188-f61b-4cfa-8f50-5cc9d6ccff2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:18.269311 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef80188-f61b-4cfa-8f50-5cc9d6ccff2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:18.269609 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef80188-f61b-4cfa-8f50-5cc9d6ccff2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:18.269890 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef80188-f61b-4cfa-8f50-5cc9d6ccff2d admin admin] PATH_INFO: `/v3/users/c8289ecbf04143b1a136f876b1467c67` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:18.271014 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef80188-f61b-4cfa-8f50-5cc9d6ccff2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8289ecbf04143b1a136f876b1467c67)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:18.272965 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef80188-f61b-4cfa-8f50-5cc9d6ccff2d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:18.324162 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7ef80188-f61b-4cfa-8f50-5cc9d6ccff2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8289ecbf04143b1a136f876b1467c67'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:18.332296 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7ef80188-f61b-4cfa-8f50-5cc9d6ccff2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8289ecbf04143b1a136f876b1467c67'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:18.345834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7ef80188-f61b-4cfa-8f50-5cc9d6ccff2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8289ecbf04143b1a136f876b1467c67'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:18.346662 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7ef80188-f61b-4cfa-8f50-5cc9d6ccff2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8289ecbf04143b1a136f876b1467c67'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:18.354303 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7ef80188-f61b-4cfa-8f50-5cc9d6ccff2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8289ecbf04143b1a136f876b1467c67'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:18.361194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1241/2479] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:21:18 2022] DELETE /identity/v3/users/c8289ecbf04143b1a136f876b1467c67 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:18.533255 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede32f9-e699-4d2b-a4d3-74825a50a678 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:18.543355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede32f9-e699-4d2b-a4d3-74825a50a678 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:18.599974 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ea424-315e-4e25-835b-cf9a50618cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:18.600603 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ea424-315e-4e25-835b-cf9a50618cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:18.600884 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ea424-315e-4e25-835b-cf9a50618cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:18.601199 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ea424-315e-4e25-835b-cf9a50618cf3 admin admin] PATH_INFO: `/v3/projects/335a1a885bfb4f5695e5b0e47777856f` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:18.602349 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ea424-315e-4e25-835b-cf9a50618cf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=335a1a885bfb4f5695e5b0e47777856f)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:18.604255 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ea424-315e-4e25-835b-cf9a50618cf3 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:18.651820 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d09ea424-315e-4e25-835b-cf9a50618cf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '335a1a885bfb4f5695e5b0e47777856f', 'request_id': 'req-d09ea424-315e-4e25-835b-cf9a50618cf3'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:18.658594 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d09ea424-315e-4e25-835b-cf9a50618cf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '335a1a885bfb4f5695e5b0e47777856f', 'request_id': 'req-d09ea424-315e-4e25-835b-cf9a50618cf3'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:18.664346 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d09ea424-315e-4e25-835b-cf9a50618cf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '335a1a885bfb4f5695e5b0e47777856f', 'request_id': 'req-d09ea424-315e-4e25-835b-cf9a50618cf3'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:18.666236 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:18.677747 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d09ea424-315e-4e25-835b-cf9a50618cf3 admin admin] The token cache is being invalidate because project 335a1a885bfb4f5695e5b0e47777856f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:21:18.678033 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d09ea424-315e-4e25-835b-cf9a50618cf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:18.678660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d09ea424-315e-4e25-835b-cf9a50618cf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:18.680164 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1239/2480] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:21:18 2022] DELETE /identity/v3/projects/335a1a885bfb4f5695e5b0e47777856f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:18.685031 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf088d9e-fb5d-4986-85f0-0388e8f41d02 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:18.685351 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf088d9e-fb5d-4986-85f0-0388e8f41d02 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:18.685623 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf088d9e-fb5d-4986-85f0-0388e8f41d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:18.732960 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-cf088d9e-fb5d-4986-85f0-0388e8f41d02 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:18.734210 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cf088d9e-fb5d-4986-85f0-0388e8f41d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:18.795650 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1242/2481] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:18.803318 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d917789-74b7-4043-b76b-0bfc4dad3cd3 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:18.803602 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d917789-74b7-4043-b76b-0bfc4dad3cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:18.803897 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d917789-74b7-4043-b76b-0bfc4dad3cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:18.823908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-5d917789-74b7-4043-b76b-0bfc4dad3cd3 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:18.825111 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5d917789-74b7-4043-b76b-0bfc4dad3cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:18.833665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1240/2482] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:18.837765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf088d9e-fb5d-4986-85f0-0388e8f41d02 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:18.847374 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf088d9e-fb5d-4986-85f0-0388e8f41d02 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:18.851891 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c48fc3-90a7-4046-9643-85df56bdd5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:18.852481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c48fc3-90a7-4046-9643-85df56bdd5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:18.852753 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c48fc3-90a7-4046-9643-85df56bdd5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:18.853027 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c48fc3-90a7-4046-9643-85df56bdd5b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:18.853679 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c48fc3-90a7-4046-9643-85df56bdd5b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:21:18.853975 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c48fc3-90a7-4046-9643-85df56bdd5b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:18.855552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c48fc3-90a7-4046-9643-85df56bdd5b8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:18.867090 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1243/2483] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:21:18.871114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d917789-74b7-4043-b76b-0bfc4dad3cd3 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:18.880838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d917789-74b7-4043-b76b-0bfc4dad3cd3 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:18.886059 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb30947-3e8e-4b7d-b833-53688ed597fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:18.886927 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb30947-3e8e-4b7d-b833-53688ed597fa admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:18.887084 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb30947-3e8e-4b7d-b833-53688ed597fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:18.887382 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb30947-3e8e-4b7d-b833-53688ed597fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:18.888045 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb30947-3e8e-4b7d-b833-53688ed597fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:18.890065 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb30947-3e8e-4b7d-b833-53688ed597fa admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:18.918530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1241/2484] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:21:18 2022] POST /identity/v3/projects => generated 401 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:21:18.923193 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c48fc3-90a7-4046-9643-85df56bdd5b8 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:18.934692 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c48fc3-90a7-4046-9643-85df56bdd5b8 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:18.968114 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:19.002351 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a08f3-9a27-494d-9967-45104a8fbb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:19.002969 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a08f3-9a27-494d-9967-45104a8fbb64 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:19.003243 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a08f3-9a27-494d-9967-45104a8fbb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:19.003560 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a08f3-9a27-494d-9967-45104a8fbb64 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:19.004137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a08f3-9a27-494d-9967-45104a8fbb64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:19.006079 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a08f3-9a27-494d-9967-45104a8fbb64 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:19.027470 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1244/2485] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:21:18 2022] POST /identity/v3/users => generated 301 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:21:19.031918 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb30947-3e8e-4b7d-b833-53688ed597fa admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:19.042009 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb30947-3e8e-4b7d-b833-53688ed597fa admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:19.047213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829534a-8c01-4841-9b84-50e0e4e8d70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:19.047745 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829534a-8c01-4841-9b84-50e0e4e8d70a admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:19.048020 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829534a-8c01-4841-9b84-50e0e4e8d70a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:19.048287 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829534a-8c01-4841-9b84-50e0e4e8d70a admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:19.048953 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829534a-8c01-4841-9b84-50e0e4e8d70a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:19.050704 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829534a-8c01-4841-9b84-50e0e4e8d70a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:19.060720 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1242/2486] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:21:19.065316 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a08f3-9a27-494d-9967-45104a8fbb64 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:19.075146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a08f3-9a27-494d-9967-45104a8fbb64 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:19.079700 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1de0c-7fd6-4aee-92a6-6218233a03e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:19.080283 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1de0c-7fd6-4aee-92a6-6218233a03e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:19.080558 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1de0c-7fd6-4aee-92a6-6218233a03e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:19.080826 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1de0c-7fd6-4aee-92a6-6218233a03e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:19.081528 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1de0c-7fd6-4aee-92a6-6218233a03e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:19.083102 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1de0c-7fd6-4aee-92a6-6218233a03e4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:19.092880 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1245/2487] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:21:19.096861 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829534a-8c01-4841-9b84-50e0e4e8d70a admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:19.106921 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829534a-8c01-4841-9b84-50e0e4e8d70a admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:19.112218 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae5086-3ba4-4872-9b53-a8a23f644f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:19.112853 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae5086-3ba4-4872-9b53-a8a23f644f30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:19.113155 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae5086-3ba4-4872-9b53-a8a23f644f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:19.113427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae5086-3ba4-4872-9b53-a8a23f644f30 admin admin] PATH_INFO: `/v3/projects/2df5546b3f274200aa86aea6fdba16ac/users/932f504bf9b742dda0f27cad9f510160/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:19.128533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae5086-3ba4-4872-9b53-a8a23f644f30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2df5546b3f274200aa86aea6fdba16ac, user_id=932f504bf9b742dda0f27cad9f510160, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:19.131215 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae5086-3ba4-4872-9b53-a8a23f644f30 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:19.143959 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1243/2488] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:21:19 2022] PUT /identity/v3/projects/2df5546b3f274200aa86aea6fdba16ac/users/932f504bf9b742dda0f27cad9f510160/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:19.149079 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16482bc4-93f6-445d-8041-db6e33fdd6e8 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:19.149391 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16482bc4-93f6-445d-8041-db6e33fdd6e8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:19.149694 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16482bc4-93f6-445d-8041-db6e33fdd6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:19.168719 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-16482bc4-93f6-445d-8041-db6e33fdd6e8 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:19.169954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-16482bc4-93f6-445d-8041-db6e33fdd6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:19.227763 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1246/2489] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:19.237886 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae5086-3ba4-4872-9b53-a8a23f644f30 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:19.239548 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4aae5086-3ba4-4872-9b53-a8a23f644f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:19.304210 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae5086-3ba4-4872-9b53-a8a23f644f30 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:19.307786 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38b21e-19eb-4ae9-8d40-47254eece089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:19.308385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38b21e-19eb-4ae9-8d40-47254eece089 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:19.308661 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38b21e-19eb-4ae9-8d40-47254eece089 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:19.308933 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38b21e-19eb-4ae9-8d40-47254eece089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:19.318431 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38b21e-19eb-4ae9-8d40-47254eece089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:19.319858 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38b21e-19eb-4ae9-8d40-47254eece089 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:19.329186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1244/2490] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:21:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:21:19.944091 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2a783-be09-4544-98b1-cdc0c4be6b3e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:19.944632 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2a783-be09-4544-98b1-cdc0c4be6b3e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:19.944730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2a783-be09-4544-98b1-cdc0c4be6b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:19.975008 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-26f2a783-be09-4544-98b1-cdc0c4be6b3e None None] MFA Rules not processed for user `932f504bf9b742dda0f27cad9f510160`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:19.976550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-26f2a783-be09-4544-98b1-cdc0c4be6b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:20.167284 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1247/2491] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:19 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:20.172593 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38b21e-19eb-4ae9-8d40-47254eece089 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:20.182451 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38b21e-19eb-4ae9-8d40-47254eece089 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:20.187041 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fb431-5d2b-4fce-92ca-bae35351d411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:20.187643 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fb431-5d2b-4fce-92ca-bae35351d411 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:20.187916 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fb431-5d2b-4fce-92ca-bae35351d411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:20.188183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fb431-5d2b-4fce-92ca-bae35351d411 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:20.188812 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631fb431-5d2b-4fce-92ca-bae35351d411 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:20.190750 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631fb431-5d2b-4fce-92ca-bae35351d411 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:20.219007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1245/2492] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:21:20 2022] POST /identity/v3/projects => generated 403 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:21:20.222929 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2a783-be09-4544-98b1-cdc0c4be6b3e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:20.233398 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2a783-be09-4544-98b1-cdc0c4be6b3e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:20.276396 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:20.291251 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f212b96-3a8b-42b8-b887-143b335d96af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:20.291850 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f212b96-3a8b-42b8-b887-143b335d96af admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:20.292130 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f212b96-3a8b-42b8-b887-143b335d96af admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:20.292402 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f212b96-3a8b-42b8-b887-143b335d96af admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:20.293060 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f212b96-3a8b-42b8-b887-143b335d96af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:20.295015 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f212b96-3a8b-42b8-b887-143b335d96af admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:20.316860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1248/2493] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:21:20 2022] POST /identity/v3/users => generated 308 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:21:20.321084 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fb431-5d2b-4fce-92ca-bae35351d411 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:20.331505 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fb431-5d2b-4fce-92ca-bae35351d411 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:20.336136 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073ad2b-a827-48e6-8b23-e4529ff9e63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:20.336729 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073ad2b-a827-48e6-8b23-e4529ff9e63c admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:20.337010 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073ad2b-a827-48e6-8b23-e4529ff9e63c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:20.337318 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073ad2b-a827-48e6-8b23-e4529ff9e63c admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:20.337957 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4073ad2b-a827-48e6-8b23-e4529ff9e63c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:20.339564 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4073ad2b-a827-48e6-8b23-e4529ff9e63c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:20.350723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1246/2494] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:21:20.354782 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f212b96-3a8b-42b8-b887-143b335d96af admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:20.365414 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f212b96-3a8b-42b8-b887-143b335d96af admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:20.370098 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb16249-927e-40f2-a7c2-642771d0f9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:20.370737 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb16249-927e-40f2-a7c2-642771d0f9a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:20.371042 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb16249-927e-40f2-a7c2-642771d0f9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:20.371315 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb16249-927e-40f2-a7c2-642771d0f9a6 admin admin] PATH_INFO: `/v3/projects/83524b55dca74105a5a0f204950c6a30/users/06895304705d435c9e49df109df15f10/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:20.385689 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb16249-927e-40f2-a7c2-642771d0f9a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83524b55dca74105a5a0f204950c6a30, user_id=06895304705d435c9e49df109df15f10, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:20.388273 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb16249-927e-40f2-a7c2-642771d0f9a6 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:20.401037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1249/2495] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:21:20 2022] PUT /identity/v3/projects/83524b55dca74105a5a0f204950c6a30/users/06895304705d435c9e49df109df15f10/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:20.405354 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073ad2b-a827-48e6-8b23-e4529ff9e63c admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:20.416397 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073ad2b-a827-48e6-8b23-e4529ff9e63c admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:20.473502 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ef72f-2c2b-482b-892f-6f51c728e4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:20.474134 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ef72f-2c2b-482b-892f-6f51c728e4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:20.474411 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ef72f-2c2b-482b-892f-6f51c728e4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:20.474677 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ef72f-2c2b-482b-892f-6f51c728e4e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:20.475311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ef72f-2c2b-482b-892f-6f51c728e4e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:20.476896 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ef72f-2c2b-482b-892f-6f51c728e4e4 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:20.478909 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:20.487613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1247/2496] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:21:20.491792 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb16249-927e-40f2-a7c2-642771d0f9a6 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:20.501863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb16249-927e-40f2-a7c2-642771d0f9a6 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:20.506632 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7eb91-453c-496e-be53-7a000118f715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:20.507275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7eb91-453c-496e-be53-7a000118f715 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:20.507551 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7eb91-453c-496e-be53-7a000118f715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:20.507819 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7eb91-453c-496e-be53-7a000118f715 admin admin] PATH_INFO: `/v3/projects/83524b55dca74105a5a0f204950c6a30/users/06895304705d435c9e49df109df15f10/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:20.509743 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7eb91-453c-496e-be53-7a000118f715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83524b55dca74105a5a0f204950c6a30, user_id=06895304705d435c9e49df109df15f10, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:20.512499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7eb91-453c-496e-be53-7a000118f715 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:20.523085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1250/2497] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:21:20 2022] PUT /identity/v3/projects/83524b55dca74105a5a0f204950c6a30/users/06895304705d435c9e49df109df15f10/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:21.150281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52a863-8de4-47c6-8d96-5888b570a9bc None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:21.150572 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52a863-8de4-47c6-8d96-5888b570a9bc None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:21.150850 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52a863-8de4-47c6-8d96-5888b570a9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:21.180379 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-0b52a863-8de4-47c6-8d96-5888b570a9bc None None] MFA Rules not processed for user `06895304705d435c9e49df109df15f10`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:21.181549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0b52a863-8de4-47c6-8d96-5888b570a9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:21.251945 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1248/2498] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:21 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:22.272893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7eb91-453c-496e-be53-7a000118f715 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:22.338758 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7eb91-453c-496e-be53-7a000118f715 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:22.343623 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5714cf-ffac-4fa2-845b-4e37e34542f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:22.344244 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5714cf-ffac-4fa2-845b-4e37e34542f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:22.344523 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5714cf-ffac-4fa2-845b-4e37e34542f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:22.344794 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5714cf-ffac-4fa2-845b-4e37e34542f5 admin admin] PATH_INFO: `/v3/users/932f504bf9b742dda0f27cad9f510160` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:22.346070 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5714cf-ffac-4fa2-845b-4e37e34542f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=932f504bf9b742dda0f27cad9f510160)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:22.347991 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5714cf-ffac-4fa2-845b-4e37e34542f5 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:22.396712 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bc5714cf-ffac-4fa2-845b-4e37e34542f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '932f504bf9b742dda0f27cad9f510160'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:22.404075 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bc5714cf-ffac-4fa2-845b-4e37e34542f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '932f504bf9b742dda0f27cad9f510160'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:22.417623 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bc5714cf-ffac-4fa2-845b-4e37e34542f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '932f504bf9b742dda0f27cad9f510160'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:22.418271 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bc5714cf-ffac-4fa2-845b-4e37e34542f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '932f504bf9b742dda0f27cad9f510160'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:22.425200 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bc5714cf-ffac-4fa2-845b-4e37e34542f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '932f504bf9b742dda0f27cad9f510160'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:22.431133 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1251/2499] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:21:22 2022] DELETE /identity/v3/users/932f504bf9b742dda0f27cad9f510160 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:22.601342 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52a863-8de4-47c6-8d96-5888b570a9bc None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:22.611887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52a863-8de4-47c6-8d96-5888b570a9bc None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:22.679904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229851a6-b81f-4088-87f7-2f83d00e611e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:22.680530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229851a6-b81f-4088-87f7-2f83d00e611e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:22.680810 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229851a6-b81f-4088-87f7-2f83d00e611e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:22.681083 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229851a6-b81f-4088-87f7-2f83d00e611e admin admin] PATH_INFO: `/v3/projects/2df5546b3f274200aa86aea6fdba16ac` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:22.682228 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229851a6-b81f-4088-87f7-2f83d00e611e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2df5546b3f274200aa86aea6fdba16ac)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:22.684133 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229851a6-b81f-4088-87f7-2f83d00e611e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:22.729005 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-229851a6-b81f-4088-87f7-2f83d00e611e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2df5546b3f274200aa86aea6fdba16ac', 'request_id': 'req-229851a6-b81f-4088-87f7-2f83d00e611e'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:22.736652 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-229851a6-b81f-4088-87f7-2f83d00e611e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2df5546b3f274200aa86aea6fdba16ac', 'request_id': 'req-229851a6-b81f-4088-87f7-2f83d00e611e'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:22.742291 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-229851a6-b81f-4088-87f7-2f83d00e611e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2df5546b3f274200aa86aea6fdba16ac', 'request_id': 'req-229851a6-b81f-4088-87f7-2f83d00e611e'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:22.753765 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-229851a6-b81f-4088-87f7-2f83d00e611e admin admin] The token cache is being invalidate because project 2df5546b3f274200aa86aea6fdba16ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:21:22.754049 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-229851a6-b81f-4088-87f7-2f83d00e611e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:22.754672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-229851a6-b81f-4088-87f7-2f83d00e611e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:22.756324 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1249/2500] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:21:22 2022] DELETE /identity/v3/projects/2df5546b3f274200aa86aea6fdba16ac => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:22.760355 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5714cf-ffac-4fa2-845b-4e37e34542f5 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:22.761818 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-bc5714cf-ffac-4fa2-845b-4e37e34542f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:22.774716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5714cf-ffac-4fa2-845b-4e37e34542f5 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:22.787232 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:22.834426 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad094c5c-b7fd-4a7b-b643-597345314693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:22.835057 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad094c5c-b7fd-4a7b-b643-597345314693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:22.835337 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad094c5c-b7fd-4a7b-b643-597345314693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:22.835608 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad094c5c-b7fd-4a7b-b643-597345314693 admin admin] PATH_INFO: `/v3/users/06895304705d435c9e49df109df15f10` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:22.836734 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad094c5c-b7fd-4a7b-b643-597345314693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06895304705d435c9e49df109df15f10)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:22.838709 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad094c5c-b7fd-4a7b-b643-597345314693 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:22.883940 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ad094c5c-b7fd-4a7b-b643-597345314693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06895304705d435c9e49df109df15f10'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:22.890508 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ad094c5c-b7fd-4a7b-b643-597345314693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06895304705d435c9e49df109df15f10'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:22.902256 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ad094c5c-b7fd-4a7b-b643-597345314693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06895304705d435c9e49df109df15f10'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:22.902871 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ad094c5c-b7fd-4a7b-b643-597345314693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06895304705d435c9e49df109df15f10'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:22.909900 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ad094c5c-b7fd-4a7b-b643-597345314693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06895304705d435c9e49df109df15f10'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:22.915597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1252/2501] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:21:22 2022] DELETE /identity/v3/users/06895304705d435c9e49df109df15f10 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:23.094599 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229851a6-b81f-4088-87f7-2f83d00e611e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:23.096218 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-229851a6-b81f-4088-87f7-2f83d00e611e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:23.109804 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229851a6-b81f-4088-87f7-2f83d00e611e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:23.118973 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:23.169142 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25f2e6-4e19-4456-a0fb-329695e38675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:23.169762 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25f2e6-4e19-4456-a0fb-329695e38675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:23.170035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25f2e6-4e19-4456-a0fb-329695e38675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:23.170300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25f2e6-4e19-4456-a0fb-329695e38675 admin admin] PATH_INFO: `/v3/projects/83524b55dca74105a5a0f204950c6a30` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:23.172283 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25f2e6-4e19-4456-a0fb-329695e38675 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83524b55dca74105a5a0f204950c6a30)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:23.174246 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25f2e6-4e19-4456-a0fb-329695e38675 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:23.220297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-af25f2e6-4e19-4456-a0fb-329695e38675 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83524b55dca74105a5a0f204950c6a30', 'request_id': 'req-af25f2e6-4e19-4456-a0fb-329695e38675'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:23.227574 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-af25f2e6-4e19-4456-a0fb-329695e38675 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83524b55dca74105a5a0f204950c6a30', 'request_id': 'req-af25f2e6-4e19-4456-a0fb-329695e38675'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:23.233261 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-af25f2e6-4e19-4456-a0fb-329695e38675 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83524b55dca74105a5a0f204950c6a30', 'request_id': 'req-af25f2e6-4e19-4456-a0fb-329695e38675'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:23.245405 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-af25f2e6-4e19-4456-a0fb-329695e38675 admin admin] The token cache is being invalidate because project 83524b55dca74105a5a0f204950c6a30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:21:23.245632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-af25f2e6-4e19-4456-a0fb-329695e38675 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:23.246262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-af25f2e6-4e19-4456-a0fb-329695e38675 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:23.247740 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1250/2502] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:21:23 2022] DELETE /identity/v3/projects/83524b55dca74105a5a0f204950c6a30 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:23.252648 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252b791-8ee0-4d66-9b9e-7d1c055711ca None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:23.252935 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252b791-8ee0-4d66-9b9e-7d1c055711ca None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:23.253247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252b791-8ee0-4d66-9b9e-7d1c055711ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:23.272596 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-1252b791-8ee0-4d66-9b9e-7d1c055711ca None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:23.273821 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1252b791-8ee0-4d66-9b9e-7d1c055711ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:23.333856 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1253/2503] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:23.341692 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476a7b1-0898-48d8-a9a5-e25754a8a2d7 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:23.341976 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476a7b1-0898-48d8-a9a5-e25754a8a2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:23.342252 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476a7b1-0898-48d8-a9a5-e25754a8a2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:23.361833 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-d476a7b1-0898-48d8-a9a5-e25754a8a2d7 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:23.363061 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d476a7b1-0898-48d8-a9a5-e25754a8a2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:23.371150 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1251/2504] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:21:23.375773 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252b791-8ee0-4d66-9b9e-7d1c055711ca None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:23.385363 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252b791-8ee0-4d66-9b9e-7d1c055711ca None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:23.389862 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4675b0-47ee-4292-a40f-2aa45d8c248b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:23.391084 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4675b0-47ee-4292-a40f-2aa45d8c248b admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:23.391355 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4675b0-47ee-4292-a40f-2aa45d8c248b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:23.391615 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4675b0-47ee-4292-a40f-2aa45d8c248b admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:23.392241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4675b0-47ee-4292-a40f-2aa45d8c248b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:21:23.392533 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4675b0-47ee-4292-a40f-2aa45d8c248b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:23.394172 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4675b0-47ee-4292-a40f-2aa45d8c248b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:23.405695 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1254/2505] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:21:23.409787 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476a7b1-0898-48d8-a9a5-e25754a8a2d7 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:23.419573 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476a7b1-0898-48d8-a9a5-e25754a8a2d7 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:23.424900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbbb46-7a5e-4bdd-92bb-a61083017efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:23.425523 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbbb46-7a5e-4bdd-92bb-a61083017efe admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:23.425795 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbbb46-7a5e-4bdd-92bb-a61083017efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:23.426058 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbbb46-7a5e-4bdd-92bb-a61083017efe admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:23.426689 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbbb46-7a5e-4bdd-92bb-a61083017efe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:23.428562 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbbb46-7a5e-4bdd-92bb-a61083017efe admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:23.455729 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1252/2506] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:21:23 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:21:23.460025 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4675b0-47ee-4292-a40f-2aa45d8c248b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:23.469868 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4675b0-47ee-4292-a40f-2aa45d8c248b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:23.490593 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:23.528946 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65925e6d-c345-44ab-9d23-92b742231783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:23.529513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65925e6d-c345-44ab-9d23-92b742231783 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:23.530044 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65925e6d-c345-44ab-9d23-92b742231783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:23.530313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65925e6d-c345-44ab-9d23-92b742231783 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:23.530923 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65925e6d-c345-44ab-9d23-92b742231783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:23.532835 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65925e6d-c345-44ab-9d23-92b742231783 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:23.554624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1255/2507] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:21:23 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:21:23.558773 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbbb46-7a5e-4bdd-92bb-a61083017efe admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:23.569707 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbbb46-7a5e-4bdd-92bb-a61083017efe admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:23.574291 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec112839-456a-4641-b5db-71ed6cb45ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:23.574894 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec112839-456a-4641-b5db-71ed6cb45ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:23.575152 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec112839-456a-4641-b5db-71ed6cb45ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:23.575423 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec112839-456a-4641-b5db-71ed6cb45ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:23.576053 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec112839-456a-4641-b5db-71ed6cb45ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:23.577731 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec112839-456a-4641-b5db-71ed6cb45ac6 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:23.587468 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1253/2508] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:21:23.591225 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65925e6d-c345-44ab-9d23-92b742231783 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:23.600822 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65925e6d-c345-44ab-9d23-92b742231783 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:23.605581 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed9067-8391-4b58-97cf-d948274dffc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:23.606190 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed9067-8391-4b58-97cf-d948274dffc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:23.606463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed9067-8391-4b58-97cf-d948274dffc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:23.606750 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed9067-8391-4b58-97cf-d948274dffc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:23.607378 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed9067-8391-4b58-97cf-d948274dffc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:23.609511 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed9067-8391-4b58-97cf-d948274dffc7 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:23.619725 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1256/2509] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:21:23.624442 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec112839-456a-4641-b5db-71ed6cb45ac6 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:23.637260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec112839-456a-4641-b5db-71ed6cb45ac6 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:23.641916 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66735a8-d5e5-4c96-8529-82b6f38395df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:23.642671 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66735a8-d5e5-4c96-8529-82b6f38395df admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:23.642950 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66735a8-d5e5-4c96-8529-82b6f38395df admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:23.643218 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66735a8-d5e5-4c96-8529-82b6f38395df admin admin] PATH_INFO: `/v3/projects/c158c0d71cdc4241839a208e0a03571a/users/84f9d8b16c4d4da381220a8d0c130409/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:23.657936 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66735a8-d5e5-4c96-8529-82b6f38395df admin admin] RBAC: Authorizing `identity:create_grant(project_id=c158c0d71cdc4241839a208e0a03571a, user_id=84f9d8b16c4d4da381220a8d0c130409, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:23.660577 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66735a8-d5e5-4c96-8529-82b6f38395df admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:23.674120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1254/2510] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:21:23 2022] PUT /identity/v3/projects/c158c0d71cdc4241839a208e0a03571a/users/84f9d8b16c4d4da381220a8d0c130409/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:23.684369 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df16ae-b8ae-432a-9e8c-82ed2fafba4a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:23.684651 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df16ae-b8ae-432a-9e8c-82ed2fafba4a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:23.684920 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df16ae-b8ae-432a-9e8c-82ed2fafba4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:23.712119 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-91df16ae-b8ae-432a-9e8c-82ed2fafba4a None None] MFA Rules not processed for user `84f9d8b16c4d4da381220a8d0c130409`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:23.713350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-91df16ae-b8ae-432a-9e8c-82ed2fafba4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:23.774718 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1257/2511] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:21:23.779177 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66735a8-d5e5-4c96-8529-82b6f38395df admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:23.821894 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:23.842174 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66735a8-d5e5-4c96-8529-82b6f38395df admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:23.847388 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391fe5b-53f5-4715-8871-f9bbe3b144f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:23.847985 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391fe5b-53f5-4715-8871-f9bbe3b144f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:23.848263 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391fe5b-53f5-4715-8871-f9bbe3b144f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:23.848535 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391fe5b-53f5-4715-8871-f9bbe3b144f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:23.849202 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391fe5b-53f5-4715-8871-f9bbe3b144f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:23.851112 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391fe5b-53f5-4715-8871-f9bbe3b144f6 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:23.877751 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1255/2512] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:21:23 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:21:23.881817 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df16ae-b8ae-432a-9e8c-82ed2fafba4a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:23.892247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df16ae-b8ae-432a-9e8c-82ed2fafba4a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:23.947755 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6fe24-c0f2-4071-8a5d-6db8a2dd550d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:23.948404 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6fe24-c0f2-4071-8a5d-6db8a2dd550d admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:23.948689 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6fe24-c0f2-4071-8a5d-6db8a2dd550d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:23.948960 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6fe24-c0f2-4071-8a5d-6db8a2dd550d admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:23.949609 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6fe24-c0f2-4071-8a5d-6db8a2dd550d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:23.951530 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6fe24-c0f2-4071-8a5d-6db8a2dd550d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:23.974151 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1258/2513] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:21:23 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:21:23.978298 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391fe5b-53f5-4715-8871-f9bbe3b144f6 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:23.989184 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391fe5b-53f5-4715-8871-f9bbe3b144f6 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:23.993908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41a82e-1ac3-4c59-b29e-d4ea345c6e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:23.994491 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41a82e-1ac3-4c59-b29e-d4ea345c6e8b admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:23.994770 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41a82e-1ac3-4c59-b29e-d4ea345c6e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:23.995035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41a82e-1ac3-4c59-b29e-d4ea345c6e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:23.995665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41a82e-1ac3-4c59-b29e-d4ea345c6e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:23.997411 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41a82e-1ac3-4c59-b29e-d4ea345c6e8b admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:24.008370 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1256/2514] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:21:24.012508 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6fe24-c0f2-4071-8a5d-6db8a2dd550d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:24.025477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6fe24-c0f2-4071-8a5d-6db8a2dd550d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:24.030464 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdcf2d-c51c-44ab-8e04-11a2aee0f56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:24.031073 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdcf2d-c51c-44ab-8e04-11a2aee0f56f admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:24.031423 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdcf2d-c51c-44ab-8e04-11a2aee0f56f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:24.031683 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdcf2d-c51c-44ab-8e04-11a2aee0f56f admin admin] PATH_INFO: `/v3/projects/320502002b5049059bbba5e2faf450ae/users/2b600a17647b44ebabbca60d492dc041/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:24.046163 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdcf2d-c51c-44ab-8e04-11a2aee0f56f admin admin] RBAC: Authorizing `identity:create_grant(project_id=320502002b5049059bbba5e2faf450ae, user_id=2b600a17647b44ebabbca60d492dc041, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:24.050249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdcf2d-c51c-44ab-8e04-11a2aee0f56f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:24.059269 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:24.066849 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1259/2515] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:21:24 2022] PUT /identity/v3/projects/320502002b5049059bbba5e2faf450ae/users/2b600a17647b44ebabbca60d492dc041/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:21:24.071055 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41a82e-1ac3-4c59-b29e-d4ea345c6e8b admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:24.083057 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41a82e-1ac3-4c59-b29e-d4ea345c6e8b admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:24.141931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7bdec-611c-4c64-92e3-5c564ecd382b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:24.142544 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7bdec-611c-4c64-92e3-5c564ecd382b admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:24.142823 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7bdec-611c-4c64-92e3-5c564ecd382b admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:24.143115 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7bdec-611c-4c64-92e3-5c564ecd382b admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:24.143807 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7bdec-611c-4c64-92e3-5c564ecd382b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:24.145459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7bdec-611c-4c64-92e3-5c564ecd382b admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:24.155450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1257/2516] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:21:24.160164 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdcf2d-c51c-44ab-8e04-11a2aee0f56f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:24.170436 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdcf2d-c51c-44ab-8e04-11a2aee0f56f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:24.175746 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6029a-cd26-4541-81dc-a896801f1bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:24.176414 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6029a-cd26-4541-81dc-a896801f1bb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:24.176692 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6029a-cd26-4541-81dc-a896801f1bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:24.176964 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6029a-cd26-4541-81dc-a896801f1bb5 admin admin] PATH_INFO: `/v3/projects/320502002b5049059bbba5e2faf450ae/users/2b600a17647b44ebabbca60d492dc041/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:24.178919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6029a-cd26-4541-81dc-a896801f1bb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=320502002b5049059bbba5e2faf450ae, user_id=2b600a17647b44ebabbca60d492dc041, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:24.181661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6029a-cd26-4541-81dc-a896801f1bb5 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:24.191764 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1260/2517] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:21:24 2022] PUT /identity/v3/projects/320502002b5049059bbba5e2faf450ae/users/2b600a17647b44ebabbca60d492dc041/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:24.203547 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d112eb6-7b61-4e29-9d22-3b9801ef49bb None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:24.203854 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d112eb6-7b61-4e29-9d22-3b9801ef49bb None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:24.204137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d112eb6-7b61-4e29-9d22-3b9801ef49bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:24.231922 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-0d112eb6-7b61-4e29-9d22-3b9801ef49bb None None] MFA Rules not processed for user `2b600a17647b44ebabbca60d492dc041`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:24.233134 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0d112eb6-7b61-4e29-9d22-3b9801ef49bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:24.302033 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1258/2518] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:24 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:24.313051 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6029a-cd26-4541-81dc-a896801f1bb5 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:24.314777 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-75d6029a-cd26-4541-81dc-a896801f1bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:24.396880 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6029a-cd26-4541-81dc-a896801f1bb5 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:24.400596 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351b35f-fc4a-48da-9fe3-09a9fc74849e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:24.401229 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351b35f-fc4a-48da-9fe3-09a9fc74849e service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:24.401509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351b35f-fc4a-48da-9fe3-09a9fc74849e service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:24.401779 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351b35f-fc4a-48da-9fe3-09a9fc74849e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:24.411394 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351b35f-fc4a-48da-9fe3-09a9fc74849e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:24.412822 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351b35f-fc4a-48da-9fe3-09a9fc74849e service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:24.422270 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1261/2519] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:21:24 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:21:24.495531 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d112eb6-7b61-4e29-9d22-3b9801ef49bb None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:24.504993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d112eb6-7b61-4e29-9d22-3b9801ef49bb None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:24.508541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6315a4-dd44-4ebe-8cde-c68f050dcfa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:24.509153 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6315a4-dd44-4ebe-8cde-c68f050dcfa5 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:24.509431 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6315a4-dd44-4ebe-8cde-c68f050dcfa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:24.509697 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6315a4-dd44-4ebe-8cde-c68f050dcfa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:24.542962 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:24.568017 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6315a4-dd44-4ebe-8cde-c68f050dcfa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:24.569384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6315a4-dd44-4ebe-8cde-c68f050dcfa5 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:24.578787 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1259/2520] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:21:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:21:31.333579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351b35f-fc4a-48da-9fe3-09a9fc74849e service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:31.397140 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351b35f-fc4a-48da-9fe3-09a9fc74849e service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:31.401647 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5672981-e24a-41a7-b81c-16006bad0e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:31.402277 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5672981-e24a-41a7-b81c-16006bad0e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:31.402556 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5672981-e24a-41a7-b81c-16006bad0e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:31.402830 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5672981-e24a-41a7-b81c-16006bad0e73 admin admin] PATH_INFO: `/v3/users/84f9d8b16c4d4da381220a8d0c130409` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:31.403935 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5672981-e24a-41a7-b81c-16006bad0e73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84f9d8b16c4d4da381220a8d0c130409)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:31.406159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5672981-e24a-41a7-b81c-16006bad0e73 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:31.452135 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f5672981-e24a-41a7-b81c-16006bad0e73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84f9d8b16c4d4da381220a8d0c130409'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:31.459621 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f5672981-e24a-41a7-b81c-16006bad0e73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84f9d8b16c4d4da381220a8d0c130409'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:31.471230 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:31.472532 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f5672981-e24a-41a7-b81c-16006bad0e73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84f9d8b16c4d4da381220a8d0c130409'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:31.473275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f5672981-e24a-41a7-b81c-16006bad0e73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84f9d8b16c4d4da381220a8d0c130409'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:31.482085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f5672981-e24a-41a7-b81c-16006bad0e73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84f9d8b16c4d4da381220a8d0c130409'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:31.488477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1262/2521] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:21:31 2022] DELETE /identity/v3/users/84f9d8b16c4d4da381220a8d0c130409 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:31.492938 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245b109-248a-4847-86dc-a71827709ed2 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:31.493416 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245b109-248a-4847-86dc-a71827709ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:31.493574 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245b109-248a-4847-86dc-a71827709ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:31.512434 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-4245b109-248a-4847-86dc-a71827709ed2 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:31.513657 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4245b109-248a-4847-86dc-a71827709ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:31.572743 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1260/2522] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:31.582445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5672981-e24a-41a7-b81c-16006bad0e73 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:31.583858 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f5672981-e24a-41a7-b81c-16006bad0e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:31.640960 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5672981-e24a-41a7-b81c-16006bad0e73 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:31.645077 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b6193-c66c-4cf9-a02b-4dee40985a8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:31.645704 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b6193-c66c-4cf9-a02b-4dee40985a8e service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:31.645977 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b6193-c66c-4cf9-a02b-4dee40985a8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:31.646241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b6193-c66c-4cf9-a02b-4dee40985a8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:31.655476 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b6193-c66c-4cf9-a02b-4dee40985a8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:31.656910 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b6193-c66c-4cf9-a02b-4dee40985a8e service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:31.666694 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1263/2523] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:21:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:21:31.928379 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245b109-248a-4847-86dc-a71827709ed2 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:31.929903 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4245b109-248a-4847-86dc-a71827709ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:31.942417 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245b109-248a-4847-86dc-a71827709ed2 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:31.947575 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310fd463-4cee-42c1-beb5-82b214a3285c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:31.948604 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fd463-4cee-42c1-beb5-82b214a3285c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:31.948952 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fd463-4cee-42c1-beb5-82b214a3285c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:31.949427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fd463-4cee-42c1-beb5-82b214a3285c admin admin] PATH_INFO: `/v3/projects/c158c0d71cdc4241839a208e0a03571a` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:31.950886 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310fd463-4cee-42c1-beb5-82b214a3285c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c158c0d71cdc4241839a208e0a03571a)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:31.953444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310fd463-4cee-42c1-beb5-82b214a3285c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:32.000081 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-310fd463-4cee-42c1-beb5-82b214a3285c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c158c0d71cdc4241839a208e0a03571a', 'request_id': 'req-310fd463-4cee-42c1-beb5-82b214a3285c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:32.007974 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-310fd463-4cee-42c1-beb5-82b214a3285c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c158c0d71cdc4241839a208e0a03571a', 'request_id': 'req-310fd463-4cee-42c1-beb5-82b214a3285c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:32.013683 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-310fd463-4cee-42c1-beb5-82b214a3285c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c158c0d71cdc4241839a208e0a03571a', 'request_id': 'req-310fd463-4cee-42c1-beb5-82b214a3285c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:32.025330 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-310fd463-4cee-42c1-beb5-82b214a3285c admin admin] The token cache is being invalidate because project c158c0d71cdc4241839a208e0a03571a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:21:32.025613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-310fd463-4cee-42c1-beb5-82b214a3285c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:32.026241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-310fd463-4cee-42c1-beb5-82b214a3285c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:32.027711 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1261/2524] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:21:31 2022] DELETE /identity/v3/projects/c158c0d71cdc4241839a208e0a03571a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:32.031980 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b6193-c66c-4cf9-a02b-4dee40985a8e service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:32.041391 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b6193-c66c-4cf9-a02b-4dee40985a8e service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:32.097440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd553261-2e96-446f-9027-a4a3a40c6524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:32.098056 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd553261-2e96-446f-9027-a4a3a40c6524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:32.098328 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd553261-2e96-446f-9027-a4a3a40c6524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:32.098592 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd553261-2e96-446f-9027-a4a3a40c6524 admin admin] PATH_INFO: `/v3/users/2b600a17647b44ebabbca60d492dc041` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:32.099686 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd553261-2e96-446f-9027-a4a3a40c6524 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b600a17647b44ebabbca60d492dc041)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:32.101623 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd553261-2e96-446f-9027-a4a3a40c6524 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:32.146378 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-dd553261-2e96-446f-9027-a4a3a40c6524 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b600a17647b44ebabbca60d492dc041'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:32.153407 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-dd553261-2e96-446f-9027-a4a3a40c6524 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b600a17647b44ebabbca60d492dc041'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:32.165797 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-dd553261-2e96-446f-9027-a4a3a40c6524 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b600a17647b44ebabbca60d492dc041'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:32.166468 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-dd553261-2e96-446f-9027-a4a3a40c6524 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b600a17647b44ebabbca60d492dc041'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:32.173742 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-dd553261-2e96-446f-9027-a4a3a40c6524 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b600a17647b44ebabbca60d492dc041'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:32.179638 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1264/2525] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:21:32 2022] DELETE /identity/v3/users/2b600a17647b44ebabbca60d492dc041 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:32.447352 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310fd463-4cee-42c1-beb5-82b214a3285c admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:32.448813 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-310fd463-4cee-42c1-beb5-82b214a3285c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:32.463167 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310fd463-4cee-42c1-beb5-82b214a3285c admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:32.515020 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:32.521792 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae80a54-5170-4882-b353-c1c700c2aa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:32.522423 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae80a54-5170-4882-b353-c1c700c2aa71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:32.523073 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae80a54-5170-4882-b353-c1c700c2aa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:32.523452 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae80a54-5170-4882-b353-c1c700c2aa71 admin admin] PATH_INFO: `/v3/projects/320502002b5049059bbba5e2faf450ae` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:32.524973 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae80a54-5170-4882-b353-c1c700c2aa71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=320502002b5049059bbba5e2faf450ae)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:32.527470 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae80a54-5170-4882-b353-c1c700c2aa71 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:32.573523 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5ae80a54-5170-4882-b353-c1c700c2aa71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '320502002b5049059bbba5e2faf450ae', 'request_id': 'req-5ae80a54-5170-4882-b353-c1c700c2aa71'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:32.581410 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5ae80a54-5170-4882-b353-c1c700c2aa71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '320502002b5049059bbba5e2faf450ae', 'request_id': 'req-5ae80a54-5170-4882-b353-c1c700c2aa71'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:32.587099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5ae80a54-5170-4882-b353-c1c700c2aa71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '320502002b5049059bbba5e2faf450ae', 'request_id': 'req-5ae80a54-5170-4882-b353-c1c700c2aa71'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:32.598177 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5ae80a54-5170-4882-b353-c1c700c2aa71 admin admin] The token cache is being invalidate because project 320502002b5049059bbba5e2faf450ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:21:32.598457 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5ae80a54-5170-4882-b353-c1c700c2aa71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:32.599075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5ae80a54-5170-4882-b353-c1c700c2aa71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:32.600530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1262/2526] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:21:32 2022] DELETE /identity/v3/projects/320502002b5049059bbba5e2faf450ae => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:32.605558 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6aa08-a4e7-4b1c-9c42-49d3c7983124 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:32.606011 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6aa08-a4e7-4b1c-9c42-49d3c7983124 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:32.606136 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6aa08-a4e7-4b1c-9c42-49d3c7983124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:32.627097 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-eed6aa08-a4e7-4b1c-9c42-49d3c7983124 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:32.628312 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-eed6aa08-a4e7-4b1c-9c42-49d3c7983124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:32.632537 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:32.693765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1265/2527] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:32.701623 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f416f-dbcf-474a-afe8-0cb8593622c9 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:32.701903 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f416f-dbcf-474a-afe8-0cb8593622c9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:32.702167 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f416f-dbcf-474a-afe8-0cb8593622c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:32.722600 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-343f416f-dbcf-474a-afe8-0cb8593622c9 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:32.723800 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-343f416f-dbcf-474a-afe8-0cb8593622c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:32.731730 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1263/2528] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:32.736407 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6aa08-a4e7-4b1c-9c42-49d3c7983124 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:32.747305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6aa08-a4e7-4b1c-9c42-49d3c7983124 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:32.752449 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ca6f5-efc1-4f39-8070-96c3a47a44d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:32.753030 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ca6f5-efc1-4f39-8070-96c3a47a44d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:32.753359 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ca6f5-efc1-4f39-8070-96c3a47a44d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:32.753625 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ca6f5-efc1-4f39-8070-96c3a47a44d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:32.754256 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ca6f5-efc1-4f39-8070-96c3a47a44d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:21:32.754548 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ca6f5-efc1-4f39-8070-96c3a47a44d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:32.756130 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ca6f5-efc1-4f39-8070-96c3a47a44d0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:32.768196 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1266/2529] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:21:32.772528 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f416f-dbcf-474a-afe8-0cb8593622c9 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:32.781964 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f416f-dbcf-474a-afe8-0cb8593622c9 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:32.786545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2a9e4-fa3a-4528-a102-96d515306f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:32.787124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2a9e4-fa3a-4528-a102-96d515306f24 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:32.787397 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2a9e4-fa3a-4528-a102-96d515306f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:32.787663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2a9e4-fa3a-4528-a102-96d515306f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:32.788277 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2a9e4-fa3a-4528-a102-96d515306f24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:32.790202 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2a9e4-fa3a-4528-a102-96d515306f24 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:32.820059 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1264/2530] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:21:32 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:21:32.823632 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ca6f5-efc1-4f39-8070-96c3a47a44d0 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:32.834243 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ca6f5-efc1-4f39-8070-96c3a47a44d0 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:32.889674 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ab1b9-e1ac-4b37-8bc3-a6df212d657f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:32.890278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ab1b9-e1ac-4b37-8bc3-a6df212d657f admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:32.890548 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ab1b9-e1ac-4b37-8bc3-a6df212d657f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:32.890812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ab1b9-e1ac-4b37-8bc3-a6df212d657f admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:32.891429 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ab1b9-e1ac-4b37-8bc3-a6df212d657f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:32.894004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ab1b9-e1ac-4b37-8bc3-a6df212d657f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:32.915017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1267/2531] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:21:32 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:21:32.919261 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2a9e4-fa3a-4528-a102-96d515306f24 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:32.929643 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2a9e4-fa3a-4528-a102-96d515306f24 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:32.934272 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14a1a5-160a-4a27-b839-df1ec9951ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:32.934866 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14a1a5-160a-4a27-b839-df1ec9951ebf admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:32.935142 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14a1a5-160a-4a27-b839-df1ec9951ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:32.935410 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14a1a5-160a-4a27-b839-df1ec9951ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:32.936049 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14a1a5-160a-4a27-b839-df1ec9951ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:32.937684 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14a1a5-160a-4a27-b839-df1ec9951ebf admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:32.948220 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1265/2532] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:21:32.952017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ab1b9-e1ac-4b37-8bc3-a6df212d657f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:32.963212 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ab1b9-e1ac-4b37-8bc3-a6df212d657f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:32.967741 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76f99f-5c24-400e-a47a-9961895a1936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:32.968319 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76f99f-5c24-400e-a47a-9961895a1936 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:32.968593 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76f99f-5c24-400e-a47a-9961895a1936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:32.968860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76f99f-5c24-400e-a47a-9961895a1936 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:32.969577 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76f99f-5c24-400e-a47a-9961895a1936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:32.971361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76f99f-5c24-400e-a47a-9961895a1936 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:32.981684 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1268/2533] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:21:32.986075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14a1a5-160a-4a27-b839-df1ec9951ebf admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:32.996931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14a1a5-160a-4a27-b839-df1ec9951ebf admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:33.002096 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a2b9d-02b9-4a01-bb85-566ee64d793e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:33.002732 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a2b9d-02b9-4a01-bb85-566ee64d793e admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:33.003008 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a2b9d-02b9-4a01-bb85-566ee64d793e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:33.003277 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a2b9d-02b9-4a01-bb85-566ee64d793e admin admin] PATH_INFO: `/v3/projects/42be0eb72ad640f3a049095957e820c8/users/010b054f24404127910085a007a55874/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:33.018393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a2b9d-02b9-4a01-bb85-566ee64d793e admin admin] RBAC: Authorizing `identity:create_grant(project_id=42be0eb72ad640f3a049095957e820c8, user_id=010b054f24404127910085a007a55874, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:33.021050 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a2b9d-02b9-4a01-bb85-566ee64d793e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:33.036203 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1266/2534] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:21:32 2022] PUT /identity/v3/projects/42be0eb72ad640f3a049095957e820c8/users/010b054f24404127910085a007a55874/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:33.047802 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee967f7f-8b19-4ab4-aaed-f4d72fb9215d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:33.048109 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee967f7f-8b19-4ab4-aaed-f4d72fb9215d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:33.048381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee967f7f-8b19-4ab4-aaed-f4d72fb9215d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:33.076323 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ee967f7f-8b19-4ab4-aaed-f4d72fb9215d None None] MFA Rules not processed for user `010b054f24404127910085a007a55874`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:33.077553 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ee967f7f-8b19-4ab4-aaed-f4d72fb9215d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:33.140274 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1269/2535] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:33.144691 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a2b9d-02b9-4a01-bb85-566ee64d793e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:33.207626 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a2b9d-02b9-4a01-bb85-566ee64d793e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:33.212250 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f2a5b-4a19-48cd-9bf3-714e319d2a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:33.212839 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f2a5b-4a19-48cd-9bf3-714e319d2a35 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:33.213142 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f2a5b-4a19-48cd-9bf3-714e319d2a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:33.213418 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f2a5b-4a19-48cd-9bf3-714e319d2a35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:33.214032 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f2a5b-4a19-48cd-9bf3-714e319d2a35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:33.215919 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f2a5b-4a19-48cd-9bf3-714e319d2a35 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:33.243136 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1267/2536] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:21:33 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:21:33.247209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee967f7f-8b19-4ab4-aaed-f4d72fb9215d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:33.254333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:33.258603 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee967f7f-8b19-4ab4-aaed-f4d72fb9215d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:33.315489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf1324-8b18-4a30-a862-4eec4c6f1d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:33.316006 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf1324-8b18-4a30-a862-4eec4c6f1d26 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:33.316282 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf1324-8b18-4a30-a862-4eec4c6f1d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:33.316552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf1324-8b18-4a30-a862-4eec4c6f1d26 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:33.317199 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf1324-8b18-4a30-a862-4eec4c6f1d26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:33.319114 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf1324-8b18-4a30-a862-4eec4c6f1d26 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:33.340207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1270/2537] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:21:33 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:21:33.344216 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f2a5b-4a19-48cd-9bf3-714e319d2a35 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:33.354466 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f2a5b-4a19-48cd-9bf3-714e319d2a35 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:33.359016 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d721920-41ce-448f-8188-405b48687d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:33.359601 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d721920-41ce-448f-8188-405b48687d2c admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:33.359874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d721920-41ce-448f-8188-405b48687d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:33.360140 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d721920-41ce-448f-8188-405b48687d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:33.360771 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d721920-41ce-448f-8188-405b48687d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:33.362894 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d721920-41ce-448f-8188-405b48687d2c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:33.364897 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:33.375438 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1268/2538] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:21:33.379780 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf1324-8b18-4a30-a862-4eec4c6f1d26 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:33.389708 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf1324-8b18-4a30-a862-4eec4c6f1d26 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:33.394261 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6dc25a-b0f9-4512-814c-469a2a6136bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:33.394893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dc25a-b0f9-4512-814c-469a2a6136bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:33.395166 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dc25a-b0f9-4512-814c-469a2a6136bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:33.395435 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dc25a-b0f9-4512-814c-469a2a6136bf admin admin] PATH_INFO: `/v3/projects/87fb82d50600415580ce87cd1310b840/users/0cf58b38768649369ae0500925e958b2/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:33.409896 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6dc25a-b0f9-4512-814c-469a2a6136bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=87fb82d50600415580ce87cd1310b840, user_id=0cf58b38768649369ae0500925e958b2, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:33.412544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6dc25a-b0f9-4512-814c-469a2a6136bf admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:33.425131 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1271/2539] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:21:33 2022] PUT /identity/v3/projects/87fb82d50600415580ce87cd1310b840/users/0cf58b38768649369ae0500925e958b2/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:33.428958 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d721920-41ce-448f-8188-405b48687d2c admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:33.438887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d721920-41ce-448f-8188-405b48687d2c admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:33.494890 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7354054-5028-465f-8d0d-c76043333b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:33.495475 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7354054-5028-465f-8d0d-c76043333b2f admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:33.495750 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7354054-5028-465f-8d0d-c76043333b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:33.496019 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7354054-5028-465f-8d0d-c76043333b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:33.496646 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7354054-5028-465f-8d0d-c76043333b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:33.498263 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7354054-5028-465f-8d0d-c76043333b2f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:33.508408 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1269/2540] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:21:33.512507 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6dc25a-b0f9-4512-814c-469a2a6136bf admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:33.522705 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6dc25a-b0f9-4512-814c-469a2a6136bf admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:33.527319 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72ace6-c992-4f51-a64a-4111d0378e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:33.527953 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72ace6-c992-4f51-a64a-4111d0378e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:33.528230 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72ace6-c992-4f51-a64a-4111d0378e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:33.528500 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72ace6-c992-4f51-a64a-4111d0378e8a admin admin] PATH_INFO: `/v3/projects/87fb82d50600415580ce87cd1310b840/users/0cf58b38768649369ae0500925e958b2/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:33.530698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72ace6-c992-4f51-a64a-4111d0378e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=87fb82d50600415580ce87cd1310b840, user_id=0cf58b38768649369ae0500925e958b2, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:33.533861 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72ace6-c992-4f51-a64a-4111d0378e8a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:33.543795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1272/2541] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:21:33 2022] PUT /identity/v3/projects/87fb82d50600415580ce87cd1310b840/users/0cf58b38768649369ae0500925e958b2/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:33.554283 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6ec1c-386a-40c1-ad38-ff074ea86fab None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:33.554757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6ec1c-386a-40c1-ad38-ff074ea86fab None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:33.554854 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6ec1c-386a-40c1-ad38-ff074ea86fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:33.582339 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e3d6ec1c-386a-40c1-ad38-ff074ea86fab None None] MFA Rules not processed for user `0cf58b38768649369ae0500925e958b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:33.583465 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e3d6ec1c-386a-40c1-ad38-ff074ea86fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:33.651886 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1270/2542] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:33.663416 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72ace6-c992-4f51-a64a-4111d0378e8a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:33.665184 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ec72ace6-c992-4f51-a64a-4111d0378e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:33.722108 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72ace6-c992-4f51-a64a-4111d0378e8a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:33.725761 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c624b8-bcaf-4c5f-abfb-8a1b418d2626 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:33.726349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c624b8-bcaf-4c5f-abfb-8a1b418d2626 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:33.726626 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c624b8-bcaf-4c5f-abfb-8a1b418d2626 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:33.726895 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c624b8-bcaf-4c5f-abfb-8a1b418d2626 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:33.735689 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c624b8-bcaf-4c5f-abfb-8a1b418d2626 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:33.737157 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c624b8-bcaf-4c5f-abfb-8a1b418d2626 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:33.746432 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1273/2543] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:21:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:21:34.160231 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6ec1c-386a-40c1-ad38-ff074ea86fab None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:34.222973 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6ec1c-386a-40c1-ad38-ff074ea86fab None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:34.227522 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d42687-a5f6-4211-8f21-8c0a7632042a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:34.228135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d42687-a5f6-4211-8f21-8c0a7632042a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:34.228413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d42687-a5f6-4211-8f21-8c0a7632042a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:34.228680 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d42687-a5f6-4211-8f21-8c0a7632042a admin admin] PATH_INFO: `/v3/users/010b054f24404127910085a007a55874` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:34.229819 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d42687-a5f6-4211-8f21-8c0a7632042a admin admin] RBAC: Authorizing `identity:delete_user(user_id=010b054f24404127910085a007a55874)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:34.231744 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d42687-a5f6-4211-8f21-8c0a7632042a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:34.253591 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:34.280149 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c3d42687-a5f6-4211-8f21-8c0a7632042a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '010b054f24404127910085a007a55874'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:34.287268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c3d42687-a5f6-4211-8f21-8c0a7632042a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '010b054f24404127910085a007a55874'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:34.299742 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c3d42687-a5f6-4211-8f21-8c0a7632042a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '010b054f24404127910085a007a55874'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:34.300373 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c3d42687-a5f6-4211-8f21-8c0a7632042a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '010b054f24404127910085a007a55874'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:34.307248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c3d42687-a5f6-4211-8f21-8c0a7632042a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '010b054f24404127910085a007a55874'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:34.313220 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1271/2544] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:21:34 2022] DELETE /identity/v3/users/010b054f24404127910085a007a55874 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:34.317712 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840d38c-349b-4b66-a09b-48362c030d59 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:34.317990 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840d38c-349b-4b66-a09b-48362c030d59 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:34.318259 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840d38c-349b-4b66-a09b-48362c030d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:34.337976 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5840d38c-349b-4b66-a09b-48362c030d59 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:34.339311 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5840d38c-349b-4b66-a09b-48362c030d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:34.389236 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:34.398325 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1274/2545] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:34.408842 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d42687-a5f6-4211-8f21-8c0a7632042a admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:34.410274 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c3d42687-a5f6-4211-8f21-8c0a7632042a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:34.466884 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d42687-a5f6-4211-8f21-8c0a7632042a admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:34.471093 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31555c41-0362-451f-af53-2bff49b94acf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:34.471680 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31555c41-0362-451f-af53-2bff49b94acf service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:34.471954 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31555c41-0362-451f-af53-2bff49b94acf service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:34.472221 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31555c41-0362-451f-af53-2bff49b94acf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:34.481394 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31555c41-0362-451f-af53-2bff49b94acf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:34.482795 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31555c41-0362-451f-af53-2bff49b94acf service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:34.492797 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1272/2546] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:21:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:21:34.764286 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840d38c-349b-4b66-a09b-48362c030d59 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:34.765762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5840d38c-349b-4b66-a09b-48362c030d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:34.782730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840d38c-349b-4b66-a09b-48362c030d59 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:34.787472 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c0dbe-3841-494d-b383-ee04e5676dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:34.788178 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c0dbe-3841-494d-b383-ee04e5676dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:34.788454 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c0dbe-3841-494d-b383-ee04e5676dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:34.788721 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c0dbe-3841-494d-b383-ee04e5676dd8 admin admin] PATH_INFO: `/v3/projects/42be0eb72ad640f3a049095957e820c8` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:34.789857 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c0dbe-3841-494d-b383-ee04e5676dd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42be0eb72ad640f3a049095957e820c8)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:34.791771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c0dbe-3841-494d-b383-ee04e5676dd8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:34.838725 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-de5c0dbe-3841-494d-b383-ee04e5676dd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42be0eb72ad640f3a049095957e820c8', 'request_id': 'req-de5c0dbe-3841-494d-b383-ee04e5676dd8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:34.844810 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-de5c0dbe-3841-494d-b383-ee04e5676dd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42be0eb72ad640f3a049095957e820c8', 'request_id': 'req-de5c0dbe-3841-494d-b383-ee04e5676dd8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:34.852420 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-de5c0dbe-3841-494d-b383-ee04e5676dd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42be0eb72ad640f3a049095957e820c8', 'request_id': 'req-de5c0dbe-3841-494d-b383-ee04e5676dd8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:34.862656 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-de5c0dbe-3841-494d-b383-ee04e5676dd8 admin admin] The token cache is being invalidate because project 42be0eb72ad640f3a049095957e820c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:21:34.862936 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-de5c0dbe-3841-494d-b383-ee04e5676dd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:34.863547 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-de5c0dbe-3841-494d-b383-ee04e5676dd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:34.864995 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1275/2547] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:21:34 2022] DELETE /identity/v3/projects/42be0eb72ad640f3a049095957e820c8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:21:34.869174 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31555c41-0362-451f-af53-2bff49b94acf service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:34.878774 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31555c41-0362-451f-af53-2bff49b94acf service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:34.934566 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165abbd-2b51-49f4-be15-77157d1340ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:34.935115 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165abbd-2b51-49f4-be15-77157d1340ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:34.935390 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165abbd-2b51-49f4-be15-77157d1340ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:34.935659 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165abbd-2b51-49f4-be15-77157d1340ef admin admin] PATH_INFO: `/v3/users/0cf58b38768649369ae0500925e958b2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:34.936792 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165abbd-2b51-49f4-be15-77157d1340ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cf58b38768649369ae0500925e958b2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:34.938751 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165abbd-2b51-49f4-be15-77157d1340ef admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:34.982204 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:34.985006 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2165abbd-2b51-49f4-be15-77157d1340ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cf58b38768649369ae0500925e958b2'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:34.992716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2165abbd-2b51-49f4-be15-77157d1340ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cf58b38768649369ae0500925e958b2'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:35.004842 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2165abbd-2b51-49f4-be15-77157d1340ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cf58b38768649369ae0500925e958b2'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:35.005475 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2165abbd-2b51-49f4-be15-77157d1340ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cf58b38768649369ae0500925e958b2'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:35.012284 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2165abbd-2b51-49f4-be15-77157d1340ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cf58b38768649369ae0500925e958b2'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:35.018841 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1273/2548] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:21:34 2022] DELETE /identity/v3/users/0cf58b38768649369ae0500925e958b2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:35.283371 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c0dbe-3841-494d-b383-ee04e5676dd8 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:35.284854 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-de5c0dbe-3841-494d-b383-ee04e5676dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:35.299099 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c0dbe-3841-494d-b383-ee04e5676dd8 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:35.356351 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408394a-15ba-4583-a0b1-1d90f731a370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:35.356972 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408394a-15ba-4583-a0b1-1d90f731a370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:35.357295 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408394a-15ba-4583-a0b1-1d90f731a370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:35.357574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408394a-15ba-4583-a0b1-1d90f731a370 admin admin] PATH_INFO: `/v3/projects/87fb82d50600415580ce87cd1310b840` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:35.358707 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408394a-15ba-4583-a0b1-1d90f731a370 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87fb82d50600415580ce87cd1310b840)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:35.360596 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408394a-15ba-4583-a0b1-1d90f731a370 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:35.406336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8408394a-15ba-4583-a0b1-1d90f731a370 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87fb82d50600415580ce87cd1310b840', 'request_id': 'req-8408394a-15ba-4583-a0b1-1d90f731a370'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:35.413271 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8408394a-15ba-4583-a0b1-1d90f731a370 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87fb82d50600415580ce87cd1310b840', 'request_id': 'req-8408394a-15ba-4583-a0b1-1d90f731a370'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:35.421206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8408394a-15ba-4583-a0b1-1d90f731a370 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87fb82d50600415580ce87cd1310b840', 'request_id': 'req-8408394a-15ba-4583-a0b1-1d90f731a370'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:35.431371 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8408394a-15ba-4583-a0b1-1d90f731a370 admin admin] The token cache is being invalidate because project 87fb82d50600415580ce87cd1310b840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:21:35.431656 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8408394a-15ba-4583-a0b1-1d90f731a370 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:35.432277 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8408394a-15ba-4583-a0b1-1d90f731a370 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:35.433769 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1276/2549] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:21:35 2022] DELETE /identity/v3/projects/87fb82d50600415580ce87cd1310b840 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:35.438609 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae8aa4-6eb7-48cb-a92a-c0a9d049cb9c None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:35.438893 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae8aa4-6eb7-48cb-a92a-c0a9d049cb9c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:35.439168 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae8aa4-6eb7-48cb-a92a-c0a9d049cb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:35.458976 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-c1ae8aa4-6eb7-48cb-a92a-c0a9d049cb9c None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:35.460224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c1ae8aa4-6eb7-48cb-a92a-c0a9d049cb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:35.518580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1274/2550] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:35.526256 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3f0db-7203-443c-b70f-d671eb22bf39 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:35.526538 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3f0db-7203-443c-b70f-d671eb22bf39 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:35.526806 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3f0db-7203-443c-b70f-d671eb22bf39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:35.546463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-0de3f0db-7203-443c-b70f-d671eb22bf39 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:35.547633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0de3f0db-7203-443c-b70f-d671eb22bf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:35.555342 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1277/2551] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:35.559308 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae8aa4-6eb7-48cb-a92a-c0a9d049cb9c None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:35.569018 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae8aa4-6eb7-48cb-a92a-c0a9d049cb9c None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:35.573766 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5e691-67d0-4c07-b4ac-3be6b0830e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:35.574357 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5e691-67d0-4c07-b4ac-3be6b0830e3b admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:35.574639 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5e691-67d0-4c07-b4ac-3be6b0830e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:35.574913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5e691-67d0-4c07-b4ac-3be6b0830e3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:35.575561 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5e691-67d0-4c07-b4ac-3be6b0830e3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:21:35.575896 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5e691-67d0-4c07-b4ac-3be6b0830e3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:35.577527 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5e691-67d0-4c07-b4ac-3be6b0830e3b admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:35.589527 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1275/2552] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:21:35.593619 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3f0db-7203-443c-b70f-d671eb22bf39 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:35.603273 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3f0db-7203-443c-b70f-d671eb22bf39 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:35.607834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c88087-bdb0-4d5c-a49f-bf4222fb961f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:35.608404 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c88087-bdb0-4d5c-a49f-bf4222fb961f admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:35.608677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c88087-bdb0-4d5c-a49f-bf4222fb961f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:35.608943 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c88087-bdb0-4d5c-a49f-bf4222fb961f admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:35.609597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c88087-bdb0-4d5c-a49f-bf4222fb961f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:35.611551 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c88087-bdb0-4d5c-a49f-bf4222fb961f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:35.615984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:35.639666 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1278/2553] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:21:35 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:21:35.644712 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5e691-67d0-4c07-b4ac-3be6b0830e3b admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:35.654628 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5e691-67d0-4c07-b4ac-3be6b0830e3b admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:35.710920 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42037b-0468-4f2b-b235-63d53a0792eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:35.711438 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42037b-0468-4f2b-b235-63d53a0792eb admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:35.711714 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42037b-0468-4f2b-b235-63d53a0792eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:35.712002 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42037b-0468-4f2b-b235-63d53a0792eb admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:35.712613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42037b-0468-4f2b-b235-63d53a0792eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:35.714541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42037b-0468-4f2b-b235-63d53a0792eb admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:35.736720 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1276/2554] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:21:35 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:21:35.740961 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c88087-bdb0-4d5c-a49f-bf4222fb961f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:35.751223 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c88087-bdb0-4d5c-a49f-bf4222fb961f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:35.756367 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d8fb8-605e-4985-8a1b-993ad947482c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:35.756956 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d8fb8-605e-4985-8a1b-993ad947482c admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:35.757405 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d8fb8-605e-4985-8a1b-993ad947482c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:35.758211 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d8fb8-605e-4985-8a1b-993ad947482c admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:35.758369 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d8fb8-605e-4985-8a1b-993ad947482c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:35.760114 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d8fb8-605e-4985-8a1b-993ad947482c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:35.771001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1279/2555] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:21:35.775167 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42037b-0468-4f2b-b235-63d53a0792eb admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:35.785374 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42037b-0468-4f2b-b235-63d53a0792eb admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:35.790024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae931a1-1238-474b-af78-46eb65c1b27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:35.790600 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae931a1-1238-474b-af78-46eb65c1b27f admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:35.790872 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae931a1-1238-474b-af78-46eb65c1b27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:35.791139 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae931a1-1238-474b-af78-46eb65c1b27f admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:35.791767 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae931a1-1238-474b-af78-46eb65c1b27f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:35.793382 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae931a1-1238-474b-af78-46eb65c1b27f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:35.803780 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1277/2556] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:21:35.807740 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d8fb8-605e-4985-8a1b-993ad947482c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:35.818190 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d8fb8-605e-4985-8a1b-993ad947482c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:35.822829 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb15927-ac39-4ae6-a7f4-475e4863f554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:35.823465 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb15927-ac39-4ae6-a7f4-475e4863f554 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:35.823744 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb15927-ac39-4ae6-a7f4-475e4863f554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:35.824013 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb15927-ac39-4ae6-a7f4-475e4863f554 admin admin] PATH_INFO: `/v3/projects/cf63d215213541208e62ee53936a4fdf/users/29a19bce00794babbcf48810a45e3c3f/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:35.838934 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb15927-ac39-4ae6-a7f4-475e4863f554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf63d215213541208e62ee53936a4fdf, user_id=29a19bce00794babbcf48810a45e3c3f, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:35.841638 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb15927-ac39-4ae6-a7f4-475e4863f554 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:35.854134 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1280/2557] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:21:35 2022] PUT /identity/v3/projects/cf63d215213541208e62ee53936a4fdf/users/29a19bce00794babbcf48810a45e3c3f/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:35.865367 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1f631-b635-4acd-b77f-6dc6ce69a06d None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:35.865647 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1f631-b635-4acd-b77f-6dc6ce69a06d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:35.865910 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1f631-b635-4acd-b77f-6dc6ce69a06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:35.894863 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-98d1f631-b635-4acd-b77f-6dc6ce69a06d None None] MFA Rules not processed for user `29a19bce00794babbcf48810a45e3c3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:35.896102 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-98d1f631-b635-4acd-b77f-6dc6ce69a06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:35.910118 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:35.963175 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1278/2558] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:35.967595 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb15927-ac39-4ae6-a7f4-475e4863f554 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:36.033441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb15927-ac39-4ae6-a7f4-475e4863f554 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:36.038041 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a229131-52ab-46f2-912f-89afa0b3a1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:36.038636 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a229131-52ab-46f2-912f-89afa0b3a1ee admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:36.038914 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a229131-52ab-46f2-912f-89afa0b3a1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:36.039184 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a229131-52ab-46f2-912f-89afa0b3a1ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:36.039815 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a229131-52ab-46f2-912f-89afa0b3a1ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:36.041745 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a229131-52ab-46f2-912f-89afa0b3a1ee admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:36.070041 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1281/2559] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:21:35 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:21:36.073997 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1f631-b635-4acd-b77f-6dc6ce69a06d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:36.085307 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1f631-b635-4acd-b77f-6dc6ce69a06d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:36.146884 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a787a-ee04-4d7c-8b9c-6dcb51b8556a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:36.147476 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a787a-ee04-4d7c-8b9c-6dcb51b8556a admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:36.147749 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a787a-ee04-4d7c-8b9c-6dcb51b8556a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:36.148014 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a787a-ee04-4d7c-8b9c-6dcb51b8556a admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:36.148673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a787a-ee04-4d7c-8b9c-6dcb51b8556a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:36.150627 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a787a-ee04-4d7c-8b9c-6dcb51b8556a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:36.171956 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1279/2560] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:21:36 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:21:36.175936 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a229131-52ab-46f2-912f-89afa0b3a1ee admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:36.186167 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a229131-52ab-46f2-912f-89afa0b3a1ee admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:36.190696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240974b-f456-4717-8b27-ee6905bef2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:36.191290 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240974b-f456-4717-8b27-ee6905bef2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:36.191565 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240974b-f456-4717-8b27-ee6905bef2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:36.191832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240974b-f456-4717-8b27-ee6905bef2e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:36.192463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240974b-f456-4717-8b27-ee6905bef2e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:36.194082 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240974b-f456-4717-8b27-ee6905bef2e1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:36.205368 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1282/2561] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:21:36.209311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a787a-ee04-4d7c-8b9c-6dcb51b8556a admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:36.219146 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a787a-ee04-4d7c-8b9c-6dcb51b8556a admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:36.224225 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c55b49-f2b5-404a-b0b0-ffdd2d5e4929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:36.224857 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c55b49-f2b5-404a-b0b0-ffdd2d5e4929 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:36.225158 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c55b49-f2b5-404a-b0b0-ffdd2d5e4929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:36.225428 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c55b49-f2b5-404a-b0b0-ffdd2d5e4929 admin admin] PATH_INFO: `/v3/projects/b67234ceb39040e8b3af93afad44c103/users/4f767334060b4f0daf30868da4783ca0/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:36.240801 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c55b49-f2b5-404a-b0b0-ffdd2d5e4929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b67234ceb39040e8b3af93afad44c103, user_id=4f767334060b4f0daf30868da4783ca0, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:36.243474 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c55b49-f2b5-404a-b0b0-ffdd2d5e4929 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:36.255941 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1280/2562] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:21:36 2022] PUT /identity/v3/projects/b67234ceb39040e8b3af93afad44c103/users/4f767334060b4f0daf30868da4783ca0/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:21:36.259791 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240974b-f456-4717-8b27-ee6905bef2e1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:36.271060 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240974b-f456-4717-8b27-ee6905bef2e1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:36.328731 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4ad5a-5e35-4bc9-abbd-abf72e28bfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:36.329373 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4ad5a-5e35-4bc9-abbd-abf72e28bfb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:36.330157 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4ad5a-5e35-4bc9-abbd-abf72e28bfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:36.330426 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4ad5a-5e35-4bc9-abbd-abf72e28bfb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:36.331053 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4ad5a-5e35-4bc9-abbd-abf72e28bfb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:36.332639 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4ad5a-5e35-4bc9-abbd-abf72e28bfb3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:36.342189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1283/2563] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:21:36.346949 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c55b49-f2b5-404a-b0b0-ffdd2d5e4929 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:36.357242 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c55b49-f2b5-404a-b0b0-ffdd2d5e4929 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:36.361843 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca3d6a-07cc-439e-b539-c3fd762bcdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:36.362503 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca3d6a-07cc-439e-b539-c3fd762bcdae admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:36.362779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca3d6a-07cc-439e-b539-c3fd762bcdae admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:36.363046 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca3d6a-07cc-439e-b539-c3fd762bcdae admin admin] PATH_INFO: `/v3/projects/b67234ceb39040e8b3af93afad44c103/users/4f767334060b4f0daf30868da4783ca0/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:36.364950 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca3d6a-07cc-439e-b539-c3fd762bcdae admin admin] RBAC: Authorizing `identity:create_grant(project_id=b67234ceb39040e8b3af93afad44c103, user_id=4f767334060b4f0daf30868da4783ca0, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:36.367600 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca3d6a-07cc-439e-b539-c3fd762bcdae admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:36.377733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1281/2564] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:21:36 2022] PUT /identity/v3/projects/b67234ceb39040e8b3af93afad44c103/users/4f767334060b4f0daf30868da4783ca0/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:36.387753 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94500a53-0304-47b0-9321-f244d8f6c533 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:36.388039 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94500a53-0304-47b0-9321-f244d8f6c533 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:36.388318 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94500a53-0304-47b0-9321-f244d8f6c533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:36.417248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-94500a53-0304-47b0-9321-f244d8f6c533 None None] MFA Rules not processed for user `4f767334060b4f0daf30868da4783ca0`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:36.418445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-94500a53-0304-47b0-9321-f244d8f6c533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:36.426552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:36.486582 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1284/2565] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:36 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:36.498039 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca3d6a-07cc-439e-b539-c3fd762bcdae admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:36.499718 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-bbca3d6a-07cc-439e-b539-c3fd762bcdae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:36.559415 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca3d6a-07cc-439e-b539-c3fd762bcdae admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:36.563047 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a4d36-8e5e-416d-9939-53d0d22288e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:36.563634 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a4d36-8e5e-416d-9939-53d0d22288e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:36.563908 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a4d36-8e5e-416d-9939-53d0d22288e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:36.564726 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a4d36-8e5e-416d-9939-53d0d22288e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:36.573714 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a4d36-8e5e-416d-9939-53d0d22288e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:36.575128 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a4d36-8e5e-416d-9939-53d0d22288e0 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:36.585277 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1282/2566] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:21:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:21:36.613970 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94500a53-0304-47b0-9321-f244d8f6c533 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:36.675748 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94500a53-0304-47b0-9321-f244d8f6c533 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:36.680298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35062af4-6568-476c-8af9-6a48074386f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:36.680910 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35062af4-6568-476c-8af9-6a48074386f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:36.681215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35062af4-6568-476c-8af9-6a48074386f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:36.681490 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35062af4-6568-476c-8af9-6a48074386f1 admin admin] PATH_INFO: `/v3/users/29a19bce00794babbcf48810a45e3c3f` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:36.682606 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35062af4-6568-476c-8af9-6a48074386f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29a19bce00794babbcf48810a45e3c3f)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:36.684506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35062af4-6568-476c-8af9-6a48074386f1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:36.730823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-35062af4-6568-476c-8af9-6a48074386f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29a19bce00794babbcf48810a45e3c3f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:36.737315 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-35062af4-6568-476c-8af9-6a48074386f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29a19bce00794babbcf48810a45e3c3f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:36.749017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-35062af4-6568-476c-8af9-6a48074386f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29a19bce00794babbcf48810a45e3c3f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:36.749679 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-35062af4-6568-476c-8af9-6a48074386f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29a19bce00794babbcf48810a45e3c3f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:36.757154 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-35062af4-6568-476c-8af9-6a48074386f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29a19bce00794babbcf48810a45e3c3f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:36.763044 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1285/2567] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:21:36 2022] DELETE /identity/v3/users/29a19bce00794babbcf48810a45e3c3f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:36.768142 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd4b25-ebb6-47cd-8eb3-446d24394d9d None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:36.768433 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd4b25-ebb6-47cd-8eb3-446d24394d9d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:36.768737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd4b25-ebb6-47cd-8eb3-446d24394d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:36.788282 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-11dd4b25-ebb6-47cd-8eb3-446d24394d9d None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:36.789585 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-11dd4b25-ebb6-47cd-8eb3-446d24394d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:36.794868 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:36.848630 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1283/2568] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:36.858208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35062af4-6568-476c-8af9-6a48074386f1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:36.859587 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-35062af4-6568-476c-8af9-6a48074386f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:36.888525 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:36.918968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35062af4-6568-476c-8af9-6a48074386f1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:36.922576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31890896-b40b-41d0-95fe-99315d7458b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:36.923165 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31890896-b40b-41d0-95fe-99315d7458b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:36.923954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31890896-b40b-41d0-95fe-99315d7458b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:36.924202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31890896-b40b-41d0-95fe-99315d7458b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:36.932945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31890896-b40b-41d0-95fe-99315d7458b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:36.934387 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31890896-b40b-41d0-95fe-99315d7458b3 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:36.944320 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1286/2569] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:21:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:21:37.210409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd4b25-ebb6-47cd-8eb3-446d24394d9d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:37.211912 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-11dd4b25-ebb6-47cd-8eb3-446d24394d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:37.225005 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd4b25-ebb6-47cd-8eb3-446d24394d9d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:37.229679 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660fa85-f42e-44f3-901c-e57a302d6bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:37.230727 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660fa85-f42e-44f3-901c-e57a302d6bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:37.230727 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660fa85-f42e-44f3-901c-e57a302d6bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:37.230951 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660fa85-f42e-44f3-901c-e57a302d6bb2 admin admin] PATH_INFO: `/v3/projects/cf63d215213541208e62ee53936a4fdf` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:37.231993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660fa85-f42e-44f3-901c-e57a302d6bb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf63d215213541208e62ee53936a4fdf)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:37.233927 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660fa85-f42e-44f3-901c-e57a302d6bb2 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:37.280555 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3660fa85-f42e-44f3-901c-e57a302d6bb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf63d215213541208e62ee53936a4fdf', 'request_id': 'req-3660fa85-f42e-44f3-901c-e57a302d6bb2'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:37.287737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3660fa85-f42e-44f3-901c-e57a302d6bb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf63d215213541208e62ee53936a4fdf', 'request_id': 'req-3660fa85-f42e-44f3-901c-e57a302d6bb2'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:37.294148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3660fa85-f42e-44f3-901c-e57a302d6bb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf63d215213541208e62ee53936a4fdf', 'request_id': 'req-3660fa85-f42e-44f3-901c-e57a302d6bb2'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:37.305975 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3660fa85-f42e-44f3-901c-e57a302d6bb2 admin admin] The token cache is being invalidate because project cf63d215213541208e62ee53936a4fdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:21:37.306257 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3660fa85-f42e-44f3-901c-e57a302d6bb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:37.306944 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3660fa85-f42e-44f3-901c-e57a302d6bb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:37.308598 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1284/2570] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:21:37 2022] DELETE /identity/v3/projects/cf63d215213541208e62ee53936a4fdf => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:37.313002 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31890896-b40b-41d0-95fe-99315d7458b3 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:37.323280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31890896-b40b-41d0-95fe-99315d7458b3 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:37.377920 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088d49d-2060-4e6d-897e-d76f634777bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:37.378529 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088d49d-2060-4e6d-897e-d76f634777bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:37.378801 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088d49d-2060-4e6d-897e-d76f634777bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:37.379064 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088d49d-2060-4e6d-897e-d76f634777bd admin admin] PATH_INFO: `/v3/users/4f767334060b4f0daf30868da4783ca0` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:37.380162 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088d49d-2060-4e6d-897e-d76f634777bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f767334060b4f0daf30868da4783ca0)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:37.382104 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088d49d-2060-4e6d-897e-d76f634777bd admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:37.427754 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c088d49d-2060-4e6d-897e-d76f634777bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f767334060b4f0daf30868da4783ca0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:37.434947 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c088d49d-2060-4e6d-897e-d76f634777bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f767334060b4f0daf30868da4783ca0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:37.447048 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c088d49d-2060-4e6d-897e-d76f634777bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f767334060b4f0daf30868da4783ca0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:37.447685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c088d49d-2060-4e6d-897e-d76f634777bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f767334060b4f0daf30868da4783ca0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:37.454639 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c088d49d-2060-4e6d-897e-d76f634777bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f767334060b4f0daf30868da4783ca0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:37.460463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1287/2571] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:21:37 2022] DELETE /identity/v3/users/4f767334060b4f0daf30868da4783ca0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:37.959978 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660fa85-f42e-44f3-901c-e57a302d6bb2 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:37.961504 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-3660fa85-f42e-44f3-901c-e57a302d6bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:37.976697 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660fa85-f42e-44f3-901c-e57a302d6bb2 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:38.037191 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908a65c-4a36-497c-8b10-35429e40d313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:38.037813 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908a65c-4a36-497c-8b10-35429e40d313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:38.038091 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908a65c-4a36-497c-8b10-35429e40d313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:38.038366 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908a65c-4a36-497c-8b10-35429e40d313 admin admin] PATH_INFO: `/v3/projects/b67234ceb39040e8b3af93afad44c103` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:38.039482 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908a65c-4a36-497c-8b10-35429e40d313 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b67234ceb39040e8b3af93afad44c103)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:38.041432 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908a65c-4a36-497c-8b10-35429e40d313 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:38.081951 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:38.092941 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7908a65c-4a36-497c-8b10-35429e40d313 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b67234ceb39040e8b3af93afad44c103', 'request_id': 'req-7908a65c-4a36-497c-8b10-35429e40d313'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:38.100321 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7908a65c-4a36-497c-8b10-35429e40d313 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b67234ceb39040e8b3af93afad44c103', 'request_id': 'req-7908a65c-4a36-497c-8b10-35429e40d313'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:38.106005 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7908a65c-4a36-497c-8b10-35429e40d313 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b67234ceb39040e8b3af93afad44c103', 'request_id': 'req-7908a65c-4a36-497c-8b10-35429e40d313'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:38.117296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7908a65c-4a36-497c-8b10-35429e40d313 admin admin] The token cache is being invalidate because project b67234ceb39040e8b3af93afad44c103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:21:38.117745 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7908a65c-4a36-497c-8b10-35429e40d313 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:38.118490 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7908a65c-4a36-497c-8b10-35429e40d313 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:38.120131 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1285/2572] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:21:37 2022] DELETE /identity/v3/projects/b67234ceb39040e8b3af93afad44c103 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:38.125472 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a5936-2da6-457f-ae01-c2c461948726 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:38.125965 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a5936-2da6-457f-ae01-c2c461948726 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:38.126067 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a5936-2da6-457f-ae01-c2c461948726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:38.148353 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-da7a5936-2da6-457f-ae01-c2c461948726 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:38.149498 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-da7a5936-2da6-457f-ae01-c2c461948726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:38.191801 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:38.212817 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1288/2573] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:38.220636 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f79013-07f1-4ca1-9908-245fc79efeda None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:38.221238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f79013-07f1-4ca1-9908-245fc79efeda None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:38.221238 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f79013-07f1-4ca1-9908-245fc79efeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:38.244743 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-d7f79013-07f1-4ca1-9908-245fc79efeda None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:38.246005 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d7f79013-07f1-4ca1-9908-245fc79efeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:38.255692 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1286/2574] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:38.260147 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a5936-2da6-457f-ae01-c2c461948726 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:38.271146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a5936-2da6-457f-ae01-c2c461948726 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:38.275974 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05a335-4b32-468c-b3bf-56cbbd800da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:38.277409 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05a335-4b32-468c-b3bf-56cbbd800da7 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:38.277409 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05a335-4b32-468c-b3bf-56cbbd800da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:38.277697 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05a335-4b32-468c-b3bf-56cbbd800da7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:38.278311 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05a335-4b32-468c-b3bf-56cbbd800da7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:21:38.278616 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05a335-4b32-468c-b3bf-56cbbd800da7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:38.280764 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05a335-4b32-468c-b3bf-56cbbd800da7 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:38.294307 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1289/2575] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:21:38.298869 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f79013-07f1-4ca1-9908-245fc79efeda None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:38.308129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f79013-07f1-4ca1-9908-245fc79efeda None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:38.312707 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cf7e4-8082-46f7-8a1f-3d71be9ef65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:38.313323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cf7e4-8082-46f7-8a1f-3d71be9ef65e admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:38.313612 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cf7e4-8082-46f7-8a1f-3d71be9ef65e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:38.313880 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cf7e4-8082-46f7-8a1f-3d71be9ef65e admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:38.314510 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cf7e4-8082-46f7-8a1f-3d71be9ef65e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:38.316996 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cf7e4-8082-46f7-8a1f-3d71be9ef65e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:38.344934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1287/2576] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:21:38 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:21:38.349246 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05a335-4b32-468c-b3bf-56cbbd800da7 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:38.361389 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05a335-4b32-468c-b3bf-56cbbd800da7 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:38.427645 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bd601-adfb-4ece-8bbb-62570039c20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:38.428173 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bd601-adfb-4ece-8bbb-62570039c20f admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:38.428452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bd601-adfb-4ece-8bbb-62570039c20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:38.428724 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bd601-adfb-4ece-8bbb-62570039c20f admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:38.429409 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209bd601-adfb-4ece-8bbb-62570039c20f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:38.431371 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209bd601-adfb-4ece-8bbb-62570039c20f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:38.458564 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1290/2577] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:21:38 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:21:38.462984 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cf7e4-8082-46f7-8a1f-3d71be9ef65e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:38.474029 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cf7e4-8082-46f7-8a1f-3d71be9ef65e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:38.480505 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb0b18-bbf8-4394-ab6f-419d9dc48560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:38.481698 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb0b18-bbf8-4394-ab6f-419d9dc48560 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:38.482191 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb0b18-bbf8-4394-ab6f-419d9dc48560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:38.482871 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb0b18-bbf8-4394-ab6f-419d9dc48560 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:38.484042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb0b18-bbf8-4394-ab6f-419d9dc48560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:38.486726 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb0b18-bbf8-4394-ab6f-419d9dc48560 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:38.500213 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1288/2578] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:21:38.505214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bd601-adfb-4ece-8bbb-62570039c20f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:38.519113 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bd601-adfb-4ece-8bbb-62570039c20f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:38.523696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c52316-e15c-4022-87e9-599e0b0a3e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:38.524285 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c52316-e15c-4022-87e9-599e0b0a3e28 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:38.524561 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c52316-e15c-4022-87e9-599e0b0a3e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:38.524828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c52316-e15c-4022-87e9-599e0b0a3e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:38.525617 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c52316-e15c-4022-87e9-599e0b0a3e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:38.527211 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c52316-e15c-4022-87e9-599e0b0a3e28 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:38.541837 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1291/2579] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:21:38.546239 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb0b18-bbf8-4394-ab6f-419d9dc48560 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:38.558204 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb0b18-bbf8-4394-ab6f-419d9dc48560 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:38.562900 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0145ea-721d-4907-9c3a-eacf24dfde19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:38.563552 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0145ea-721d-4907-9c3a-eacf24dfde19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:38.563833 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0145ea-721d-4907-9c3a-eacf24dfde19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:38.564117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0145ea-721d-4907-9c3a-eacf24dfde19 admin admin] PATH_INFO: `/v3/projects/d6bf4ae94a9747c899a66af417ea0a00/users/926fb7a255874ed887985baa032f21f3/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:38.580565 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0145ea-721d-4907-9c3a-eacf24dfde19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6bf4ae94a9747c899a66af417ea0a00, user_id=926fb7a255874ed887985baa032f21f3, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:38.584946 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0145ea-721d-4907-9c3a-eacf24dfde19 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:38.600682 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1289/2580] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:21:38 2022] PUT /identity/v3/projects/d6bf4ae94a9747c899a66af417ea0a00/users/926fb7a255874ed887985baa032f21f3/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:38.613276 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f04d6b-c17d-40f4-8dc4-d5c04ed77d12 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:38.614482 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f04d6b-c17d-40f4-8dc4-d5c04ed77d12 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:38.614482 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f04d6b-c17d-40f4-8dc4-d5c04ed77d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:38.643838 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d3f04d6b-c17d-40f4-8dc4-d5c04ed77d12 None None] MFA Rules not processed for user `926fb7a255874ed887985baa032f21f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:38.645774 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d3f04d6b-c17d-40f4-8dc4-d5c04ed77d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:38.713705 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1292/2581] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:21:38.718371 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0145ea-721d-4907-9c3a-eacf24dfde19 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:38.779974 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0145ea-721d-4907-9c3a-eacf24dfde19 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:38.785230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b87f5-48a3-406c-8d64-ef2401c4e34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:38.785826 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b87f5-48a3-406c-8d64-ef2401c4e34e admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:38.786099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b87f5-48a3-406c-8d64-ef2401c4e34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:38.786363 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b87f5-48a3-406c-8d64-ef2401c4e34e admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:38.786995 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b87f5-48a3-406c-8d64-ef2401c4e34e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:38.788870 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b87f5-48a3-406c-8d64-ef2401c4e34e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:38.816153 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1290/2582] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:21:38 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:21:38.820295 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f04d6b-c17d-40f4-8dc4-d5c04ed77d12 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:38.834911 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f04d6b-c17d-40f4-8dc4-d5c04ed77d12 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:38.880011 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:38.899060 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00e044-856f-47ad-ba6e-eaf1e434f416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:38.900070 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00e044-856f-47ad-ba6e-eaf1e434f416 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:38.900564 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00e044-856f-47ad-ba6e-eaf1e434f416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:38.901060 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00e044-856f-47ad-ba6e-eaf1e434f416 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:38.902253 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a00e044-856f-47ad-ba6e-eaf1e434f416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:38.904465 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a00e044-856f-47ad-ba6e-eaf1e434f416 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:38.930779 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1293/2583] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:21:38 2022] POST /identity/v3/users => generated 298 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:21:38.934808 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b87f5-48a3-406c-8d64-ef2401c4e34e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:38.945163 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b87f5-48a3-406c-8d64-ef2401c4e34e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:38.950905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eec393-3a57-44d3-883a-f1b4d62811b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:38.951878 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eec393-3a57-44d3-883a-f1b4d62811b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:38.952376 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eec393-3a57-44d3-883a-f1b4d62811b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:38.952864 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eec393-3a57-44d3-883a-f1b4d62811b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:38.954056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eec393-3a57-44d3-883a-f1b4d62811b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:38.956635 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eec393-3a57-44d3-883a-f1b4d62811b4 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:38.969190 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1291/2584] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:21:38.973624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00e044-856f-47ad-ba6e-eaf1e434f416 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:38.983696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00e044-856f-47ad-ba6e-eaf1e434f416 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:38.988983 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e72874-188d-41b4-a87d-dd91493d9190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:38.989664 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e72874-188d-41b4-a87d-dd91493d9190 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:38.989945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e72874-188d-41b4-a87d-dd91493d9190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:38.990217 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e72874-188d-41b4-a87d-dd91493d9190 admin admin] PATH_INFO: `/v3/projects/1732ef55d42248c5ad16260e5ab5abb6/users/d06a922a6dbb49b8a8c4fc1b62a16d02/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:39.005490 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e72874-188d-41b4-a87d-dd91493d9190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1732ef55d42248c5ad16260e5ab5abb6, user_id=d06a922a6dbb49b8a8c4fc1b62a16d02, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:39.008195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e72874-188d-41b4-a87d-dd91493d9190 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:39.021277 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1294/2585] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:21:38 2022] PUT /identity/v3/projects/1732ef55d42248c5ad16260e5ab5abb6/users/d06a922a6dbb49b8a8c4fc1b62a16d02/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:21:39.025313 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eec393-3a57-44d3-883a-f1b4d62811b4 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:39.037960 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eec393-3a57-44d3-883a-f1b4d62811b4 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:39.070345 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:39.096936 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffeda4-e3b4-46a9-88c9-d5e3314daf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:39.097558 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffeda4-e3b4-46a9-88c9-d5e3314daf3f admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:39.097838 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffeda4-e3b4-46a9-88c9-d5e3314daf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:39.098106 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffeda4-e3b4-46a9-88c9-d5e3314daf3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:39.098761 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ffeda4-e3b4-46a9-88c9-d5e3314daf3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:39.100327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ffeda4-e3b4-46a9-88c9-d5e3314daf3f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:39.109854 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1292/2586] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:21:39.113900 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e72874-188d-41b4-a87d-dd91493d9190 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:39.124155 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e72874-188d-41b4-a87d-dd91493d9190 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:39.128784 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee742d96-bab8-42bc-a398-5559fca2d7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:39.129532 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee742d96-bab8-42bc-a398-5559fca2d7f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:39.129810 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee742d96-bab8-42bc-a398-5559fca2d7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:39.130080 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee742d96-bab8-42bc-a398-5559fca2d7f7 admin admin] PATH_INFO: `/v3/projects/1732ef55d42248c5ad16260e5ab5abb6/users/d06a922a6dbb49b8a8c4fc1b62a16d02/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:39.131984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee742d96-bab8-42bc-a398-5559fca2d7f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1732ef55d42248c5ad16260e5ab5abb6, user_id=d06a922a6dbb49b8a8c4fc1b62a16d02, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:39.134650 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee742d96-bab8-42bc-a398-5559fca2d7f7 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:39.145295 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1295/2587] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:21:39 2022] PUT /identity/v3/projects/1732ef55d42248c5ad16260e5ab5abb6/users/d06a922a6dbb49b8a8c4fc1b62a16d02/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:39.155582 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819a6e7-35d7-4996-b1ba-633241dcf584 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:39.155890 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819a6e7-35d7-4996-b1ba-633241dcf584 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:39.156161 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819a6e7-35d7-4996-b1ba-633241dcf584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:39.184415 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-4819a6e7-35d7-4996-b1ba-633241dcf584 None None] MFA Rules not processed for user `d06a922a6dbb49b8a8c4fc1b62a16d02`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:39.185676 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4819a6e7-35d7-4996-b1ba-633241dcf584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:39.253323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1293/2588] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:39 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:39.265303 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee742d96-bab8-42bc-a398-5559fca2d7f7 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:39.266980 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ee742d96-bab8-42bc-a398-5559fca2d7f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:39.326501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee742d96-bab8-42bc-a398-5559fca2d7f7 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:39.330118 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e62c0-8d84-4bdd-ae0f-5847d66d339b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:39.331251 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e62c0-8d84-4bdd-ae0f-5847d66d339b service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:39.331527 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e62c0-8d84-4bdd-ae0f-5847d66d339b service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:39.331836 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e62c0-8d84-4bdd-ae0f-5847d66d339b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:39.340841 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e62c0-8d84-4bdd-ae0f-5847d66d339b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:39.342323 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e62c0-8d84-4bdd-ae0f-5847d66d339b service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:39.352255 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1296/2589] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:21:39 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:21:39.441681 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819a6e7-35d7-4996-b1ba-633241dcf584 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:39.451148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819a6e7-35d7-4996-b1ba-633241dcf584 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:39.454733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b609caa-0d5b-446b-91f4-1ca54fd93f6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:39.455326 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b609caa-0d5b-446b-91f4-1ca54fd93f6a service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:39.456157 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b609caa-0d5b-446b-91f4-1ca54fd93f6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:39.456427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b609caa-0d5b-446b-91f4-1ca54fd93f6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:39.512610 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b609caa-0d5b-446b-91f4-1ca54fd93f6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:39.514013 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b609caa-0d5b-446b-91f4-1ca54fd93f6a service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:39.523348 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1294/2590] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:21:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:21:39.782747 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e62c0-8d84-4bdd-ae0f-5847d66d339b service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:39.843820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e62c0-8d84-4bdd-ae0f-5847d66d339b service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:39.848279 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961078e-7c97-4bc2-a9e3-d0a0cea26669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:39.848881 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961078e-7c97-4bc2-a9e3-d0a0cea26669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:39.849184 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961078e-7c97-4bc2-a9e3-d0a0cea26669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:39.849450 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961078e-7c97-4bc2-a9e3-d0a0cea26669 admin admin] PATH_INFO: `/v3/users/926fb7a255874ed887985baa032f21f3` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:39.850549 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961078e-7c97-4bc2-a9e3-d0a0cea26669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=926fb7a255874ed887985baa032f21f3)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:39.852441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961078e-7c97-4bc2-a9e3-d0a0cea26669 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:39.892412 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:39.899856 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7961078e-7c97-4bc2-a9e3-d0a0cea26669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '926fb7a255874ed887985baa032f21f3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:39.907497 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7961078e-7c97-4bc2-a9e3-d0a0cea26669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '926fb7a255874ed887985baa032f21f3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:39.919807 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7961078e-7c97-4bc2-a9e3-d0a0cea26669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '926fb7a255874ed887985baa032f21f3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:39.920536 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7961078e-7c97-4bc2-a9e3-d0a0cea26669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '926fb7a255874ed887985baa032f21f3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:39.927898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7961078e-7c97-4bc2-a9e3-d0a0cea26669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '926fb7a255874ed887985baa032f21f3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:39.933667 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1297/2591] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:21:39 2022] DELETE /identity/v3/users/926fb7a255874ed887985baa032f21f3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:39.938111 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75862a-e3cf-4891-b91c-1a5a206c36f4 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:39.938398 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75862a-e3cf-4891-b91c-1a5a206c36f4 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:39.938673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75862a-e3cf-4891-b91c-1a5a206c36f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:39.957994 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-eb75862a-e3cf-4891-b91c-1a5a206c36f4 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:39.959198 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-eb75862a-e3cf-4891-b91c-1a5a206c36f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:40.006472 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:40.017922 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1295/2592] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:40.027655 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961078e-7c97-4bc2-a9e3-d0a0cea26669 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:40.029090 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7961078e-7c97-4bc2-a9e3-d0a0cea26669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:40.086452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961078e-7c97-4bc2-a9e3-d0a0cea26669 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:40.090077 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa342d03-2ee6-4d5e-a8fc-5725ef7cc8c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:40.090698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa342d03-2ee6-4d5e-a8fc-5725ef7cc8c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:40.091003 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa342d03-2ee6-4d5e-a8fc-5725ef7cc8c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:40.091268 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa342d03-2ee6-4d5e-a8fc-5725ef7cc8c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:40.100135 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa342d03-2ee6-4d5e-a8fc-5725ef7cc8c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:40.101582 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa342d03-2ee6-4d5e-a8fc-5725ef7cc8c9 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:40.110780 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1298/2593] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:21:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:21:40.370088 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75862a-e3cf-4891-b91c-1a5a206c36f4 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:40.371547 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-eb75862a-e3cf-4891-b91c-1a5a206c36f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:40.383353 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75862a-e3cf-4891-b91c-1a5a206c36f4 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:40.388493 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffaf6e-b2cf-4cb0-bf0c-6ff827b59c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:40.389150 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffaf6e-b2cf-4cb0-bf0c-6ff827b59c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:40.389434 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffaf6e-b2cf-4cb0-bf0c-6ff827b59c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:40.389762 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffaf6e-b2cf-4cb0-bf0c-6ff827b59c8b admin admin] PATH_INFO: `/v3/projects/d6bf4ae94a9747c899a66af417ea0a00` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:40.390898 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fffaf6e-b2cf-4cb0-bf0c-6ff827b59c8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6bf4ae94a9747c899a66af417ea0a00)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:40.392847 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fffaf6e-b2cf-4cb0-bf0c-6ff827b59c8b admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:40.440349 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7fffaf6e-b2cf-4cb0-bf0c-6ff827b59c8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6bf4ae94a9747c899a66af417ea0a00', 'request_id': 'req-7fffaf6e-b2cf-4cb0-bf0c-6ff827b59c8b'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:40.447404 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7fffaf6e-b2cf-4cb0-bf0c-6ff827b59c8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6bf4ae94a9747c899a66af417ea0a00', 'request_id': 'req-7fffaf6e-b2cf-4cb0-bf0c-6ff827b59c8b'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:40.453024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7fffaf6e-b2cf-4cb0-bf0c-6ff827b59c8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6bf4ae94a9747c899a66af417ea0a00', 'request_id': 'req-7fffaf6e-b2cf-4cb0-bf0c-6ff827b59c8b'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:40.464112 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7fffaf6e-b2cf-4cb0-bf0c-6ff827b59c8b admin admin] The token cache is being invalidate because project d6bf4ae94a9747c899a66af417ea0a00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:21:40.464403 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7fffaf6e-b2cf-4cb0-bf0c-6ff827b59c8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:40.465039 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7fffaf6e-b2cf-4cb0-bf0c-6ff827b59c8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:40.466545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1296/2594] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:21:40 2022] DELETE /identity/v3/projects/d6bf4ae94a9747c899a66af417ea0a00 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:40.470633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa342d03-2ee6-4d5e-a8fc-5725ef7cc8c9 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:40.481138 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa342d03-2ee6-4d5e-a8fc-5725ef7cc8c9 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:40.536250 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1f62c-0ed8-4f23-9016-256500fad9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:40.536866 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1f62c-0ed8-4f23-9016-256500fad9e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:40.537169 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1f62c-0ed8-4f23-9016-256500fad9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:40.537443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1f62c-0ed8-4f23-9016-256500fad9e9 admin admin] PATH_INFO: `/v3/users/d06a922a6dbb49b8a8c4fc1b62a16d02` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:40.538555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1f62c-0ed8-4f23-9016-256500fad9e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d06a922a6dbb49b8a8c4fc1b62a16d02)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:40.540465 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1f62c-0ed8-4f23-9016-256500fad9e9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:40.586981 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-cdb1f62c-0ed8-4f23-9016-256500fad9e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd06a922a6dbb49b8a8c4fc1b62a16d02'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:40.594254 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-cdb1f62c-0ed8-4f23-9016-256500fad9e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd06a922a6dbb49b8a8c4fc1b62a16d02'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:40.600238 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:40.608587 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-cdb1f62c-0ed8-4f23-9016-256500fad9e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd06a922a6dbb49b8a8c4fc1b62a16d02'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:40.609421 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-cdb1f62c-0ed8-4f23-9016-256500fad9e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd06a922a6dbb49b8a8c4fc1b62a16d02'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:40.616697 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-cdb1f62c-0ed8-4f23-9016-256500fad9e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd06a922a6dbb49b8a8c4fc1b62a16d02'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:40.622940 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1299/2595] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:21:40 2022] DELETE /identity/v3/users/d06a922a6dbb49b8a8c4fc1b62a16d02 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:40.891058 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffaf6e-b2cf-4cb0-bf0c-6ff827b59c8b admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:40.892576 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7fffaf6e-b2cf-4cb0-bf0c-6ff827b59c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:40.906829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffaf6e-b2cf-4cb0-bf0c-6ff827b59c8b admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:40.963463 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831b698-9f8b-4a7e-82c1-283678f19e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:40.964083 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831b698-9f8b-4a7e-82c1-283678f19e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:40.964356 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831b698-9f8b-4a7e-82c1-283678f19e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:40.964645 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831b698-9f8b-4a7e-82c1-283678f19e7f admin admin] PATH_INFO: `/v3/projects/1732ef55d42248c5ad16260e5ab5abb6` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:40.965754 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a831b698-9f8b-4a7e-82c1-283678f19e7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1732ef55d42248c5ad16260e5ab5abb6)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:40.967644 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a831b698-9f8b-4a7e-82c1-283678f19e7f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:41.013381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a831b698-9f8b-4a7e-82c1-283678f19e7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1732ef55d42248c5ad16260e5ab5abb6', 'request_id': 'req-a831b698-9f8b-4a7e-82c1-283678f19e7f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:41.020939 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a831b698-9f8b-4a7e-82c1-283678f19e7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1732ef55d42248c5ad16260e5ab5abb6', 'request_id': 'req-a831b698-9f8b-4a7e-82c1-283678f19e7f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:41.026827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a831b698-9f8b-4a7e-82c1-283678f19e7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1732ef55d42248c5ad16260e5ab5abb6', 'request_id': 'req-a831b698-9f8b-4a7e-82c1-283678f19e7f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:41.038272 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a831b698-9f8b-4a7e-82c1-283678f19e7f admin admin] The token cache is being invalidate because project 1732ef55d42248c5ad16260e5ab5abb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:21:41.038557 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a831b698-9f8b-4a7e-82c1-283678f19e7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:41.039185 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a831b698-9f8b-4a7e-82c1-283678f19e7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:41.040690 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1297/2596] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:21:40 2022] DELETE /identity/v3/projects/1732ef55d42248c5ad16260e5ab5abb6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:41.045734 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c3e59-a94b-485b-a6d5-59ab1c29758e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:41.046020 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c3e59-a94b-485b-a6d5-59ab1c29758e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:41.046297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c3e59-a94b-485b-a6d5-59ab1c29758e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:41.065854 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-107c3e59-a94b-485b-a6d5-59ab1c29758e None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:41.067046 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-107c3e59-a94b-485b-a6d5-59ab1c29758e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:41.124696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1300/2597] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:41.132956 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e99025-1be8-4797-9924-8a68abc9887d None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:41.133354 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e99025-1be8-4797-9924-8a68abc9887d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:41.133624 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e99025-1be8-4797-9924-8a68abc9887d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:41.153471 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-78e99025-1be8-4797-9924-8a68abc9887d None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:41.154666 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-78e99025-1be8-4797-9924-8a68abc9887d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:41.162757 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1298/2598] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:41.166891 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c3e59-a94b-485b-a6d5-59ab1c29758e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:41.176430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c3e59-a94b-485b-a6d5-59ab1c29758e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:41.180906 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf41455-db74-4059-8f95-dc82366ee166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:41.181516 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf41455-db74-4059-8f95-dc82366ee166 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:41.181792 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf41455-db74-4059-8f95-dc82366ee166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:41.182057 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf41455-db74-4059-8f95-dc82366ee166 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:41.182688 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf41455-db74-4059-8f95-dc82366ee166 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:21:41.182982 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf41455-db74-4059-8f95-dc82366ee166 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:41.184555 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf41455-db74-4059-8f95-dc82366ee166 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:41.197004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1301/2599] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:21:41.201355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e99025-1be8-4797-9924-8a68abc9887d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:41.206214 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:41.212584 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e99025-1be8-4797-9924-8a68abc9887d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:41.217878 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e50dd-98b3-446f-a536-c716c3a576ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:41.218480 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e50dd-98b3-446f-a536-c716c3a576ed admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:41.218753 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e50dd-98b3-446f-a536-c716c3a576ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:41.219020 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e50dd-98b3-446f-a536-c716c3a576ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:41.219632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e50dd-98b3-446f-a536-c716c3a576ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:41.221556 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e50dd-98b3-446f-a536-c716c3a576ed admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:41.247514 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1299/2600] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:21:41 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:21:41.251528 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf41455-db74-4059-8f95-dc82366ee166 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:41.261747 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf41455-db74-4059-8f95-dc82366ee166 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:41.316745 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2874a9d-6783-4062-976b-bcf9c446ade9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:41.317381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2874a9d-6783-4062-976b-bcf9c446ade9 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:41.317663 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2874a9d-6783-4062-976b-bcf9c446ade9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:41.317929 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2874a9d-6783-4062-976b-bcf9c446ade9 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:41.318557 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2874a9d-6783-4062-976b-bcf9c446ade9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:41.320460 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2874a9d-6783-4062-976b-bcf9c446ade9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:41.343241 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1302/2601] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:21:41 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:21:41.347626 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e50dd-98b3-446f-a536-c716c3a576ed admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:41.357982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e50dd-98b3-446f-a536-c716c3a576ed admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:41.363323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148c4f4-fef6-4aee-9405-a84c203b1cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:41.363924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148c4f4-fef6-4aee-9405-a84c203b1cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:41.364206 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148c4f4-fef6-4aee-9405-a84c203b1cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:41.364509 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148c4f4-fef6-4aee-9405-a84c203b1cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:41.365192 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148c4f4-fef6-4aee-9405-a84c203b1cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:41.366911 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148c4f4-fef6-4aee-9405-a84c203b1cb6 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:41.389723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1300/2602] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:21:41.393712 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2874a9d-6783-4062-976b-bcf9c446ade9 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:41.404144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2874a9d-6783-4062-976b-bcf9c446ade9 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:41.408919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3201d-15c0-40db-ad8a-bc484fb3fa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:41.409540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3201d-15c0-40db-ad8a-bc484fb3fa0c admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:41.409815 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3201d-15c0-40db-ad8a-bc484fb3fa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:41.410080 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3201d-15c0-40db-ad8a-bc484fb3fa0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:41.410710 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3201d-15c0-40db-ad8a-bc484fb3fa0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:41.412291 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3201d-15c0-40db-ad8a-bc484fb3fa0c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:41.423260 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1303/2603] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:21:41.427873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148c4f4-fef6-4aee-9405-a84c203b1cb6 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:41.437624 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148c4f4-fef6-4aee-9405-a84c203b1cb6 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:41.442818 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4806a61-9bea-46d6-b962-be8279c4d6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:41.443444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4806a61-9bea-46d6-b962-be8279c4d6b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:41.443718 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4806a61-9bea-46d6-b962-be8279c4d6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:41.443984 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4806a61-9bea-46d6-b962-be8279c4d6b5 admin admin] PATH_INFO: `/v3/projects/b121efd939ac4d5c8a6c1f2a815d0744/users/5c6d039cc04145e2a168d5c964d5e08e/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:41.458981 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4806a61-9bea-46d6-b962-be8279c4d6b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b121efd939ac4d5c8a6c1f2a815d0744, user_id=5c6d039cc04145e2a168d5c964d5e08e, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:41.461663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4806a61-9bea-46d6-b962-be8279c4d6b5 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:41.474543 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1301/2604] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:21:41 2022] PUT /identity/v3/projects/b121efd939ac4d5c8a6c1f2a815d0744/users/5c6d039cc04145e2a168d5c964d5e08e/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:41.539884 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50486085-2e6a-459e-b117-81d398d14a63 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:41.540481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50486085-2e6a-459e-b117-81d398d14a63 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:41.540481 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50486085-2e6a-459e-b117-81d398d14a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:41.568478 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-50486085-2e6a-459e-b117-81d398d14a63 None None] MFA Rules not processed for user `5c6d039cc04145e2a168d5c964d5e08e`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:41.569691 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-50486085-2e6a-459e-b117-81d398d14a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:41.601331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:41.635029 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1304/2605] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:41.639505 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4806a61-9bea-46d6-b962-be8279c4d6b5 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:41.823332 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4806a61-9bea-46d6-b962-be8279c4d6b5 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:41.828148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684a639-87ca-4145-8707-3bc8ba4f7c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:41.828746 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684a639-87ca-4145-8707-3bc8ba4f7c44 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:41.829024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684a639-87ca-4145-8707-3bc8ba4f7c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:41.829316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684a639-87ca-4145-8707-3bc8ba4f7c44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:41.829948 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684a639-87ca-4145-8707-3bc8ba4f7c44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:41.831877 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684a639-87ca-4145-8707-3bc8ba4f7c44 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:41.857990 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1302/2606] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:21:41 2022] POST /identity/v3/projects => generated 383 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:21:41.862678 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50486085-2e6a-459e-b117-81d398d14a63 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:41.873088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50486085-2e6a-459e-b117-81d398d14a63 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:41.927457 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c2757-5691-41e9-aa76-a0b7edebfee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:41.928044 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c2757-5691-41e9-aa76-a0b7edebfee5 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:41.928319 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c2757-5691-41e9-aa76-a0b7edebfee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:41.928584 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c2757-5691-41e9-aa76-a0b7edebfee5 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:41.929231 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c2757-5691-41e9-aa76-a0b7edebfee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:41.931123 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c2757-5691-41e9-aa76-a0b7edebfee5 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:41.951647 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1305/2607] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:21:41 2022] POST /identity/v3/users => generated 298 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:21:41.955642 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684a639-87ca-4145-8707-3bc8ba4f7c44 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:41.965770 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684a639-87ca-4145-8707-3bc8ba4f7c44 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:41.970356 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3c968-b90c-4853-8cf0-9c3a44c7bd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:41.970999 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3c968-b90c-4853-8cf0-9c3a44c7bd21 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:41.971829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3c968-b90c-4853-8cf0-9c3a44c7bd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:41.972097 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3c968-b90c-4853-8cf0-9c3a44c7bd21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:41.972736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3c968-b90c-4853-8cf0-9c3a44c7bd21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:41.974445 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3c968-b90c-4853-8cf0-9c3a44c7bd21 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:41.984973 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1303/2608] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:21:41.989713 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c2757-5691-41e9-aa76-a0b7edebfee5 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:41.999368 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c2757-5691-41e9-aa76-a0b7edebfee5 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:42.003902 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b41c6-ec05-4f83-9553-b038d6143eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:42.004539 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b41c6-ec05-4f83-9553-b038d6143eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:42.004832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b41c6-ec05-4f83-9553-b038d6143eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:42.005112 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b41c6-ec05-4f83-9553-b038d6143eb7 admin admin] PATH_INFO: `/v3/projects/5f12cd14755e463782c8bceb686147cc/users/70833b0542ba4605a4c0caf8b5b3c0b1/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:42.019392 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b41c6-ec05-4f83-9553-b038d6143eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f12cd14755e463782c8bceb686147cc, user_id=70833b0542ba4605a4c0caf8b5b3c0b1, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:42.022067 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b41c6-ec05-4f83-9553-b038d6143eb7 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:42.036325 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1306/2609] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:21:41 2022] PUT /identity/v3/projects/5f12cd14755e463782c8bceb686147cc/users/70833b0542ba4605a4c0caf8b5b3c0b1/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:42.040286 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3c968-b90c-4853-8cf0-9c3a44c7bd21 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:42.050798 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3c968-b90c-4853-8cf0-9c3a44c7bd21 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:42.110398 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f87e68-464e-488d-80e7-37158a02f550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:42.110907 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f87e68-464e-488d-80e7-37158a02f550 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:42.111178 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f87e68-464e-488d-80e7-37158a02f550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:42.111441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f87e68-464e-488d-80e7-37158a02f550 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:42.112069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f87e68-464e-488d-80e7-37158a02f550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:42.113673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f87e68-464e-488d-80e7-37158a02f550 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:42.123061 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1304/2610] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:21:42.127186 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b41c6-ec05-4f83-9553-b038d6143eb7 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:42.137172 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b41c6-ec05-4f83-9553-b038d6143eb7 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:42.141729 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3e878-5b6f-406c-b0c9-34a2a2aaa0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:42.142363 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3e878-5b6f-406c-b0c9-34a2a2aaa0a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:42.142635 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3e878-5b6f-406c-b0c9-34a2a2aaa0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:42.143397 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3e878-5b6f-406c-b0c9-34a2a2aaa0a4 admin admin] PATH_INFO: `/v3/projects/5f12cd14755e463782c8bceb686147cc/users/70833b0542ba4605a4c0caf8b5b3c0b1/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:42.145322 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3e878-5b6f-406c-b0c9-34a2a2aaa0a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f12cd14755e463782c8bceb686147cc, user_id=70833b0542ba4605a4c0caf8b5b3c0b1, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:42.147927 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3e878-5b6f-406c-b0c9-34a2a2aaa0a4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:42.158058 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1307/2611] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:21:42 2022] PUT /identity/v3/projects/5f12cd14755e463782c8bceb686147cc/users/70833b0542ba4605a4c0caf8b5b3c0b1/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:21:42.168739 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c6a0e-004b-4f70-993c-83a7843f204a None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:42.169018 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c6a0e-004b-4f70-993c-83a7843f204a None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:42.169337 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c6a0e-004b-4f70-993c-83a7843f204a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:42.197395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-863c6a0e-004b-4f70-993c-83a7843f204a None None] MFA Rules not processed for user `70833b0542ba4605a4c0caf8b5b3c0b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:42.198619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-863c6a0e-004b-4f70-993c-83a7843f204a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:42.202509 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:42.265723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1305/2612] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:42.276786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3e878-5b6f-406c-b0c9-34a2a2aaa0a4 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:42.278924 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-54f3e878-5b6f-406c-b0c9-34a2a2aaa0a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:42.336206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3e878-5b6f-406c-b0c9-34a2a2aaa0a4 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:42.339808 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa6a88-be0f-4907-be82-d0592478357f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:42.340393 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa6a88-be0f-4907-be82-d0592478357f service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:42.340665 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa6a88-be0f-4907-be82-d0592478357f service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:42.340928 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa6a88-be0f-4907-be82-d0592478357f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:42.381213 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:42.398701 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa6a88-be0f-4907-be82-d0592478357f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:42.400143 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa6a88-be0f-4907-be82-d0592478357f service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:42.409825 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1308/2613] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:21:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:21:46.621114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c6a0e-004b-4f70-993c-83a7843f204a None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:46.622557 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-863c6a0e-004b-4f70-993c-83a7843f204a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:46.635182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c6a0e-004b-4f70-993c-83a7843f204a None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:46.638706 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382aa043-fad4-4667-aa92-f968b8fd6846 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:46.639298 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382aa043-fad4-4667-aa92-f968b8fd6846 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:46.639575 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382aa043-fad4-4667-aa92-f968b8fd6846 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:46.639847 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382aa043-fad4-4667-aa92-f968b8fd6846 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:46.648568 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382aa043-fad4-4667-aa92-f968b8fd6846 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:46.650029 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382aa043-fad4-4667-aa92-f968b8fd6846 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:46.659516 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1306/2614] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:21:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:21:51.538412 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa6a88-be0f-4907-be82-d0592478357f service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:51.599054 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa6a88-be0f-4907-be82-d0592478357f service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:51.603610 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe383442-6851-420c-8331-b50ead5a1f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:51.604218 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe383442-6851-420c-8331-b50ead5a1f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:51.604494 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe383442-6851-420c-8331-b50ead5a1f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:51.604765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe383442-6851-420c-8331-b50ead5a1f43 admin admin] PATH_INFO: `/v3/users/5c6d039cc04145e2a168d5c964d5e08e` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:51.605899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe383442-6851-420c-8331-b50ead5a1f43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c6d039cc04145e2a168d5c964d5e08e)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:51.607809 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe383442-6851-420c-8331-b50ead5a1f43 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:51.653307 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fe383442-6851-420c-8331-b50ead5a1f43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c6d039cc04145e2a168d5c964d5e08e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:51.660640 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fe383442-6851-420c-8331-b50ead5a1f43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c6d039cc04145e2a168d5c964d5e08e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:51.672303 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fe383442-6851-420c-8331-b50ead5a1f43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c6d039cc04145e2a168d5c964d5e08e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:51.672925 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fe383442-6851-420c-8331-b50ead5a1f43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c6d039cc04145e2a168d5c964d5e08e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:51.679973 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fe383442-6851-420c-8331-b50ead5a1f43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c6d039cc04145e2a168d5c964d5e08e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:51.686045 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1309/2615] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:21:51 2022] DELETE /identity/v3/users/5c6d039cc04145e2a168d5c964d5e08e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:51.691392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad6a64-7464-4e73-9d1c-545ceaa49988 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:51.691842 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad6a64-7464-4e73-9d1c-545ceaa49988 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:51.691922 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad6a64-7464-4e73-9d1c-545ceaa49988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:51.710912 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-00ad6a64-7464-4e73-9d1c-545ceaa49988 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:51.712081 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-00ad6a64-7464-4e73-9d1c-545ceaa49988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:51.767702 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1307/2616] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:51.777860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe383442-6851-420c-8331-b50ead5a1f43 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:51.779253 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fe383442-6851-420c-8331-b50ead5a1f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:51.836459 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe383442-6851-420c-8331-b50ead5a1f43 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:51.840148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde0faf-b736-4fa5-a43b-dbbab703ac67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:51.840746 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde0faf-b736-4fa5-a43b-dbbab703ac67 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:51.841024 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde0faf-b736-4fa5-a43b-dbbab703ac67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:51.841327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde0faf-b736-4fa5-a43b-dbbab703ac67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:51.850204 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde0faf-b736-4fa5-a43b-dbbab703ac67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:51.851630 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde0faf-b736-4fa5-a43b-dbbab703ac67 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:51.860899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1310/2617] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:21:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:21:52.124984 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad6a64-7464-4e73-9d1c-545ceaa49988 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:52.126652 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-00ad6a64-7464-4e73-9d1c-545ceaa49988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:52.143081 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad6a64-7464-4e73-9d1c-545ceaa49988 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:52.147695 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702eb4b-82e9-4976-aa61-823be623c37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:52.148327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702eb4b-82e9-4976-aa61-823be623c37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:52.148605 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702eb4b-82e9-4976-aa61-823be623c37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:52.149016 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702eb4b-82e9-4976-aa61-823be623c37d admin admin] PATH_INFO: `/v3/projects/b121efd939ac4d5c8a6c1f2a815d0744` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:52.150031 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702eb4b-82e9-4976-aa61-823be623c37d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b121efd939ac4d5c8a6c1f2a815d0744)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:52.151967 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702eb4b-82e9-4976-aa61-823be623c37d admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:52.200387 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-1702eb4b-82e9-4976-aa61-823be623c37d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b121efd939ac4d5c8a6c1f2a815d0744', 'request_id': 'req-1702eb4b-82e9-4976-aa61-823be623c37d'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:52.207597 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-1702eb4b-82e9-4976-aa61-823be623c37d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b121efd939ac4d5c8a6c1f2a815d0744', 'request_id': 'req-1702eb4b-82e9-4976-aa61-823be623c37d'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:52.213378 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-1702eb4b-82e9-4976-aa61-823be623c37d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b121efd939ac4d5c8a6c1f2a815d0744', 'request_id': 'req-1702eb4b-82e9-4976-aa61-823be623c37d'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:52.225106 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-1702eb4b-82e9-4976-aa61-823be623c37d admin admin] The token cache is being invalidate because project b121efd939ac4d5c8a6c1f2a815d0744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:21:52.225399 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-1702eb4b-82e9-4976-aa61-823be623c37d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:52.226017 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-1702eb4b-82e9-4976-aa61-823be623c37d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:52.227467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1308/2618] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:21:52 2022] DELETE /identity/v3/projects/b121efd939ac4d5c8a6c1f2a815d0744 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:52.231432 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde0faf-b736-4fa5-a43b-dbbab703ac67 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:52.236189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:52.242669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde0faf-b736-4fa5-a43b-dbbab703ac67 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:52.300189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d8dc6-0bb8-436b-9773-69682b0a266c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:52.300815 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d8dc6-0bb8-436b-9773-69682b0a266c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:52.301111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d8dc6-0bb8-436b-9773-69682b0a266c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:52.301391 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d8dc6-0bb8-436b-9773-69682b0a266c admin admin] PATH_INFO: `/v3/users/70833b0542ba4605a4c0caf8b5b3c0b1` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:52.302567 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d8dc6-0bb8-436b-9773-69682b0a266c admin admin] RBAC: Authorizing `identity:delete_user(user_id=70833b0542ba4605a4c0caf8b5b3c0b1)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:52.304446 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d8dc6-0bb8-436b-9773-69682b0a266c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:52.350425 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-479d8dc6-0bb8-436b-9773-69682b0a266c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70833b0542ba4605a4c0caf8b5b3c0b1'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:52.357610 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-479d8dc6-0bb8-436b-9773-69682b0a266c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70833b0542ba4605a4c0caf8b5b3c0b1'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:52.370348 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-479d8dc6-0bb8-436b-9773-69682b0a266c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70833b0542ba4605a4c0caf8b5b3c0b1'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:52.370979 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-479d8dc6-0bb8-436b-9773-69682b0a266c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70833b0542ba4605a4c0caf8b5b3c0b1'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:52.377915 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-479d8dc6-0bb8-436b-9773-69682b0a266c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70833b0542ba4605a4c0caf8b5b3c0b1'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:52.383788 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1311/2619] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:21:52 2022] DELETE /identity/v3/users/70833b0542ba4605a4c0caf8b5b3c0b1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:52.645002 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702eb4b-82e9-4976-aa61-823be623c37d admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:52.646515 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1702eb4b-82e9-4976-aa61-823be623c37d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:52.660517 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702eb4b-82e9-4976-aa61-823be623c37d admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:52.669066 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:52.720440 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c8150-6469-4322-b0f4-1724c47def40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:52.721722 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c8150-6469-4322-b0f4-1724c47def40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:52.722020 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c8150-6469-4322-b0f4-1724c47def40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:52.722289 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c8150-6469-4322-b0f4-1724c47def40 admin admin] PATH_INFO: `/v3/projects/5f12cd14755e463782c8bceb686147cc` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:52.723467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c8150-6469-4322-b0f4-1724c47def40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f12cd14755e463782c8bceb686147cc)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:52.725483 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c8150-6469-4322-b0f4-1724c47def40 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:52.772227 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-609c8150-6469-4322-b0f4-1724c47def40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f12cd14755e463782c8bceb686147cc', 'request_id': 'req-609c8150-6469-4322-b0f4-1724c47def40'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:52.778705 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-609c8150-6469-4322-b0f4-1724c47def40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f12cd14755e463782c8bceb686147cc', 'request_id': 'req-609c8150-6469-4322-b0f4-1724c47def40'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:52.785129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-609c8150-6469-4322-b0f4-1724c47def40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f12cd14755e463782c8bceb686147cc', 'request_id': 'req-609c8150-6469-4322-b0f4-1724c47def40'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:52.796107 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-609c8150-6469-4322-b0f4-1724c47def40 admin admin] The token cache is being invalidate because project 5f12cd14755e463782c8bceb686147cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:21:52.796399 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-609c8150-6469-4322-b0f4-1724c47def40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:52.797029 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-609c8150-6469-4322-b0f4-1724c47def40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:21:52.798531 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1309/2620] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:21:52 2022] DELETE /identity/v3/projects/5f12cd14755e463782c8bceb686147cc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:52.804489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478b8c6-ad7e-4edf-aa0d-09d222d10850 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:52.804976 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478b8c6-ad7e-4edf-aa0d-09d222d10850 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:52.805060 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478b8c6-ad7e-4edf-aa0d-09d222d10850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:52.825762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5478b8c6-ad7e-4edf-aa0d-09d222d10850 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:52.826978 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5478b8c6-ad7e-4edf-aa0d-09d222d10850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:52.885225 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1312/2621] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:52.895526 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f15fa-f865-4992-8213-405a58db35c9 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:52.895812 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f15fa-f865-4992-8213-405a58db35c9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:52.896081 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f15fa-f865-4992-8213-405a58db35c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:52.917208 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-140f15fa-f865-4992-8213-405a58db35c9 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:52.918389 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-140f15fa-f865-4992-8213-405a58db35c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:52.926300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1310/2622] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:52.930388 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478b8c6-ad7e-4edf-aa0d-09d222d10850 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:52.940095 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478b8c6-ad7e-4edf-aa0d-09d222d10850 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:52.944606 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1babf16f-818a-4d49-8465-2018da0971da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:52.945231 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babf16f-818a-4d49-8465-2018da0971da admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:52.945507 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babf16f-818a-4d49-8465-2018da0971da admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:52.945770 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babf16f-818a-4d49-8465-2018da0971da admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:52.946400 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1babf16f-818a-4d49-8465-2018da0971da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:21:52.946689 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1babf16f-818a-4d49-8465-2018da0971da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:52.948266 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1babf16f-818a-4d49-8465-2018da0971da admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:52.960296 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1313/2623] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:21:52.964530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f15fa-f865-4992-8213-405a58db35c9 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:52.974163 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f15fa-f865-4992-8213-405a58db35c9 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:52.978715 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a8f2b-69e9-4e95-b8dd-510b3bf7b981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:52.979290 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a8f2b-69e9-4e95-b8dd-510b3bf7b981 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:52.979561 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a8f2b-69e9-4e95-b8dd-510b3bf7b981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:52.979825 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a8f2b-69e9-4e95-b8dd-510b3bf7b981 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:52.980436 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a8f2b-69e9-4e95-b8dd-510b3bf7b981 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:52.982332 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a8f2b-69e9-4e95-b8dd-510b3bf7b981 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:53.009031 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1311/2624] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:21:52 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:21:53.013180 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1babf16f-818a-4d49-8465-2018da0971da admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:53.023801 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1babf16f-818a-4d49-8465-2018da0971da admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:53.028972 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:53.083928 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c80eb0-5eb9-4bad-9667-b9ab823002a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:53.084451 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c80eb0-5eb9-4bad-9667-b9ab823002a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:53.084731 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c80eb0-5eb9-4bad-9667-b9ab823002a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:53.085005 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c80eb0-5eb9-4bad-9667-b9ab823002a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:53.085660 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c80eb0-5eb9-4bad-9667-b9ab823002a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:53.087576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c80eb0-5eb9-4bad-9667-b9ab823002a3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:53.107851 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1314/2625] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:21:53 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:21:53.112021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a8f2b-69e9-4e95-b8dd-510b3bf7b981 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:53.122171 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a8f2b-69e9-4e95-b8dd-510b3bf7b981 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:53.126816 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf87e7-1a1f-4d14-8d99-6de62ae1f2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:53.127934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf87e7-1a1f-4d14-8d99-6de62ae1f2dd admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:53.128211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf87e7-1a1f-4d14-8d99-6de62ae1f2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:53.128478 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf87e7-1a1f-4d14-8d99-6de62ae1f2dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:53.129169 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf87e7-1a1f-4d14-8d99-6de62ae1f2dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:53.130756 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf87e7-1a1f-4d14-8d99-6de62ae1f2dd admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:53.141028 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1312/2626] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:21:53.145394 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c80eb0-5eb9-4bad-9667-b9ab823002a3 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:53.155442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c80eb0-5eb9-4bad-9667-b9ab823002a3 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:53.160543 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cc96e-d81d-4967-b567-60cd5815c311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:53.161165 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cc96e-d81d-4967-b567-60cd5815c311 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:53.161446 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cc96e-d81d-4967-b567-60cd5815c311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:53.161712 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cc96e-d81d-4967-b567-60cd5815c311 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:53.162374 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cc96e-d81d-4967-b567-60cd5815c311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:53.163972 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cc96e-d81d-4967-b567-60cd5815c311 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:53.174560 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1315/2627] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:21:53.178323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf87e7-1a1f-4d14-8d99-6de62ae1f2dd admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:53.188221 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf87e7-1a1f-4d14-8d99-6de62ae1f2dd admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:53.193503 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c082db7-4126-4d07-aefe-403d00875f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:53.194170 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c082db7-4126-4d07-aefe-403d00875f33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:53.194467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c082db7-4126-4d07-aefe-403d00875f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:53.194832 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c082db7-4126-4d07-aefe-403d00875f33 admin admin] PATH_INFO: `/v3/projects/39fc4cfb845c46f49dd70d61a2f7295a/users/2da2c5e80c814527a6e034b7df0eff62/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:53.210268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c082db7-4126-4d07-aefe-403d00875f33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39fc4cfb845c46f49dd70d61a2f7295a, user_id=2da2c5e80c814527a6e034b7df0eff62, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:53.212892 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c082db7-4126-4d07-aefe-403d00875f33 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:53.225220 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1313/2628] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:21:53 2022] PUT /identity/v3/projects/39fc4cfb845c46f49dd70d61a2f7295a/users/2da2c5e80c814527a6e034b7df0eff62/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:53.236319 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e08123-2717-4f24-bdfa-c6f97f5c20fd None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:53.236602 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e08123-2717-4f24-bdfa-c6f97f5c20fd None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:53.236874 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e08123-2717-4f24-bdfa-c6f97f5c20fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:53.264366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-80e08123-2717-4f24-bdfa-c6f97f5c20fd None None] MFA Rules not processed for user `2da2c5e80c814527a6e034b7df0eff62`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:53.265641 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-80e08123-2717-4f24-bdfa-c6f97f5c20fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:53.332981 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1316/2629] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:53.337699 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c082db7-4126-4d07-aefe-403d00875f33 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:53.389287 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:53.412142 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c082db7-4126-4d07-aefe-403d00875f33 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:53.417557 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e0a6c-27c3-434a-b93f-55514bf1fb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:53.418240 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e0a6c-27c3-434a-b93f-55514bf1fb1d admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:53.418568 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e0a6c-27c3-434a-b93f-55514bf1fb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:53.418883 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e0a6c-27c3-434a-b93f-55514bf1fb1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:53.419592 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e0a6c-27c3-434a-b93f-55514bf1fb1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:53.421670 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e0a6c-27c3-434a-b93f-55514bf1fb1d admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:53.448124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1314/2630] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:21:53 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:21:53.452386 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e08123-2717-4f24-bdfa-c6f97f5c20fd None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:53.463101 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e08123-2717-4f24-bdfa-c6f97f5c20fd None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:53.518900 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eecb6b-2768-4ff9-a22a-08b9485206a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:53.519521 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eecb6b-2768-4ff9-a22a-08b9485206a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:53.519800 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eecb6b-2768-4ff9-a22a-08b9485206a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:53.520066 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eecb6b-2768-4ff9-a22a-08b9485206a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:53.520686 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eecb6b-2768-4ff9-a22a-08b9485206a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:53.522685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eecb6b-2768-4ff9-a22a-08b9485206a4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:53.543391 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1317/2631] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:21:53 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:21:53.547469 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e0a6c-27c3-434a-b93f-55514bf1fb1d admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:53.559670 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e0a6c-27c3-434a-b93f-55514bf1fb1d admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:53.564241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666645e-99b3-4805-90bd-fe8429d90bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:53.565446 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666645e-99b3-4805-90bd-fe8429d90bec admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:53.565721 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666645e-99b3-4805-90bd-fe8429d90bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:53.565979 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666645e-99b3-4805-90bd-fe8429d90bec admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:53.566600 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666645e-99b3-4805-90bd-fe8429d90bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:53.568172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666645e-99b3-4805-90bd-fe8429d90bec admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:53.578482 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1315/2632] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:21:53.582460 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eecb6b-2768-4ff9-a22a-08b9485206a4 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:53.592740 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eecb6b-2768-4ff9-a22a-08b9485206a4 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:53.597287 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd0793-d0ab-4335-ac78-c49b9fc6c2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:53.597869 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd0793-d0ab-4335-ac78-c49b9fc6c2cf admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:53.598148 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd0793-d0ab-4335-ac78-c49b9fc6c2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:53.598419 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd0793-d0ab-4335-ac78-c49b9fc6c2cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:53.599069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd0793-d0ab-4335-ac78-c49b9fc6c2cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:53.600658 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd0793-d0ab-4335-ac78-c49b9fc6c2cf admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:53.601914 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:53.612870 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1318/2633] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:21:53.616677 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666645e-99b3-4805-90bd-fe8429d90bec admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:53.626791 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666645e-99b3-4805-90bd-fe8429d90bec admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:53.632001 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e12d74-59e1-4e36-9dd4-60879c58a0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:53.632633 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e12d74-59e1-4e36-9dd4-60879c58a0e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:53.632904 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e12d74-59e1-4e36-9dd4-60879c58a0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:53.633202 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e12d74-59e1-4e36-9dd4-60879c58a0e4 admin admin] PATH_INFO: `/v3/projects/30e89eadbbee407da86b718eee95d0ff/users/fd39b03b4e67436d86d3843ae6551480/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:53.647534 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e12d74-59e1-4e36-9dd4-60879c58a0e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30e89eadbbee407da86b718eee95d0ff, user_id=fd39b03b4e67436d86d3843ae6551480, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:53.650201 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e12d74-59e1-4e36-9dd4-60879c58a0e4 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:53.663015 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1316/2634] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:21:53 2022] PUT /identity/v3/projects/30e89eadbbee407da86b718eee95d0ff/users/fd39b03b4e67436d86d3843ae6551480/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:53.673504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfd961-8a0b-407b-9027-da3fac0918dd None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:53.675061 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfd961-8a0b-407b-9027-da3fac0918dd None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:53.675330 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfd961-8a0b-407b-9027-da3fac0918dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:53.704274 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-accfd961-8a0b-407b-9027-da3fac0918dd None None] MFA Rules not processed for user `fd39b03b4e67436d86d3843ae6551480`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:53.705543 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-accfd961-8a0b-407b-9027-da3fac0918dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:53.766879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1319/2635] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:53.771483 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e12d74-59e1-4e36-9dd4-60879c58a0e4 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:53.831866 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e12d74-59e1-4e36-9dd4-60879c58a0e4 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:53.836417 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a42ca-1edd-43c9-bc81-40d786dfe0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:53.837004 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a42ca-1edd-43c9-bc81-40d786dfe0be admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:53.837387 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a42ca-1edd-43c9-bc81-40d786dfe0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:53.837651 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a42ca-1edd-43c9-bc81-40d786dfe0be admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:53.838272 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a42ca-1edd-43c9-bc81-40d786dfe0be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:53.840145 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a42ca-1edd-43c9-bc81-40d786dfe0be admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:53.866934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1317/2636] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:21:53 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:21:53.871243 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfd961-8a0b-407b-9027-da3fac0918dd None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:53.882044 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfd961-8a0b-407b-9027-da3fac0918dd None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:53.936671 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce1a5b-23ee-42ee-9d1a-7d7d8ac6c80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:53.937289 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce1a5b-23ee-42ee-9d1a-7d7d8ac6c80d admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:53.937566 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce1a5b-23ee-42ee-9d1a-7d7d8ac6c80d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:53.937833 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce1a5b-23ee-42ee-9d1a-7d7d8ac6c80d admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:53.938453 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce1a5b-23ee-42ee-9d1a-7d7d8ac6c80d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:53.940413 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce1a5b-23ee-42ee-9d1a-7d7d8ac6c80d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:53.960730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1320/2637] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:21:53 2022] POST /identity/v3/users => generated 298 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:21:53.964618 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a42ca-1edd-43c9-bc81-40d786dfe0be admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:53.975195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a42ca-1edd-43c9-bc81-40d786dfe0be admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:53.979663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e88c5-a08c-45b7-b118-c98270717910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:53.980241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e88c5-a08c-45b7-b118-c98270717910 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:53.980511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e88c5-a08c-45b7-b118-c98270717910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:53.980774 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e88c5-a08c-45b7-b118-c98270717910 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:53.981464 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e88c5-a08c-45b7-b118-c98270717910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:53.983027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e88c5-a08c-45b7-b118-c98270717910 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:53.994387 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1318/2638] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:21:53.998212 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce1a5b-23ee-42ee-9d1a-7d7d8ac6c80d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:54.008053 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce1a5b-23ee-42ee-9d1a-7d7d8ac6c80d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:54.012624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf1c41-f723-495a-a6f8-e5ed66104923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:54.013284 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf1c41-f723-495a-a6f8-e5ed66104923 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:54.013561 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf1c41-f723-495a-a6f8-e5ed66104923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:54.013826 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf1c41-f723-495a-a6f8-e5ed66104923 admin admin] PATH_INFO: `/v3/projects/cbc379699ccd4ed3ba565fbbf2c8fe68/users/649958a631714ee0896f8322fd0318a6/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:54.028175 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf1c41-f723-495a-a6f8-e5ed66104923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc379699ccd4ed3ba565fbbf2c8fe68, user_id=649958a631714ee0896f8322fd0318a6, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:54.031127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf1c41-f723-495a-a6f8-e5ed66104923 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:54.044462 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1321/2639] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:21:53 2022] PUT /identity/v3/projects/cbc379699ccd4ed3ba565fbbf2c8fe68/users/649958a631714ee0896f8322fd0318a6/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:21:54.048217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e88c5-a08c-45b7-b118-c98270717910 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:54.058412 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e88c5-a08c-45b7-b118-c98270717910 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:54.113466 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd1d86-af2b-4cf8-989a-8ab3f41e61f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:54.114044 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd1d86-af2b-4cf8-989a-8ab3f41e61f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:54.114314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd1d86-af2b-4cf8-989a-8ab3f41e61f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:54.114580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd1d86-af2b-4cf8-989a-8ab3f41e61f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:54.115207 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd1d86-af2b-4cf8-989a-8ab3f41e61f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:54.116796 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd1d86-af2b-4cf8-989a-8ab3f41e61f6 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:54.118905 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:54.128907 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1319/2640] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:21:54.132825 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf1c41-f723-495a-a6f8-e5ed66104923 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:54.143688 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf1c41-f723-495a-a6f8-e5ed66104923 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:54.149980 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd6c9a-db69-4dc5-a7a3-88b8716c777a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:54.150765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd6c9a-db69-4dc5-a7a3-88b8716c777a admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:54.151052 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd6c9a-db69-4dc5-a7a3-88b8716c777a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:54.151327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd6c9a-db69-4dc5-a7a3-88b8716c777a admin admin] PATH_INFO: `/v3/projects/cbc379699ccd4ed3ba565fbbf2c8fe68/users/649958a631714ee0896f8322fd0318a6/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:54.153948 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd6c9a-db69-4dc5-a7a3-88b8716c777a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc379699ccd4ed3ba565fbbf2c8fe68, user_id=649958a631714ee0896f8322fd0318a6, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:54.156848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd6c9a-db69-4dc5-a7a3-88b8716c777a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:54.169975 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1322/2641] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:21:54 2022] PUT /identity/v3/projects/cbc379699ccd4ed3ba565fbbf2c8fe68/users/649958a631714ee0896f8322fd0318a6/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:21:54.180976 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa60df-ded1-48dd-901f-e036935dc708 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:54.181291 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa60df-ded1-48dd-901f-e036935dc708 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:54.181672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa60df-ded1-48dd-901f-e036935dc708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:54.209742 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-bfaa60df-ded1-48dd-901f-e036935dc708 None None] MFA Rules not processed for user `649958a631714ee0896f8322fd0318a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:21:54.211110 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-bfaa60df-ded1-48dd-901f-e036935dc708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:54.277981 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1320/2642] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:21:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:21:54.291077 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd6c9a-db69-4dc5-a7a3-88b8716c777a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:54.292785 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6cdd6c9a-db69-4dc5-a7a3-88b8716c777a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:54.334480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:54.351367 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd6c9a-db69-4dc5-a7a3-88b8716c777a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:54.354995 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fed15-5e89-43f7-a1c6-d718340220f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:54.355585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fed15-5e89-43f7-a1c6-d718340220f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:54.355862 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fed15-5e89-43f7-a1c6-d718340220f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:54.356129 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fed15-5e89-43f7-a1c6-d718340220f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:54.412400 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fed15-5e89-43f7-a1c6-d718340220f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:54.413820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fed15-5e89-43f7-a1c6-d718340220f3 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:54.422764 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1323/2643] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:21:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:21:55.912470 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa60df-ded1-48dd-901f-e036935dc708 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:55.913870 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-bfaa60df-ded1-48dd-901f-e036935dc708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:21:55.925748 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa60df-ded1-48dd-901f-e036935dc708 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:55.929251 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a747f4-b2ab-4b46-97cb-39e9068ab0d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:55.929829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a747f4-b2ab-4b46-97cb-39e9068ab0d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:55.930103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a747f4-b2ab-4b46-97cb-39e9068ab0d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:55.930369 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a747f4-b2ab-4b46-97cb-39e9068ab0d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:55.984785 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a747f4-b2ab-4b46-97cb-39e9068ab0d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:55.986217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a747f4-b2ab-4b46-97cb-39e9068ab0d0 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:55.994975 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1321/2644] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:21:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:21:56.527663 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fed15-5e89-43f7-a1c6-d718340220f3 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:21:56.536802 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fed15-5e89-43f7-a1c6-d718340220f3 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:21:56.540549 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e54d3-7395-4da1-bbbb-8f00d5e957f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:21:56.541168 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e54d3-7395-4da1-bbbb-8f00d5e957f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:21:56.541445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e54d3-7395-4da1-bbbb-8f00d5e957f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:21:56.541715 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e54d3-7395-4da1-bbbb-8f00d5e957f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:21:56.550965 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e54d3-7395-4da1-bbbb-8f00d5e957f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:21:56.552378 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e54d3-7395-4da1-bbbb-8f00d5e957f7 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:21:56.561614 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1324/2645] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:21:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:22:00.410597 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a747f4-b2ab-4b46-97cb-39e9068ab0d0 service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:00.472793 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a747f4-b2ab-4b46-97cb-39e9068ab0d0 service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:00.477271 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa525341-9640-4b1b-9b7f-a95de4766ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:00.477873 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa525341-9640-4b1b-9b7f-a95de4766ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:00.478145 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa525341-9640-4b1b-9b7f-a95de4766ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:00.478411 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa525341-9640-4b1b-9b7f-a95de4766ee5 admin admin] PATH_INFO: `/v3/users/2da2c5e80c814527a6e034b7df0eff62` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:00.479504 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa525341-9640-4b1b-9b7f-a95de4766ee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2da2c5e80c814527a6e034b7df0eff62)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:00.481428 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa525341-9640-4b1b-9b7f-a95de4766ee5 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:00.503212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:00.527704 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-fa525341-9640-4b1b-9b7f-a95de4766ee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2da2c5e80c814527a6e034b7df0eff62'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:00.536027 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-fa525341-9640-4b1b-9b7f-a95de4766ee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2da2c5e80c814527a6e034b7df0eff62'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:00.547769 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-fa525341-9640-4b1b-9b7f-a95de4766ee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2da2c5e80c814527a6e034b7df0eff62'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:00.548387 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-fa525341-9640-4b1b-9b7f-a95de4766ee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2da2c5e80c814527a6e034b7df0eff62'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:00.555735 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-fa525341-9640-4b1b-9b7f-a95de4766ee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2da2c5e80c814527a6e034b7df0eff62'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:00.561479 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1322/2646] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:22:00 2022] DELETE /identity/v3/users/2da2c5e80c814527a6e034b7df0eff62 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:00.565986 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4965e-6d34-4528-9dfb-ef718495064a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:00.566439 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4965e-6d34-4528-9dfb-ef718495064a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:00.566550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4965e-6d34-4528-9dfb-ef718495064a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:00.584991 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-cce4965e-6d34-4528-9dfb-ef718495064a None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:22:00.586215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cce4965e-6d34-4528-9dfb-ef718495064a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:00.647322 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1325/2647] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:22:00.657264 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa525341-9640-4b1b-9b7f-a95de4766ee5 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:00.659172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-fa525341-9640-4b1b-9b7f-a95de4766ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:00.715962 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa525341-9640-4b1b-9b7f-a95de4766ee5 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:00.719566 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0896559-ac51-4391-b030-57c3ccaa18c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:00.720153 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0896559-ac51-4391-b030-57c3ccaa18c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:00.720424 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0896559-ac51-4391-b030-57c3ccaa18c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:00.720690 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0896559-ac51-4391-b030-57c3ccaa18c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:00.730172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0896559-ac51-4391-b030-57c3ccaa18c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:00.731568 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0896559-ac51-4391-b030-57c3ccaa18c5 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:00.741391 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1323/2648] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:22:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:22:01.002366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4965e-6d34-4528-9dfb-ef718495064a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:01.003968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cce4965e-6d34-4528-9dfb-ef718495064a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:01.018547 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4965e-6d34-4528-9dfb-ef718495064a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:01.023940 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6612b-9655-4b1c-bf22-f19bf00043cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:01.024574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6612b-9655-4b1c-bf22-f19bf00043cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:01.024845 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6612b-9655-4b1c-bf22-f19bf00043cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:01.025137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6612b-9655-4b1c-bf22-f19bf00043cf admin admin] PATH_INFO: `/v3/projects/39fc4cfb845c46f49dd70d61a2f7295a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:01.026314 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6612b-9655-4b1c-bf22-f19bf00043cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=39fc4cfb845c46f49dd70d61a2f7295a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:01.028234 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6612b-9655-4b1c-bf22-f19bf00043cf admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:01.075215 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-72a6612b-9655-4b1c-bf22-f19bf00043cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39fc4cfb845c46f49dd70d61a2f7295a', 'request_id': 'req-72a6612b-9655-4b1c-bf22-f19bf00043cf'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:01.081920 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-72a6612b-9655-4b1c-bf22-f19bf00043cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39fc4cfb845c46f49dd70d61a2f7295a', 'request_id': 'req-72a6612b-9655-4b1c-bf22-f19bf00043cf'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:01.089386 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-72a6612b-9655-4b1c-bf22-f19bf00043cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39fc4cfb845c46f49dd70d61a2f7295a', 'request_id': 'req-72a6612b-9655-4b1c-bf22-f19bf00043cf'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:01.102338 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-72a6612b-9655-4b1c-bf22-f19bf00043cf admin admin] The token cache is being invalidate because project 39fc4cfb845c46f49dd70d61a2f7295a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:22:01.102627 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-72a6612b-9655-4b1c-bf22-f19bf00043cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:01.103279 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-72a6612b-9655-4b1c-bf22-f19bf00043cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:01.104758 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1326/2649] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:22:01 2022] DELETE /identity/v3/projects/39fc4cfb845c46f49dd70d61a2f7295a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:01.108764 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0896559-ac51-4391-b030-57c3ccaa18c5 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:01.118576 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0896559-ac51-4391-b030-57c3ccaa18c5 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:01.178981 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d384f-7184-42b6-8f78-4275f33393a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:01.179525 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d384f-7184-42b6-8f78-4275f33393a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:01.179802 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d384f-7184-42b6-8f78-4275f33393a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:01.180071 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d384f-7184-42b6-8f78-4275f33393a9 admin admin] PATH_INFO: `/v3/users/fd39b03b4e67436d86d3843ae6551480` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:01.181223 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d384f-7184-42b6-8f78-4275f33393a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd39b03b4e67436d86d3843ae6551480)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:01.183144 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d384f-7184-42b6-8f78-4275f33393a9 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:01.226450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:01.228043 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a38d384f-7184-42b6-8f78-4275f33393a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd39b03b4e67436d86d3843ae6551480'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:01.236107 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a38d384f-7184-42b6-8f78-4275f33393a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd39b03b4e67436d86d3843ae6551480'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:01.248672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a38d384f-7184-42b6-8f78-4275f33393a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd39b03b4e67436d86d3843ae6551480'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:01.249355 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a38d384f-7184-42b6-8f78-4275f33393a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd39b03b4e67436d86d3843ae6551480'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:01.256696 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a38d384f-7184-42b6-8f78-4275f33393a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd39b03b4e67436d86d3843ae6551480'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:01.262565 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1324/2650] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:22:01 2022] DELETE /identity/v3/users/fd39b03b4e67436d86d3843ae6551480 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:01.540808 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6612b-9655-4b1c-bf22-f19bf00043cf admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:01.542298 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-72a6612b-9655-4b1c-bf22-f19bf00043cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:01.550989 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:01.558488 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6612b-9655-4b1c-bf22-f19bf00043cf admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:01.637863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555d1ba-23b6-4f8d-821c-d70568845005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:01.638524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555d1ba-23b6-4f8d-821c-d70568845005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:01.638892 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555d1ba-23b6-4f8d-821c-d70568845005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:01.639160 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555d1ba-23b6-4f8d-821c-d70568845005 admin admin] PATH_INFO: `/v3/projects/30e89eadbbee407da86b718eee95d0ff` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:01.640305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555d1ba-23b6-4f8d-821c-d70568845005 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30e89eadbbee407da86b718eee95d0ff)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:01.642354 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555d1ba-23b6-4f8d-821c-d70568845005 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:01.694336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e555d1ba-23b6-4f8d-821c-d70568845005 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30e89eadbbee407da86b718eee95d0ff', 'request_id': 'req-e555d1ba-23b6-4f8d-821c-d70568845005'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:01.700991 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e555d1ba-23b6-4f8d-821c-d70568845005 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30e89eadbbee407da86b718eee95d0ff', 'request_id': 'req-e555d1ba-23b6-4f8d-821c-d70568845005'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:01.709343 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e555d1ba-23b6-4f8d-821c-d70568845005 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30e89eadbbee407da86b718eee95d0ff', 'request_id': 'req-e555d1ba-23b6-4f8d-821c-d70568845005'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:01.720629 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e555d1ba-23b6-4f8d-821c-d70568845005 admin admin] The token cache is being invalidate because project 30e89eadbbee407da86b718eee95d0ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:22:01.720946 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e555d1ba-23b6-4f8d-821c-d70568845005 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:01.721607 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e555d1ba-23b6-4f8d-821c-d70568845005 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:01.723194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1327/2651] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:22:01 2022] DELETE /identity/v3/projects/30e89eadbbee407da86b718eee95d0ff => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:01.727182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d384f-7184-42b6-8f78-4275f33393a9 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:01.728575 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a38d384f-7184-42b6-8f78-4275f33393a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:01.741831 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d384f-7184-42b6-8f78-4275f33393a9 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:01.798258 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74c107-9889-4cd0-886c-46ceb6790b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:01.798877 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74c107-9889-4cd0-886c-46ceb6790b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:01.799694 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74c107-9889-4cd0-886c-46ceb6790b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:01.799962 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74c107-9889-4cd0-886c-46ceb6790b40 admin admin] PATH_INFO: `/v3/users/649958a631714ee0896f8322fd0318a6` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:01.801083 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74c107-9889-4cd0-886c-46ceb6790b40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=649958a631714ee0896f8322fd0318a6)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:01.803016 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74c107-9889-4cd0-886c-46ceb6790b40 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:01.847414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6d74c107-9889-4cd0-886c-46ceb6790b40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '649958a631714ee0896f8322fd0318a6'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:01.854418 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6d74c107-9889-4cd0-886c-46ceb6790b40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '649958a631714ee0896f8322fd0318a6'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:01.866832 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6d74c107-9889-4cd0-886c-46ceb6790b40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '649958a631714ee0896f8322fd0318a6'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:01.867468 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6d74c107-9889-4cd0-886c-46ceb6790b40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '649958a631714ee0896f8322fd0318a6'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:01.874507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6d74c107-9889-4cd0-886c-46ceb6790b40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '649958a631714ee0896f8322fd0318a6'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:01.880878 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1325/2652] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:22:01 2022] DELETE /identity/v3/users/649958a631714ee0896f8322fd0318a6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:02.153407 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555d1ba-23b6-4f8d-821c-d70568845005 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:02.155101 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e555d1ba-23b6-4f8d-821c-d70568845005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:02.168386 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555d1ba-23b6-4f8d-821c-d70568845005 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:02.226016 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45ba75-f64f-43c0-9616-a606aeb1fc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:02.226640 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45ba75-f64f-43c0-9616-a606aeb1fc22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:02.226913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45ba75-f64f-43c0-9616-a606aeb1fc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:02.227179 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45ba75-f64f-43c0-9616-a606aeb1fc22 admin admin] PATH_INFO: `/v3/projects/cbc379699ccd4ed3ba565fbbf2c8fe68` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:02.228296 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45ba75-f64f-43c0-9616-a606aeb1fc22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbc379699ccd4ed3ba565fbbf2c8fe68)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:02.230281 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45ba75-f64f-43c0-9616-a606aeb1fc22 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:02.266700 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:02.277917 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1c45ba75-f64f-43c0-9616-a606aeb1fc22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbc379699ccd4ed3ba565fbbf2c8fe68', 'request_id': 'req-1c45ba75-f64f-43c0-9616-a606aeb1fc22'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:02.284775 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1c45ba75-f64f-43c0-9616-a606aeb1fc22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbc379699ccd4ed3ba565fbbf2c8fe68', 'request_id': 'req-1c45ba75-f64f-43c0-9616-a606aeb1fc22'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:02.292795 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1c45ba75-f64f-43c0-9616-a606aeb1fc22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbc379699ccd4ed3ba565fbbf2c8fe68', 'request_id': 'req-1c45ba75-f64f-43c0-9616-a606aeb1fc22'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:02.303958 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1c45ba75-f64f-43c0-9616-a606aeb1fc22 admin admin] The token cache is being invalidate because project cbc379699ccd4ed3ba565fbbf2c8fe68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:22:02.304251 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1c45ba75-f64f-43c0-9616-a606aeb1fc22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:02.304887 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1c45ba75-f64f-43c0-9616-a606aeb1fc22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:02.306425 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1328/2653] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:22:02 2022] DELETE /identity/v3/projects/cbc379699ccd4ed3ba565fbbf2c8fe68 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:08.199857 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74c107-9889-4cd0-886c-46ceb6790b40 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:08.201320 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-6d74c107-9889-4cd0-886c-46ceb6790b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:08.246316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:08.259563 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74c107-9889-4cd0-886c-46ceb6790b40 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:08.306770 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5806ee-8f69-41fa-814b-ef2807dded74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:08.307358 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5806ee-8f69-41fa-814b-ef2807dded74 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:08.307630 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5806ee-8f69-41fa-814b-ef2807dded74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:08.307921 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5806ee-8f69-41fa-814b-ef2807dded74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:08.309656 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0e5806ee-8f69-41fa-814b-ef2807dded74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:08.370024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5806ee-8f69-41fa-814b-ef2807dded74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:08.371505 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5806ee-8f69-41fa-814b-ef2807dded74 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:08.382237 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1326/2654] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:22:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:22:11.598031 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45ba75-f64f-43c0-9616-a606aeb1fc22 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:11.599566 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1c45ba75-f64f-43c0-9616-a606aeb1fc22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:11.616035 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45ba75-f64f-43c0-9616-a606aeb1fc22 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:11.619258 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923bd5c-2dae-4e3e-9984-88aebd3776b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:11.619896 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923bd5c-2dae-4e3e-9984-88aebd3776b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:11.620206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923bd5c-2dae-4e3e-9984-88aebd3776b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:11.620480 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923bd5c-2dae-4e3e-9984-88aebd3776b0 admin admin] PATH_INFO: `/v3/users/a06ffa78739345039aff49f6fb524b2b` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:11.622127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923bd5c-2dae-4e3e-9984-88aebd3776b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a06ffa78739345039aff49f6fb524b2b)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:11.624114 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923bd5c-2dae-4e3e-9984-88aebd3776b0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:11.670746 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0923bd5c-2dae-4e3e-9984-88aebd3776b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a06ffa78739345039aff49f6fb524b2b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:11.678260 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0923bd5c-2dae-4e3e-9984-88aebd3776b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a06ffa78739345039aff49f6fb524b2b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:11.690881 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0923bd5c-2dae-4e3e-9984-88aebd3776b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a06ffa78739345039aff49f6fb524b2b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:11.691523 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0923bd5c-2dae-4e3e-9984-88aebd3776b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a06ffa78739345039aff49f6fb524b2b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:11.698654 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0923bd5c-2dae-4e3e-9984-88aebd3776b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a06ffa78739345039aff49f6fb524b2b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:11.704473 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1329/2655] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:22:11 2022] DELETE /identity/v3/users/a06ffa78739345039aff49f6fb524b2b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:11.876478 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5806ee-8f69-41fa-814b-ef2807dded74 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:11.886684 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5806ee-8f69-41fa-814b-ef2807dded74 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:11.946525 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d592584-97d5-4178-9a77-98f47c90fc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:11.947075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d592584-97d5-4178-9a77-98f47c90fc18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:11.947350 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d592584-97d5-4178-9a77-98f47c90fc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:11.947616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d592584-97d5-4178-9a77-98f47c90fc18 admin admin] PATH_INFO: `/v3/projects/56a108845fcb4358aa5697ab47adac2e` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:11.948712 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d592584-97d5-4178-9a77-98f47c90fc18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56a108845fcb4358aa5697ab47adac2e)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:11.950657 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d592584-97d5-4178-9a77-98f47c90fc18 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:11.995611 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-0d592584-97d5-4178-9a77-98f47c90fc18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56a108845fcb4358aa5697ab47adac2e', 'request_id': 'req-0d592584-97d5-4178-9a77-98f47c90fc18'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:11.997231 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:12.003046 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-0d592584-97d5-4178-9a77-98f47c90fc18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56a108845fcb4358aa5697ab47adac2e', 'request_id': 'req-0d592584-97d5-4178-9a77-98f47c90fc18'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:12.009118 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-0d592584-97d5-4178-9a77-98f47c90fc18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56a108845fcb4358aa5697ab47adac2e', 'request_id': 'req-0d592584-97d5-4178-9a77-98f47c90fc18'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:12.020105 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-0d592584-97d5-4178-9a77-98f47c90fc18 admin admin] The token cache is being invalidate because project 56a108845fcb4358aa5697ab47adac2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:22:12.020390 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-0d592584-97d5-4178-9a77-98f47c90fc18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:12.021021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-0d592584-97d5-4178-9a77-98f47c90fc18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:12.022534 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1327/2656] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:22:11 2022] DELETE /identity/v3/projects/56a108845fcb4358aa5697ab47adac2e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:12.027379 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e313f-297a-420c-a6d7-844e4f512ffd None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:12.027661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e313f-297a-420c-a6d7-844e4f512ffd None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:12.027928 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e313f-297a-420c-a6d7-844e4f512ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:12.047860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-7d0e313f-297a-420c-a6d7-844e4f512ffd None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:22:12.049609 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7d0e313f-297a-420c-a6d7-844e4f512ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:12.107015 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1330/2657] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:22:12.115318 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd05b2c-33a0-439c-8f05-5258688c1d51 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:12.115571 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd05b2c-33a0-439c-8f05-5258688c1d51 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:12.115848 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd05b2c-33a0-439c-8f05-5258688c1d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:12.138733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-fbd05b2c-33a0-439c-8f05-5258688c1d51 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:22:12.139930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-fbd05b2c-33a0-439c-8f05-5258688c1d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:12.147805 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1328/2658] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:22:12.152031 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e313f-297a-420c-a6d7-844e4f512ffd None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:12.162278 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e313f-297a-420c-a6d7-844e4f512ffd None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:12.166973 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b07af-34b1-446d-975b-a2421b306d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:12.167568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b07af-34b1-446d-975b-a2421b306d0a admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:12.167873 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b07af-34b1-446d-975b-a2421b306d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:12.168170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b07af-34b1-446d-975b-a2421b306d0a admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:12.168855 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b07af-34b1-446d-975b-a2421b306d0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:22:12.169191 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b07af-34b1-446d-975b-a2421b306d0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:12.170791 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b07af-34b1-446d-975b-a2421b306d0a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:12.182800 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1331/2659] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:22:12.186995 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd05b2c-33a0-439c-8f05-5258688c1d51 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:12.196480 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd05b2c-33a0-439c-8f05-5258688c1d51 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:12.201127 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74875412-73bb-48e4-b0d0-374642d402fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:12.201707 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74875412-73bb-48e4-b0d0-374642d402fe admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:12.201977 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74875412-73bb-48e4-b0d0-374642d402fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:12.202239 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74875412-73bb-48e4-b0d0-374642d402fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:12.202842 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74875412-73bb-48e4-b0d0-374642d402fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:12.204702 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74875412-73bb-48e4-b0d0-374642d402fe admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:12.234156 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1329/2660] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:22:12 2022] POST /identity/v3/projects => generated 357 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:22:12.238861 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b07af-34b1-446d-975b-a2421b306d0a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:12.248937 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b07af-34b1-446d-975b-a2421b306d0a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:12.268034 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:12.308464 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c31944-bc51-4e41-aed9-8120f7873bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:12.309116 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c31944-bc51-4e41-aed9-8120f7873bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:12.309396 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c31944-bc51-4e41-aed9-8120f7873bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:12.309661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c31944-bc51-4e41-aed9-8120f7873bd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:12.310281 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c31944-bc51-4e41-aed9-8120f7873bd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:12.312189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c31944-bc51-4e41-aed9-8120f7873bd8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:12.333115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1332/2661] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:22:12 2022] POST /identity/v3/users => generated 279 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:22:12.337180 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74875412-73bb-48e4-b0d0-374642d402fe admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:12.347145 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74875412-73bb-48e4-b0d0-374642d402fe admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:12.351708 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15982d-9b56-446a-ad0e-60be25f53e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:12.352288 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15982d-9b56-446a-ad0e-60be25f53e4e admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:12.352558 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15982d-9b56-446a-ad0e-60be25f53e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:12.352819 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15982d-9b56-446a-ad0e-60be25f53e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:12.353485 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15982d-9b56-446a-ad0e-60be25f53e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:12.355053 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15982d-9b56-446a-ad0e-60be25f53e4e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:12.365737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1330/2662] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:22:12.369476 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c31944-bc51-4e41-aed9-8120f7873bd8 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:12.379468 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c31944-bc51-4e41-aed9-8120f7873bd8 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:12.384052 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c7380-d03c-41ba-9282-757461daa6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:12.384637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c7380-d03c-41ba-9282-757461daa6cc admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:12.384920 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c7380-d03c-41ba-9282-757461daa6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:12.385213 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c7380-d03c-41ba-9282-757461daa6cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:12.385854 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c7380-d03c-41ba-9282-757461daa6cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:12.387446 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c7380-d03c-41ba-9282-757461daa6cc admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:12.399287 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1333/2663] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:22:12.403294 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15982d-9b56-446a-ad0e-60be25f53e4e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:12.413938 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15982d-9b56-446a-ad0e-60be25f53e4e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:12.419341 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283448fb-a518-47a2-8770-8d77b913ec31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:12.420059 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283448fb-a518-47a2-8770-8d77b913ec31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:12.420400 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283448fb-a518-47a2-8770-8d77b913ec31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:12.420682 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283448fb-a518-47a2-8770-8d77b913ec31 admin admin] PATH_INFO: `/v3/projects/fc84cb807491488ba20000b8fd7b5d35/users/3c59ca777b7b4200ae50d410bd129338/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:12.435461 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283448fb-a518-47a2-8770-8d77b913ec31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc84cb807491488ba20000b8fd7b5d35, user_id=3c59ca777b7b4200ae50d410bd129338, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:12.438125 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283448fb-a518-47a2-8770-8d77b913ec31 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:12.450859 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1331/2664] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:22:12 2022] PUT /identity/v3/projects/fc84cb807491488ba20000b8fd7b5d35/users/3c59ca777b7b4200ae50d410bd129338/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:12.462854 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff877ae-b6de-404a-a539-3a9abfb1cc1b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:12.463135 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff877ae-b6de-404a-a539-3a9abfb1cc1b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:12.463406 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff877ae-b6de-404a-a539-3a9abfb1cc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:12.495224 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-8ff877ae-b6de-404a-a539-3a9abfb1cc1b None None] MFA Rules not processed for user `3c59ca777b7b4200ae50d410bd129338`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:22:12.496489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8ff877ae-b6de-404a-a539-3a9abfb1cc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:12.565446 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1334/2665] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:22:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:22:12.569750 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283448fb-a518-47a2-8770-8d77b913ec31 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:12.644993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283448fb-a518-47a2-8770-8d77b913ec31 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:12.649607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ec1a7-5cc3-4e9a-b2b5-55c1a6239d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:12.650201 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ec1a7-5cc3-4e9a-b2b5-55c1a6239d12 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:12.650477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ec1a7-5cc3-4e9a-b2b5-55c1a6239d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:12.650741 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ec1a7-5cc3-4e9a-b2b5-55c1a6239d12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:12.651360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ec1a7-5cc3-4e9a-b2b5-55c1a6239d12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:12.653262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ec1a7-5cc3-4e9a-b2b5-55c1a6239d12 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:12.680132 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1332/2666] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:22:12 2022] POST /identity/v3/projects => generated 357 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:22:12.684266 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff877ae-b6de-404a-a539-3a9abfb1cc1b None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:12.695327 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff877ae-b6de-404a-a539-3a9abfb1cc1b None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:12.750221 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecde8d-46ea-4ab0-95e3-ec101f143ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:12.750741 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecde8d-46ea-4ab0-95e3-ec101f143ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:12.751016 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecde8d-46ea-4ab0-95e3-ec101f143ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:12.751285 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecde8d-46ea-4ab0-95e3-ec101f143ed4 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:12.752429 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecde8d-46ea-4ab0-95e3-ec101f143ed4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:12.754369 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecde8d-46ea-4ab0-95e3-ec101f143ed4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:12.775047 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1335/2667] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:22:12 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:22:12.779061 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ec1a7-5cc3-4e9a-b2b5-55c1a6239d12 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:12.789593 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ec1a7-5cc3-4e9a-b2b5-55c1a6239d12 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:12.794169 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460b902-623d-4324-a191-86092211b3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:12.796116 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460b902-623d-4324-a191-86092211b3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:12.796116 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460b902-623d-4324-a191-86092211b3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:12.796116 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460b902-623d-4324-a191-86092211b3e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:12.796442 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460b902-623d-4324-a191-86092211b3e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:12.797824 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460b902-623d-4324-a191-86092211b3e3 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:12.809303 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1333/2668] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:22:12.814899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecde8d-46ea-4ab0-95e3-ec101f143ed4 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:12.824827 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecde8d-46ea-4ab0-95e3-ec101f143ed4 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:12.829357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b8067-d0f2-4c29-8a3d-b104169f3919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:12.830645 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b8067-d0f2-4c29-8a3d-b104169f3919 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:12.830924 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b8067-d0f2-4c29-8a3d-b104169f3919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:12.831188 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b8067-d0f2-4c29-8a3d-b104169f3919 admin admin] PATH_INFO: `/v3/projects/76ea877e1436473ea56de82e7aab9929/users/649eac3f105848ccb0bb359d3d06e204/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:12.845813 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b8067-d0f2-4c29-8a3d-b104169f3919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ea877e1436473ea56de82e7aab9929, user_id=649eac3f105848ccb0bb359d3d06e204, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:12.848544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b8067-d0f2-4c29-8a3d-b104169f3919 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:12.851634 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:12.863129 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1336/2669] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:22:12 2022] PUT /identity/v3/projects/76ea877e1436473ea56de82e7aab9929/users/649eac3f105848ccb0bb359d3d06e204/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:12.867078 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460b902-623d-4324-a191-86092211b3e3 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:12.877453 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460b902-623d-4324-a191-86092211b3e3 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:12.922041 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:12.936551 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925ef62-6206-4212-b28b-9bc03a87c7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:12.937184 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925ef62-6206-4212-b28b-9bc03a87c7ea admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:12.937522 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925ef62-6206-4212-b28b-9bc03a87c7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:12.937799 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925ef62-6206-4212-b28b-9bc03a87c7ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:12.939075 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925ef62-6206-4212-b28b-9bc03a87c7ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:12.941360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925ef62-6206-4212-b28b-9bc03a87c7ea admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:12.951882 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1334/2670] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:22:12.956170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b8067-d0f2-4c29-8a3d-b104169f3919 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:12.966206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b8067-d0f2-4c29-8a3d-b104169f3919 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:12.971226 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af2565-c8dc-48ec-b664-ce0c1a4a506d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:12.971869 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af2565-c8dc-48ec-b664-ce0c1a4a506d admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:12.972141 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af2565-c8dc-48ec-b664-ce0c1a4a506d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:12.972409 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af2565-c8dc-48ec-b664-ce0c1a4a506d admin admin] PATH_INFO: `/v3/projects/76ea877e1436473ea56de82e7aab9929/users/649eac3f105848ccb0bb359d3d06e204/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:12.974346 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af2565-c8dc-48ec-b664-ce0c1a4a506d admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ea877e1436473ea56de82e7aab9929, user_id=649eac3f105848ccb0bb359d3d06e204, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:12.976970 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af2565-c8dc-48ec-b664-ce0c1a4a506d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:12.988464 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1337/2671] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:22:12 2022] PUT /identity/v3/projects/76ea877e1436473ea56de82e7aab9929/users/649eac3f105848ccb0bb359d3d06e204/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:12.998590 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc26bd-e5dc-4670-a731-cbaf1fd4a434 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:12.998875 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc26bd-e5dc-4670-a731-cbaf1fd4a434 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:12.999147 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc26bd-e5dc-4670-a731-cbaf1fd4a434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:13.027323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-41dc26bd-e5dc-4670-a731-cbaf1fd4a434 None None] MFA Rules not processed for user `649eac3f105848ccb0bb359d3d06e204`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:22:13.028518 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-41dc26bd-e5dc-4670-a731-cbaf1fd4a434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:13.094124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1335/2672] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:22:12 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:22:13.105175 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af2565-c8dc-48ec-b664-ce0c1a4a506d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:13.106881 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-15af2565-c8dc-48ec-b664-ce0c1a4a506d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:13.163579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af2565-c8dc-48ec-b664-ce0c1a4a506d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:13.167186 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d313655-eaaf-4918-b6c3-cec2d73f1526 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:13.167769 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d313655-eaaf-4918-b6c3-cec2d73f1526 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:13.168044 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d313655-eaaf-4918-b6c3-cec2d73f1526 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:13.168309 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d313655-eaaf-4918-b6c3-cec2d73f1526 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:13.177707 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d313655-eaaf-4918-b6c3-cec2d73f1526 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:13.179133 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d313655-eaaf-4918-b6c3-cec2d73f1526 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:13.189080 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1338/2673] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:22:13 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:22:13.264397 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc26bd-e5dc-4670-a731-cbaf1fd4a434 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:13.273932 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc26bd-e5dc-4670-a731-cbaf1fd4a434 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:13.277592 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64866a-4560-47cd-b901-ed682ab390b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:13.278180 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64866a-4560-47cd-b901-ed682ab390b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:13.278457 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64866a-4560-47cd-b901-ed682ab390b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:13.278725 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64866a-4560-47cd-b901-ed682ab390b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:13.335029 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64866a-4560-47cd-b901-ed682ab390b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:13.336445 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64866a-4560-47cd-b901-ed682ab390b4 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:13.345169 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1336/2674] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:22:13 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:22:23.184997 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:23.341220 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=69 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:28.121156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d313655-eaaf-4918-b6c3-cec2d73f1526 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:28.182409 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d313655-eaaf-4918-b6c3-cec2d73f1526 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:28.186879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5a710-39ea-4870-bd7c-09a494cdc96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:28.187494 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5a710-39ea-4870-bd7c-09a494cdc96f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:28.187771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5a710-39ea-4870-bd7c-09a494cdc96f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:28.188040 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5a710-39ea-4870-bd7c-09a494cdc96f admin admin] PATH_INFO: `/v3/users/3c59ca777b7b4200ae50d410bd129338` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:28.189170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da5a710-39ea-4870-bd7c-09a494cdc96f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c59ca777b7b4200ae50d410bd129338)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:28.191578 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da5a710-39ea-4870-bd7c-09a494cdc96f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:28.237958 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9da5a710-39ea-4870-bd7c-09a494cdc96f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c59ca777b7b4200ae50d410bd129338'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:28.245519 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9da5a710-39ea-4870-bd7c-09a494cdc96f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c59ca777b7b4200ae50d410bd129338'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:28.258188 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9da5a710-39ea-4870-bd7c-09a494cdc96f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c59ca777b7b4200ae50d410bd129338'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:28.258824 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9da5a710-39ea-4870-bd7c-09a494cdc96f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c59ca777b7b4200ae50d410bd129338'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:28.265753 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9da5a710-39ea-4870-bd7c-09a494cdc96f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c59ca777b7b4200ae50d410bd129338'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:28.272670 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1339/2675] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:22:28 2022] DELETE /identity/v3/users/3c59ca777b7b4200ae50d410bd129338 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:22:28.278342 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256b094-abb2-48d3-abaa-eee52659dc03 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:28.278831 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256b094-abb2-48d3-abaa-eee52659dc03 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:28.278977 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256b094-abb2-48d3-abaa-eee52659dc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:28.297874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-0256b094-abb2-48d3-abaa-eee52659dc03 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:22:28.299098 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0256b094-abb2-48d3-abaa-eee52659dc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:28.356728 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1337/2676] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:22:28.371085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5a710-39ea-4870-bd7c-09a494cdc96f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:28.374011 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9da5a710-39ea-4870-bd7c-09a494cdc96f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:28.432560 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5a710-39ea-4870-bd7c-09a494cdc96f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:28.436105 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02572f27-0d48-48d6-83d8-7e7efb4fcf09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:28.436705 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02572f27-0d48-48d6-83d8-7e7efb4fcf09 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:28.436981 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02572f27-0d48-48d6-83d8-7e7efb4fcf09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:28.437280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02572f27-0d48-48d6-83d8-7e7efb4fcf09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:28.446639 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02572f27-0d48-48d6-83d8-7e7efb4fcf09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:28.448065 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02572f27-0d48-48d6-83d8-7e7efb4fcf09 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:28.457889 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1340/2677] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:22:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:22:28.718047 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256b094-abb2-48d3-abaa-eee52659dc03 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:28.719535 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0256b094-abb2-48d3-abaa-eee52659dc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:28.740281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256b094-abb2-48d3-abaa-eee52659dc03 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:28.745267 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764b912-480d-4863-8c6c-cc06e08ced8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:28.745893 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764b912-480d-4863-8c6c-cc06e08ced8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:28.746192 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764b912-480d-4863-8c6c-cc06e08ced8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:28.746459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764b912-480d-4863-8c6c-cc06e08ced8a admin admin] PATH_INFO: `/v3/projects/fc84cb807491488ba20000b8fd7b5d35` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:28.747560 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764b912-480d-4863-8c6c-cc06e08ced8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc84cb807491488ba20000b8fd7b5d35)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:28.749477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764b912-480d-4863-8c6c-cc06e08ced8a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:28.796093 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3764b912-480d-4863-8c6c-cc06e08ced8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc84cb807491488ba20000b8fd7b5d35', 'request_id': 'req-3764b912-480d-4863-8c6c-cc06e08ced8a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:28.803607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3764b912-480d-4863-8c6c-cc06e08ced8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc84cb807491488ba20000b8fd7b5d35', 'request_id': 'req-3764b912-480d-4863-8c6c-cc06e08ced8a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:28.809203 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3764b912-480d-4863-8c6c-cc06e08ced8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc84cb807491488ba20000b8fd7b5d35', 'request_id': 'req-3764b912-480d-4863-8c6c-cc06e08ced8a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:28.820753 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3764b912-480d-4863-8c6c-cc06e08ced8a admin admin] The token cache is being invalidate because project fc84cb807491488ba20000b8fd7b5d35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:22:28.821041 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3764b912-480d-4863-8c6c-cc06e08ced8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:28.821702 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3764b912-480d-4863-8c6c-cc06e08ced8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:28.823239 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1338/2678] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:22:28 2022] DELETE /identity/v3/projects/fc84cb807491488ba20000b8fd7b5d35 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:28.827349 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02572f27-0d48-48d6-83d8-7e7efb4fcf09 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:28.837034 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02572f27-0d48-48d6-83d8-7e7efb4fcf09 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:28.854770 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:28.894657 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c535b6-2296-44a2-8b6f-db9a15376f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:28.895272 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c535b6-2296-44a2-8b6f-db9a15376f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:28.895548 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c535b6-2296-44a2-8b6f-db9a15376f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:28.895817 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c535b6-2296-44a2-8b6f-db9a15376f0e admin admin] PATH_INFO: `/v3/users/649eac3f105848ccb0bb359d3d06e204` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:28.896962 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c535b6-2296-44a2-8b6f-db9a15376f0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=649eac3f105848ccb0bb359d3d06e204)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:28.898946 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c535b6-2296-44a2-8b6f-db9a15376f0e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:28.944345 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-43c535b6-2296-44a2-8b6f-db9a15376f0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '649eac3f105848ccb0bb359d3d06e204'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:28.951433 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-43c535b6-2296-44a2-8b6f-db9a15376f0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '649eac3f105848ccb0bb359d3d06e204'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:28.963539 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-43c535b6-2296-44a2-8b6f-db9a15376f0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '649eac3f105848ccb0bb359d3d06e204'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:28.964122 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-43c535b6-2296-44a2-8b6f-db9a15376f0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '649eac3f105848ccb0bb359d3d06e204'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:28.971508 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-43c535b6-2296-44a2-8b6f-db9a15376f0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '649eac3f105848ccb0bb359d3d06e204'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:28.977331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1341/2679] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:22:28 2022] DELETE /identity/v3/users/649eac3f105848ccb0bb359d3d06e204 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:29.244330 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764b912-480d-4863-8c6c-cc06e08ced8a admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:29.245802 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-3764b912-480d-4863-8c6c-cc06e08ced8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:29.263290 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764b912-480d-4863-8c6c-cc06e08ced8a admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:29.321390 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87dfad-fa23-4fc2-92c2-aa1253c301ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:29.322021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87dfad-fa23-4fc2-92c2-aa1253c301ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:29.322260 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87dfad-fa23-4fc2-92c2-aa1253c301ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:29.322523 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87dfad-fa23-4fc2-92c2-aa1253c301ef admin admin] PATH_INFO: `/v3/projects/76ea877e1436473ea56de82e7aab9929` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:29.323615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87dfad-fa23-4fc2-92c2-aa1253c301ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=76ea877e1436473ea56de82e7aab9929)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:29.325525 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87dfad-fa23-4fc2-92c2-aa1253c301ef admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:29.355418 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:29.373179 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6f87dfad-fa23-4fc2-92c2-aa1253c301ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76ea877e1436473ea56de82e7aab9929', 'request_id': 'req-6f87dfad-fa23-4fc2-92c2-aa1253c301ef'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:29.380736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6f87dfad-fa23-4fc2-92c2-aa1253c301ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76ea877e1436473ea56de82e7aab9929', 'request_id': 'req-6f87dfad-fa23-4fc2-92c2-aa1253c301ef'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:29.386368 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6f87dfad-fa23-4fc2-92c2-aa1253c301ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76ea877e1436473ea56de82e7aab9929', 'request_id': 'req-6f87dfad-fa23-4fc2-92c2-aa1253c301ef'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:29.397681 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6f87dfad-fa23-4fc2-92c2-aa1253c301ef admin admin] The token cache is being invalidate because project 76ea877e1436473ea56de82e7aab9929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:22:29.397964 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6f87dfad-fa23-4fc2-92c2-aa1253c301ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:29.398583 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6f87dfad-fa23-4fc2-92c2-aa1253c301ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:29.400042 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1339/2680] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:22:29 2022] DELETE /identity/v3/projects/76ea877e1436473ea56de82e7aab9929 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:29.405475 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5731714-a50d-4f96-8413-f022bae016c0 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:29.405931 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5731714-a50d-4f96-8413-f022bae016c0 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:29.406033 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5731714-a50d-4f96-8413-f022bae016c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:29.428157 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b5731714-a50d-4f96-8413-f022bae016c0 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:22:29.429378 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b5731714-a50d-4f96-8413-f022bae016c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:29.486152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1342/2681] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:22:29.493874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c9f7b-7026-4522-9c9b-9f31bc31a55e None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:29.494094 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c9f7b-7026-4522-9c9b-9f31bc31a55e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:29.494362 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c9f7b-7026-4522-9c9b-9f31bc31a55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:29.513380 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-491c9f7b-7026-4522-9c9b-9f31bc31a55e None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:22:29.514556 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-491c9f7b-7026-4522-9c9b-9f31bc31a55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:29.522987 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1340/2682] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:22:29.527050 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5731714-a50d-4f96-8413-f022bae016c0 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:29.537408 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5731714-a50d-4f96-8413-f022bae016c0 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:29.541884 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b29fd-b01d-4dee-b733-51784023cfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:29.542466 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b29fd-b01d-4dee-b733-51784023cfee admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:29.542739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b29fd-b01d-4dee-b733-51784023cfee admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:29.543004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b29fd-b01d-4dee-b733-51784023cfee admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:29.543635 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b29fd-b01d-4dee-b733-51784023cfee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:22:29.543929 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b29fd-b01d-4dee-b733-51784023cfee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:29.545544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b29fd-b01d-4dee-b733-51784023cfee admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:29.556792 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1343/2683] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:22:29.560907 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c9f7b-7026-4522-9c9b-9f31bc31a55e None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:29.569884 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c9f7b-7026-4522-9c9b-9f31bc31a55e None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:29.574411 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dc22d-a458-43b4-8789-dad2e18314c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:29.574984 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dc22d-a458-43b4-8789-dad2e18314c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:29.575255 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dc22d-a458-43b4-8789-dad2e18314c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:29.575519 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dc22d-a458-43b4-8789-dad2e18314c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:29.576127 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249dc22d-a458-43b4-8789-dad2e18314c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:29.578037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249dc22d-a458-43b4-8789-dad2e18314c0 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:29.618214 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1341/2684] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:22:29 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:22:29.619462 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b29fd-b01d-4dee-b733-51784023cfee admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:29.629739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b29fd-b01d-4dee-b733-51784023cfee admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:29.655329 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:29.687770 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0f088-3e70-41dd-8c98-1adf85f6dbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:29.688370 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0f088-3e70-41dd-8c98-1adf85f6dbf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:29.688673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0f088-3e70-41dd-8c98-1adf85f6dbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:29.688951 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0f088-3e70-41dd-8c98-1adf85f6dbf9 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:29.690115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0f088-3e70-41dd-8c98-1adf85f6dbf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:29.692016 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0f088-3e70-41dd-8c98-1adf85f6dbf9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:29.712662 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1344/2685] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:22:29 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:22:29.716733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dc22d-a458-43b4-8789-dad2e18314c0 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:29.726965 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dc22d-a458-43b4-8789-dad2e18314c0 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:29.731595 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56b36a-810b-4a59-a4e4-5008ed6c4792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:29.732179 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56b36a-810b-4a59-a4e4-5008ed6c4792 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:29.732453 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56b36a-810b-4a59-a4e4-5008ed6c4792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:29.732716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56b36a-810b-4a59-a4e4-5008ed6c4792 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:29.733389 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56b36a-810b-4a59-a4e4-5008ed6c4792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:29.734986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56b36a-810b-4a59-a4e4-5008ed6c4792 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:29.744728 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1342/2686] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:22:29.748583 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0f088-3e70-41dd-8c98-1adf85f6dbf9 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:29.759003 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0f088-3e70-41dd-8c98-1adf85f6dbf9 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:29.763635 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92d271-7882-411c-bed3-e0638d83a674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:29.764212 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92d271-7882-411c-bed3-e0638d83a674 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:29.764489 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92d271-7882-411c-bed3-e0638d83a674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:29.764755 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92d271-7882-411c-bed3-e0638d83a674 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:29.765460 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b92d271-7882-411c-bed3-e0638d83a674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:29.767042 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b92d271-7882-411c-bed3-e0638d83a674 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:29.777412 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1345/2687] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:22:29.781551 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56b36a-810b-4a59-a4e4-5008ed6c4792 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:29.791263 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56b36a-810b-4a59-a4e4-5008ed6c4792 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:29.795764 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c44b0-f892-4235-b0ad-37bb9cfdd44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:29.796382 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c44b0-f892-4235-b0ad-37bb9cfdd44d admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:29.796656 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c44b0-f892-4235-b0ad-37bb9cfdd44d admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:29.796919 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c44b0-f892-4235-b0ad-37bb9cfdd44d admin admin] PATH_INFO: `/v3/projects/447ef9e69cbe4b969846df3913bde94a/users/8f9b27fc598f4d549686e587290522ae/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:29.811093 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c44b0-f892-4235-b0ad-37bb9cfdd44d admin admin] RBAC: Authorizing `identity:create_grant(project_id=447ef9e69cbe4b969846df3913bde94a, user_id=8f9b27fc598f4d549686e587290522ae, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:29.818840 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c44b0-f892-4235-b0ad-37bb9cfdd44d admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:29.829921 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1343/2688] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:22:29 2022] PUT /identity/v3/projects/447ef9e69cbe4b969846df3913bde94a/users/8f9b27fc598f4d549686e587290522ae/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:29.841716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1e8af-8b4b-46e9-a6c9-605275879fcf None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:29.842003 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1e8af-8b4b-46e9-a6c9-605275879fcf None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:29.842275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1e8af-8b4b-46e9-a6c9-605275879fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:29.869431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-39c1e8af-8b4b-46e9-a6c9-605275879fcf None None] MFA Rules not processed for user `8f9b27fc598f4d549686e587290522ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:22:29.870635 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-39c1e8af-8b4b-46e9-a6c9-605275879fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:29.933228 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1346/2689] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:22:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:22:29.937681 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c44b0-f892-4235-b0ad-37bb9cfdd44d admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:29.998385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c44b0-f892-4235-b0ad-37bb9cfdd44d admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:30.003498 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bade20e-b479-4786-ac15-a65fc5f32235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:30.004086 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bade20e-b479-4786-ac15-a65fc5f32235 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:30.004363 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bade20e-b479-4786-ac15-a65fc5f32235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:30.004633 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bade20e-b479-4786-ac15-a65fc5f32235 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:30.005292 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bade20e-b479-4786-ac15-a65fc5f32235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:30.007177 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bade20e-b479-4786-ac15-a65fc5f32235 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:30.033850 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1344/2690] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:22:29 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:22:30.037864 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1e8af-8b4b-46e9-a6c9-605275879fcf None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:30.048398 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1e8af-8b4b-46e9-a6c9-605275879fcf None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:30.110885 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126bd04b-e7be-40b5-9569-4c9b21335aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:30.111975 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bd04b-e7be-40b5-9569-4c9b21335aec admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:30.112253 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bd04b-e7be-40b5-9569-4c9b21335aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:30.112524 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bd04b-e7be-40b5-9569-4c9b21335aec admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:30.113195 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126bd04b-e7be-40b5-9569-4c9b21335aec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:30.115213 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126bd04b-e7be-40b5-9569-4c9b21335aec admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:30.138510 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1347/2691] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:22:30 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:22:30.142519 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bade20e-b479-4786-ac15-a65fc5f32235 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:30.152675 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bade20e-b479-4786-ac15-a65fc5f32235 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:30.157538 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0599ac3-8f1a-4e1f-8d60-c3ca4e210c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:30.158122 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0599ac3-8f1a-4e1f-8d60-c3ca4e210c9f admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:30.158393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0599ac3-8f1a-4e1f-8d60-c3ca4e210c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:30.158658 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0599ac3-8f1a-4e1f-8d60-c3ca4e210c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:30.159323 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0599ac3-8f1a-4e1f-8d60-c3ca4e210c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:30.160992 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0599ac3-8f1a-4e1f-8d60-c3ca4e210c9f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:30.171297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1345/2692] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:22:30.175778 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126bd04b-e7be-40b5-9569-4c9b21335aec admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:30.185626 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126bd04b-e7be-40b5-9569-4c9b21335aec admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:30.190823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a26448-6aed-4af1-a7f8-5512ceb7d546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:30.191408 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a26448-6aed-4af1-a7f8-5512ceb7d546 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:30.191685 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a26448-6aed-4af1-a7f8-5512ceb7d546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:30.191954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a26448-6aed-4af1-a7f8-5512ceb7d546 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:30.192589 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a26448-6aed-4af1-a7f8-5512ceb7d546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:30.194212 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a26448-6aed-4af1-a7f8-5512ceb7d546 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:30.203917 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1348/2693] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:22:30.207823 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0599ac3-8f1a-4e1f-8d60-c3ca4e210c9f admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:30.217566 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0599ac3-8f1a-4e1f-8d60-c3ca4e210c9f admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:30.222055 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ba516-39b0-42b5-91c2-0a08734bdadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:30.222679 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ba516-39b0-42b5-91c2-0a08734bdadc admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:30.222951 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ba516-39b0-42b5-91c2-0a08734bdadc admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:30.223215 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ba516-39b0-42b5-91c2-0a08734bdadc admin admin] PATH_INFO: `/v3/projects/b52c576783a74bb3a9b2ff9825e50c42/users/ca13a635e05d48529f6f4f340c01c796/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:30.235397 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:30.239288 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ba516-39b0-42b5-91c2-0a08734bdadc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b52c576783a74bb3a9b2ff9825e50c42, user_id=ca13a635e05d48529f6f4f340c01c796, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:30.242504 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ba516-39b0-42b5-91c2-0a08734bdadc admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:30.256497 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1346/2694] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:22:30 2022] PUT /identity/v3/projects/b52c576783a74bb3a9b2ff9825e50c42/users/ca13a635e05d48529f6f4f340c01c796/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:30.266422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc514cf5-5085-4cad-8b39-ebfafe7c93cb None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:30.266702 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc514cf5-5085-4cad-8b39-ebfafe7c93cb None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:30.266970 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc514cf5-5085-4cad-8b39-ebfafe7c93cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:30.299210 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-cc514cf5-5085-4cad-8b39-ebfafe7c93cb None None] MFA Rules not processed for user `ca13a635e05d48529f6f4f340c01c796`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:22:30.300413 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cc514cf5-5085-4cad-8b39-ebfafe7c93cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:30.304357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:30.364104 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1349/2695] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:22:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:22:30.368609 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ba516-39b0-42b5-91c2-0a08734bdadc admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:30.430599 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ba516-39b0-42b5-91c2-0a08734bdadc admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:30.435301 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a247858-67c9-4c9a-b419-523230822ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:30.435895 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a247858-67c9-4c9a-b419-523230822ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:30.436176 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a247858-67c9-4c9a-b419-523230822ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:30.436439 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a247858-67c9-4c9a-b419-523230822ba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:30.437057 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a247858-67c9-4c9a-b419-523230822ba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:30.438966 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a247858-67c9-4c9a-b419-523230822ba6 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:30.465032 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1347/2696] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:22:30 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:22:30.469048 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc514cf5-5085-4cad-8b39-ebfafe7c93cb None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:30.480049 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc514cf5-5085-4cad-8b39-ebfafe7c93cb None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:30.534359 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99af997-aca0-408d-9309-ca6463127917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:30.534908 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99af997-aca0-408d-9309-ca6463127917 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:30.535184 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99af997-aca0-408d-9309-ca6463127917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:30.535470 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99af997-aca0-408d-9309-ca6463127917 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:30.536061 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99af997-aca0-408d-9309-ca6463127917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:30.537994 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99af997-aca0-408d-9309-ca6463127917 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:30.559033 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1350/2697] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:22:30 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:22:30.562968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a247858-67c9-4c9a-b419-523230822ba6 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:30.573109 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a247858-67c9-4c9a-b419-523230822ba6 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:30.577679 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0159db4-85c6-409b-9e64-4f97cd6beff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:30.578266 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0159db4-85c6-409b-9e64-4f97cd6beff3 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:30.578542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0159db4-85c6-409b-9e64-4f97cd6beff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:30.578807 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0159db4-85c6-409b-9e64-4f97cd6beff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:30.579444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0159db4-85c6-409b-9e64-4f97cd6beff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:30.581014 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0159db4-85c6-409b-9e64-4f97cd6beff3 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:30.591598 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1348/2698] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:22:30.597318 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99af997-aca0-408d-9309-ca6463127917 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:30.607939 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99af997-aca0-408d-9309-ca6463127917 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:30.613244 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61609d9f-856b-4471-bd67-a1818bc0c558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:30.613893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61609d9f-856b-4471-bd67-a1818bc0c558 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:30.614170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61609d9f-856b-4471-bd67-a1818bc0c558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:30.614440 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61609d9f-856b-4471-bd67-a1818bc0c558 admin admin] PATH_INFO: `/v3/projects/fe542f915bce4e4b945e90aa959e8f17/users/11939766a5f14c3aaab0993324f4bb6c/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:30.629838 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61609d9f-856b-4471-bd67-a1818bc0c558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe542f915bce4e4b945e90aa959e8f17, user_id=11939766a5f14c3aaab0993324f4bb6c, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:30.632486 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61609d9f-856b-4471-bd67-a1818bc0c558 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:30.645088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1351/2699] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:22:30 2022] PUT /identity/v3/projects/fe542f915bce4e4b945e90aa959e8f17/users/11939766a5f14c3aaab0993324f4bb6c/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:22:30.649088 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0159db4-85c6-409b-9e64-4f97cd6beff3 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:30.659810 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0159db4-85c6-409b-9e64-4f97cd6beff3 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:30.715113 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc0b2a-72e3-407e-bf77-afdfed6e87fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:30.715739 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc0b2a-72e3-407e-bf77-afdfed6e87fe admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:30.716020 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc0b2a-72e3-407e-bf77-afdfed6e87fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:30.716297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc0b2a-72e3-407e-bf77-afdfed6e87fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:30.716936 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc0b2a-72e3-407e-bf77-afdfed6e87fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:30.718560 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc0b2a-72e3-407e-bf77-afdfed6e87fe admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:30.728674 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1349/2700] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:22:30.733009 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61609d9f-856b-4471-bd67-a1818bc0c558 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:30.743845 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61609d9f-856b-4471-bd67-a1818bc0c558 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:30.748588 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad93d3e-48e0-46bc-94f3-b831c1c65385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:30.749274 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad93d3e-48e0-46bc-94f3-b831c1c65385 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:30.749558 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad93d3e-48e0-46bc-94f3-b831c1c65385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:30.749860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad93d3e-48e0-46bc-94f3-b831c1c65385 admin admin] PATH_INFO: `/v3/projects/fe542f915bce4e4b945e90aa959e8f17/users/11939766a5f14c3aaab0993324f4bb6c/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:30.751830 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad93d3e-48e0-46bc-94f3-b831c1c65385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe542f915bce4e4b945e90aa959e8f17, user_id=11939766a5f14c3aaab0993324f4bb6c, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:30.754572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad93d3e-48e0-46bc-94f3-b831c1c65385 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:30.764772 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1352/2701] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:22:30 2022] PUT /identity/v3/projects/fe542f915bce4e4b945e90aa959e8f17/users/11939766a5f14c3aaab0993324f4bb6c/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:22:30.775805 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fe62f-171e-4c3d-ad55-c1cefe9f0e51 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:30.776092 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fe62f-171e-4c3d-ad55-c1cefe9f0e51 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:30.776368 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fe62f-171e-4c3d-ad55-c1cefe9f0e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:30.804749 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-840fe62f-171e-4c3d-ad55-c1cefe9f0e51 None None] MFA Rules not processed for user `11939766a5f14c3aaab0993324f4bb6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:22:30.805921 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-840fe62f-171e-4c3d-ad55-c1cefe9f0e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:30.853519 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:30.875083 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1350/2702] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:22:30 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:22:30.885683 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad93d3e-48e0-46bc-94f3-b831c1c65385 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:30.887353 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-bad93d3e-48e0-46bc-94f3-b831c1c65385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:30.944971 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad93d3e-48e0-46bc-94f3-b831c1c65385 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:30.948585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0aae6f-762e-4e88-b5d0-e7599bb098ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:30.949202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0aae6f-762e-4e88-b5d0-e7599bb098ac service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:30.949476 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0aae6f-762e-4e88-b5d0-e7599bb098ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:30.949741 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0aae6f-762e-4e88-b5d0-e7599bb098ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:30.958951 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0aae6f-762e-4e88-b5d0-e7599bb098ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:30.960362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0aae6f-762e-4e88-b5d0-e7599bb098ac service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:30.965190 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:30.971307 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1353/2703] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:22:30 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:22:31.460759 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fe62f-171e-4c3d-ad55-c1cefe9f0e51 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:31.462208 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-840fe62f-171e-4c3d-ad55-c1cefe9f0e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:31.477472 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fe62f-171e-4c3d-ad55-c1cefe9f0e51 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:31.481120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff5f61-dd6c-4d8d-a81f-8757197d377c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:31.481714 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff5f61-dd6c-4d8d-a81f-8757197d377c service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:31.481985 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff5f61-dd6c-4d8d-a81f-8757197d377c service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:31.482249 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff5f61-dd6c-4d8d-a81f-8757197d377c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:31.537552 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff5f61-dd6c-4d8d-a81f-8757197d377c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:31.538952 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff5f61-dd6c-4d8d-a81f-8757197d377c service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:31.547691 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1351/2704] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:22:31 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:22:35.556454 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0aae6f-762e-4e88-b5d0-e7599bb098ac service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:35.565696 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0aae6f-762e-4e88-b5d0-e7599bb098ac service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:35.569405 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e366a7-3e66-425e-af83-fa6d1714259f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:35.570001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e366a7-3e66-425e-af83-fa6d1714259f service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:35.570283 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e366a7-3e66-425e-af83-fa6d1714259f service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:35.570552 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e366a7-3e66-425e-af83-fa6d1714259f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:35.625988 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e366a7-3e66-425e-af83-fa6d1714259f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:35.627953 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e366a7-3e66-425e-af83-fa6d1714259f service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:35.637361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1354/2705] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:22:35 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:22:37.719049 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff5f61-dd6c-4d8d-a81f-8757197d377c service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:37.780552 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff5f61-dd6c-4d8d-a81f-8757197d377c service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:37.785143 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69160d38-5cb0-43a9-b357-8ada1fca8036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:37.785723 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69160d38-5cb0-43a9-b357-8ada1fca8036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:37.785998 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69160d38-5cb0-43a9-b357-8ada1fca8036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:37.786266 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69160d38-5cb0-43a9-b357-8ada1fca8036 admin admin] PATH_INFO: `/v3/users/8f9b27fc598f4d549686e587290522ae` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:37.787381 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69160d38-5cb0-43a9-b357-8ada1fca8036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f9b27fc598f4d549686e587290522ae)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:37.789327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69160d38-5cb0-43a9-b357-8ada1fca8036 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:37.835648 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-69160d38-5cb0-43a9-b357-8ada1fca8036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f9b27fc598f4d549686e587290522ae'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:37.842514 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-69160d38-5cb0-43a9-b357-8ada1fca8036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f9b27fc598f4d549686e587290522ae'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:37.854830 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-69160d38-5cb0-43a9-b357-8ada1fca8036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f9b27fc598f4d549686e587290522ae'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:37.855467 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-69160d38-5cb0-43a9-b357-8ada1fca8036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f9b27fc598f4d549686e587290522ae'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:37.862427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-69160d38-5cb0-43a9-b357-8ada1fca8036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f9b27fc598f4d549686e587290522ae'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:37.868320 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1352/2706] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:22:37 2022] DELETE /identity/v3/users/8f9b27fc598f4d549686e587290522ae => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:37.872876 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50951ba6-1410-4966-86a7-4f06864d07b6 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:37.873368 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50951ba6-1410-4966-86a7-4f06864d07b6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:37.873483 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50951ba6-1410-4966-86a7-4f06864d07b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:37.892018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-50951ba6-1410-4966-86a7-4f06864d07b6 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:22:37.893277 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-50951ba6-1410-4966-86a7-4f06864d07b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:37.952210 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1355/2707] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:22:37.962561 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69160d38-5cb0-43a9-b357-8ada1fca8036 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:37.963964 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-69160d38-5cb0-43a9-b357-8ada1fca8036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:37.970424 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:38.022450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69160d38-5cb0-43a9-b357-8ada1fca8036 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:38.026060 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3116b-081d-4aa4-ab6a-9480ae5faf20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:38.026649 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3116b-081d-4aa4-ab6a-9480ae5faf20 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:38.026922 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3116b-081d-4aa4-ab6a-9480ae5faf20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:38.027186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3116b-081d-4aa4-ab6a-9480ae5faf20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:38.036366 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f3116b-081d-4aa4-ab6a-9480ae5faf20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:38.037750 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f3116b-081d-4aa4-ab6a-9480ae5faf20 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:38.047266 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1353/2708] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:22:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:22:38.314533 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50951ba6-1410-4966-86a7-4f06864d07b6 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:38.316588 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-50951ba6-1410-4966-86a7-4f06864d07b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:38.329359 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50951ba6-1410-4966-86a7-4f06864d07b6 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:38.334031 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff8285-6674-4fcf-bfff-cbcfbd92374a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:38.334661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff8285-6674-4fcf-bfff-cbcfbd92374a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:38.335064 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff8285-6674-4fcf-bfff-cbcfbd92374a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:38.335310 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff8285-6674-4fcf-bfff-cbcfbd92374a admin admin] PATH_INFO: `/v3/projects/447ef9e69cbe4b969846df3913bde94a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:38.336336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff8285-6674-4fcf-bfff-cbcfbd92374a admin admin] RBAC: Authorizing `identity:delete_project(project_id=447ef9e69cbe4b969846df3913bde94a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:38.338272 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff8285-6674-4fcf-bfff-cbcfbd92374a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:38.386358 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2bff8285-6674-4fcf-bfff-cbcfbd92374a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '447ef9e69cbe4b969846df3913bde94a', 'request_id': 'req-2bff8285-6674-4fcf-bfff-cbcfbd92374a'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:38.392486 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2bff8285-6674-4fcf-bfff-cbcfbd92374a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '447ef9e69cbe4b969846df3913bde94a', 'request_id': 'req-2bff8285-6674-4fcf-bfff-cbcfbd92374a'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:38.399638 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2bff8285-6674-4fcf-bfff-cbcfbd92374a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '447ef9e69cbe4b969846df3913bde94a', 'request_id': 'req-2bff8285-6674-4fcf-bfff-cbcfbd92374a'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:38.410099 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2bff8285-6674-4fcf-bfff-cbcfbd92374a admin admin] The token cache is being invalidate because project 447ef9e69cbe4b969846df3913bde94a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:22:38.410381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2bff8285-6674-4fcf-bfff-cbcfbd92374a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:38.410997 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2bff8285-6674-4fcf-bfff-cbcfbd92374a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:38.412472 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1356/2709] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:22:38 2022] DELETE /identity/v3/projects/447ef9e69cbe4b969846df3913bde94a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:38.416450 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3116b-081d-4aa4-ab6a-9480ae5faf20 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:38.427756 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3116b-081d-4aa4-ab6a-9480ae5faf20 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:38.482934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54449f8-2e41-4217-9ac6-c1a9f453b5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:38.483545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54449f8-2e41-4217-9ac6-c1a9f453b5f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:38.483822 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54449f8-2e41-4217-9ac6-c1a9f453b5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:38.484093 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54449f8-2e41-4217-9ac6-c1a9f453b5f1 admin admin] PATH_INFO: `/v3/users/ca13a635e05d48529f6f4f340c01c796` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:38.485237 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54449f8-2e41-4217-9ac6-c1a9f453b5f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca13a635e05d48529f6f4f340c01c796)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:38.487703 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54449f8-2e41-4217-9ac6-c1a9f453b5f1 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:38.533423 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a54449f8-2e41-4217-9ac6-c1a9f453b5f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca13a635e05d48529f6f4f340c01c796'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:38.540764 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a54449f8-2e41-4217-9ac6-c1a9f453b5f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca13a635e05d48529f6f4f340c01c796'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:38.553241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a54449f8-2e41-4217-9ac6-c1a9f453b5f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca13a635e05d48529f6f4f340c01c796'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:38.553872 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a54449f8-2e41-4217-9ac6-c1a9f453b5f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca13a635e05d48529f6f4f340c01c796'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:38.560857 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a54449f8-2e41-4217-9ac6-c1a9f453b5f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca13a635e05d48529f6f4f340c01c796'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:38.567196 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1354/2710] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:22:38 2022] DELETE /identity/v3/users/ca13a635e05d48529f6f4f340c01c796 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:38.852671 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff8285-6674-4fcf-bfff-cbcfbd92374a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:38.854310 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2bff8285-6674-4fcf-bfff-cbcfbd92374a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:38.869907 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff8285-6674-4fcf-bfff-cbcfbd92374a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:38.890172 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:38.934583 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc8b0d-8048-41ca-9e1a-59ed96b20c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:38.935207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc8b0d-8048-41ca-9e1a-59ed96b20c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:38.935483 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc8b0d-8048-41ca-9e1a-59ed96b20c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:38.935749 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc8b0d-8048-41ca-9e1a-59ed96b20c03 admin admin] PATH_INFO: `/v3/projects/b52c576783a74bb3a9b2ff9825e50c42` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:38.937056 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc8b0d-8048-41ca-9e1a-59ed96b20c03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b52c576783a74bb3a9b2ff9825e50c42)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:38.939095 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc8b0d-8048-41ca-9e1a-59ed96b20c03 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:38.985008 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7ebc8b0d-8048-41ca-9e1a-59ed96b20c03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b52c576783a74bb3a9b2ff9825e50c42', 'request_id': 'req-7ebc8b0d-8048-41ca-9e1a-59ed96b20c03'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:38.991990 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7ebc8b0d-8048-41ca-9e1a-59ed96b20c03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b52c576783a74bb3a9b2ff9825e50c42', 'request_id': 'req-7ebc8b0d-8048-41ca-9e1a-59ed96b20c03'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:38.999334 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7ebc8b0d-8048-41ca-9e1a-59ed96b20c03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b52c576783a74bb3a9b2ff9825e50c42', 'request_id': 'req-7ebc8b0d-8048-41ca-9e1a-59ed96b20c03'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:39.009746 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7ebc8b0d-8048-41ca-9e1a-59ed96b20c03 admin admin] The token cache is being invalidate because project b52c576783a74bb3a9b2ff9825e50c42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:22:39.010035 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7ebc8b0d-8048-41ca-9e1a-59ed96b20c03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:39.010659 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7ebc8b0d-8048-41ca-9e1a-59ed96b20c03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:39.012125 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1357/2711] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:22:38 2022] DELETE /identity/v3/projects/b52c576783a74bb3a9b2ff9825e50c42 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:39.016129 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54449f8-2e41-4217-9ac6-c1a9f453b5f1 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:39.017533 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a54449f8-2e41-4217-9ac6-c1a9f453b5f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:39.030199 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54449f8-2e41-4217-9ac6-c1a9f453b5f1 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:39.055317 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:39.092199 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d28bb9-354e-4cff-9f2a-f6daa9f9a134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:39.092813 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d28bb9-354e-4cff-9f2a-f6daa9f9a134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:39.093086 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d28bb9-354e-4cff-9f2a-f6daa9f9a134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:39.093380 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d28bb9-354e-4cff-9f2a-f6daa9f9a134 admin admin] PATH_INFO: `/v3/users/11939766a5f14c3aaab0993324f4bb6c` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:39.094547 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d28bb9-354e-4cff-9f2a-f6daa9f9a134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11939766a5f14c3aaab0993324f4bb6c)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:39.097174 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d28bb9-354e-4cff-9f2a-f6daa9f9a134 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:39.145709 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b1d28bb9-354e-4cff-9f2a-f6daa9f9a134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11939766a5f14c3aaab0993324f4bb6c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:39.152628 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b1d28bb9-354e-4cff-9f2a-f6daa9f9a134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11939766a5f14c3aaab0993324f4bb6c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:39.165216 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b1d28bb9-354e-4cff-9f2a-f6daa9f9a134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11939766a5f14c3aaab0993324f4bb6c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:39.165854 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b1d28bb9-354e-4cff-9f2a-f6daa9f9a134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11939766a5f14c3aaab0993324f4bb6c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:39.172609 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b1d28bb9-354e-4cff-9f2a-f6daa9f9a134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11939766a5f14c3aaab0993324f4bb6c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:39.178385 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1355/2712] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:22:39 2022] DELETE /identity/v3/users/11939766a5f14c3aaab0993324f4bb6c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:39.454628 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc8b0d-8048-41ca-9e1a-59ed96b20c03 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:39.456069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7ebc8b0d-8048-41ca-9e1a-59ed96b20c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:39.473472 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc8b0d-8048-41ca-9e1a-59ed96b20c03 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:39.532270 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dca8c4-0b6a-4850-a8cb-42d79de4bc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:39.532909 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dca8c4-0b6a-4850-a8cb-42d79de4bc62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:39.533292 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dca8c4-0b6a-4850-a8cb-42d79de4bc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:39.533569 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dca8c4-0b6a-4850-a8cb-42d79de4bc62 admin admin] PATH_INFO: `/v3/projects/fe542f915bce4e4b945e90aa959e8f17` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:39.534697 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dca8c4-0b6a-4850-a8cb-42d79de4bc62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe542f915bce4e4b945e90aa959e8f17)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:39.536648 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dca8c4-0b6a-4850-a8cb-42d79de4bc62 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:39.586233 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-43dca8c4-0b6a-4850-a8cb-42d79de4bc62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe542f915bce4e4b945e90aa959e8f17', 'request_id': 'req-43dca8c4-0b6a-4850-a8cb-42d79de4bc62'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:39.592499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-43dca8c4-0b6a-4850-a8cb-42d79de4bc62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe542f915bce4e4b945e90aa959e8f17', 'request_id': 'req-43dca8c4-0b6a-4850-a8cb-42d79de4bc62'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:39.594196 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:39.600994 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-43dca8c4-0b6a-4850-a8cb-42d79de4bc62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe542f915bce4e4b945e90aa959e8f17', 'request_id': 'req-43dca8c4-0b6a-4850-a8cb-42d79de4bc62'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:39.614561 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-43dca8c4-0b6a-4850-a8cb-42d79de4bc62 admin admin] The token cache is being invalidate because project fe542f915bce4e4b945e90aa959e8f17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:22:39.614850 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-43dca8c4-0b6a-4850-a8cb-42d79de4bc62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:39.615531 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-43dca8c4-0b6a-4850-a8cb-42d79de4bc62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:39.617025 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1358/2713] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:22:39 2022] DELETE /identity/v3/projects/fe542f915bce4e4b945e90aa959e8f17 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:39.623016 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4bc8e-c91e-4bed-bd7b-0f726d035ba2 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:39.623240 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4bc8e-c91e-4bed-bd7b-0f726d035ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:39.623513 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4bc8e-c91e-4bed-bd7b-0f726d035ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:39.643777 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-40a4bc8e-c91e-4bed-bd7b-0f726d035ba2 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:22:39.645615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-40a4bc8e-c91e-4bed-bd7b-0f726d035ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:39.710644 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1356/2714] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:22:39.719299 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ea30c-13e7-4bcf-9b22-e2e58a178e06 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:39.719582 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ea30c-13e7-4bcf-9b22-e2e58a178e06 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:39.719858 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ea30c-13e7-4bcf-9b22-e2e58a178e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:39.740310 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-dd8ea30c-13e7-4bcf-9b22-e2e58a178e06 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:22:39.741563 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-dd8ea30c-13e7-4bcf-9b22-e2e58a178e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:39.749527 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1359/2715] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:22:39.754271 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4bc8e-c91e-4bed-bd7b-0f726d035ba2 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:39.765274 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4bc8e-c91e-4bed-bd7b-0f726d035ba2 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:39.769883 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec16b20-2853-4ce6-b399-74db262619cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:39.770470 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec16b20-2853-4ce6-b399-74db262619cb admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:39.770747 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec16b20-2853-4ce6-b399-74db262619cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:39.771018 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec16b20-2853-4ce6-b399-74db262619cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:39.771653 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec16b20-2853-4ce6-b399-74db262619cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:22:39.771953 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec16b20-2853-4ce6-b399-74db262619cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:39.773584 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec16b20-2853-4ce6-b399-74db262619cb admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:39.786663 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1357/2716] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:22:39.790961 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ea30c-13e7-4bcf-9b22-e2e58a178e06 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:39.800299 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ea30c-13e7-4bcf-9b22-e2e58a178e06 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:39.805564 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe538f0-2236-4350-a711-a4db91e7b3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:39.806158 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe538f0-2236-4350-a711-a4db91e7b3dc admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:39.806437 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe538f0-2236-4350-a711-a4db91e7b3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:39.806710 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe538f0-2236-4350-a711-a4db91e7b3dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:39.807337 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe538f0-2236-4350-a711-a4db91e7b3dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:39.809300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe538f0-2236-4350-a711-a4db91e7b3dc admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:39.838011 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1360/2717] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:22:39 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:22:39.842315 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec16b20-2853-4ce6-b399-74db262619cb admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:39.852565 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec16b20-2853-4ce6-b399-74db262619cb admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:39.883314 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:39.912002 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258d8d9-56fa-4d08-8722-f64d19f43dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:39.912602 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258d8d9-56fa-4d08-8722-f64d19f43dad admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:39.912877 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258d8d9-56fa-4d08-8722-f64d19f43dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:39.913172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258d8d9-56fa-4d08-8722-f64d19f43dad admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:39.913812 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258d8d9-56fa-4d08-8722-f64d19f43dad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:39.915716 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258d8d9-56fa-4d08-8722-f64d19f43dad admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:39.937120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1358/2718] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:22:39 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:22:39.941266 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe538f0-2236-4350-a711-a4db91e7b3dc admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:39.952227 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe538f0-2236-4350-a711-a4db91e7b3dc admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:39.956898 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c3646-2815-4439-a83f-70118d22003c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:39.957550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c3646-2815-4439-a83f-70118d22003c admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:39.957827 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c3646-2815-4439-a83f-70118d22003c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:39.958093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c3646-2815-4439-a83f-70118d22003c admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:39.958728 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c3646-2815-4439-a83f-70118d22003c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:39.960338 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c3646-2815-4439-a83f-70118d22003c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:39.970579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1361/2719] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:22:39.974635 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258d8d9-56fa-4d08-8722-f64d19f43dad admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:39.985203 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258d8d9-56fa-4d08-8722-f64d19f43dad admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:39.990399 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dd42f-3953-4070-828c-623555f9fe3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:39.990952 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dd42f-3953-4070-828c-623555f9fe3f admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:39.991224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dd42f-3953-4070-828c-623555f9fe3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:39.991489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dd42f-3953-4070-828c-623555f9fe3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:39.992120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dd42f-3953-4070-828c-623555f9fe3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:39.993732 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dd42f-3953-4070-828c-623555f9fe3f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:40.005919 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1359/2720] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:22:40.010022 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c3646-2815-4439-a83f-70118d22003c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:40.020579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c3646-2815-4439-a83f-70118d22003c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:40.025207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6bdbc3-6ba8-4c9a-95de-cb206a8d5045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:40.025844 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6bdbc3-6ba8-4c9a-95de-cb206a8d5045 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:40.026121 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6bdbc3-6ba8-4c9a-95de-cb206a8d5045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:40.026390 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6bdbc3-6ba8-4c9a-95de-cb206a8d5045 admin admin] PATH_INFO: `/v3/projects/332744b7db6f45bc9255b9ec6a8e9be1/users/62b76bf204484730b242c2453a3f7092/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:40.041488 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6bdbc3-6ba8-4c9a-95de-cb206a8d5045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=332744b7db6f45bc9255b9ec6a8e9be1, user_id=62b76bf204484730b242c2453a3f7092, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:40.044170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6bdbc3-6ba8-4c9a-95de-cb206a8d5045 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:40.057085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1362/2721] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:22:40 2022] PUT /identity/v3/projects/332744b7db6f45bc9255b9ec6a8e9be1/users/62b76bf204484730b242c2453a3f7092/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:40.068071 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00deaf34-d944-4f0c-aeb1-754004d10728 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:40.068516 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00deaf34-d944-4f0c-aeb1-754004d10728 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:40.068621 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00deaf34-d944-4f0c-aeb1-754004d10728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:40.095701 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-00deaf34-d944-4f0c-aeb1-754004d10728 None None] MFA Rules not processed for user `62b76bf204484730b242c2453a3f7092`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:22:40.096876 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-00deaf34-d944-4f0c-aeb1-754004d10728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:40.160680 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1360/2722] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:22:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:22:40.165030 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6bdbc3-6ba8-4c9a-95de-cb206a8d5045 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:40.227079 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6bdbc3-6ba8-4c9a-95de-cb206a8d5045 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:40.232520 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c4f8c-886a-48ba-b071-923124926b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:40.233134 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c4f8c-886a-48ba-b071-923124926b08 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:40.233504 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c4f8c-886a-48ba-b071-923124926b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:40.233780 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c4f8c-886a-48ba-b071-923124926b08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:40.234405 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c4f8c-886a-48ba-b071-923124926b08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:40.236287 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c4f8c-886a-48ba-b071-923124926b08 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:40.263248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1363/2723] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:22:40 2022] POST /identity/v3/projects => generated 389 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:22:40.267350 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00deaf34-d944-4f0c-aeb1-754004d10728 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:40.278447 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00deaf34-d944-4f0c-aeb1-754004d10728 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:40.335392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6e97d-4039-44e4-8954-7226ec375882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:40.335978 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6e97d-4039-44e4-8954-7226ec375882 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:40.336248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6e97d-4039-44e4-8954-7226ec375882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:40.336511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6e97d-4039-44e4-8954-7226ec375882 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:40.337166 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a6e97d-4039-44e4-8954-7226ec375882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:40.339067 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a6e97d-4039-44e4-8954-7226ec375882 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:40.359525 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1361/2724] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:22:40 2022] POST /identity/v3/users => generated 301 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:22:40.363581 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c4f8c-886a-48ba-b071-923124926b08 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:40.374436 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c4f8c-886a-48ba-b071-923124926b08 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:40.379447 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3aa177-539b-4675-be82-3022f88e94de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:40.380054 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aa177-539b-4675-be82-3022f88e94de admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:40.380337 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aa177-539b-4675-be82-3022f88e94de admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:40.380728 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aa177-539b-4675-be82-3022f88e94de admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:40.381414 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3aa177-539b-4675-be82-3022f88e94de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:40.383076 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3aa177-539b-4675-be82-3022f88e94de admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:40.393859 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1364/2725] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:22:40.398100 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6e97d-4039-44e4-8954-7226ec375882 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:40.408274 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6e97d-4039-44e4-8954-7226ec375882 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:40.413421 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baecf74c-2c05-4af7-94fc-f4384de5f0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:40.414006 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecf74c-2c05-4af7-94fc-f4384de5f0d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:40.414281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecf74c-2c05-4af7-94fc-f4384de5f0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:40.414549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecf74c-2c05-4af7-94fc-f4384de5f0d7 admin admin] PATH_INFO: `/v3/projects/4b54e1e504af4419803b6d6fa4bb64f5/users/5914cda85e5e4c7b8c1b16453a0c1270/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:40.430268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baecf74c-2c05-4af7-94fc-f4384de5f0d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b54e1e504af4419803b6d6fa4bb64f5, user_id=5914cda85e5e4c7b8c1b16453a0c1270, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:40.432930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baecf74c-2c05-4af7-94fc-f4384de5f0d7 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:40.444951 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1362/2726] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:22:40 2022] PUT /identity/v3/projects/4b54e1e504af4419803b6d6fa4bb64f5/users/5914cda85e5e4c7b8c1b16453a0c1270/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:22:40.449086 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3aa177-539b-4675-be82-3022f88e94de admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:40.459066 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3aa177-539b-4675-be82-3022f88e94de admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:40.505877 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:40.516036 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c734f7-e5fb-4640-997e-0e804a94facd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:40.516630 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c734f7-e5fb-4640-997e-0e804a94facd admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:40.516928 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c734f7-e5fb-4640-997e-0e804a94facd admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:40.517222 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c734f7-e5fb-4640-997e-0e804a94facd admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:40.517853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c734f7-e5fb-4640-997e-0e804a94facd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:40.519437 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c734f7-e5fb-4640-997e-0e804a94facd admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:40.529603 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1365/2727] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:22:40.536120 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baecf74c-2c05-4af7-94fc-f4384de5f0d7 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:40.546123 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baecf74c-2c05-4af7-94fc-f4384de5f0d7 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:40.550763 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563debc-7bba-467a-9dd8-cf1b9e02d237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:40.551400 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563debc-7bba-467a-9dd8-cf1b9e02d237 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:40.551672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563debc-7bba-467a-9dd8-cf1b9e02d237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:40.551937 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563debc-7bba-467a-9dd8-cf1b9e02d237 admin admin] PATH_INFO: `/v3/projects/4b54e1e504af4419803b6d6fa4bb64f5/users/5914cda85e5e4c7b8c1b16453a0c1270/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:40.553849 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563debc-7bba-467a-9dd8-cf1b9e02d237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b54e1e504af4419803b6d6fa4bb64f5, user_id=5914cda85e5e4c7b8c1b16453a0c1270, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:40.556449 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563debc-7bba-467a-9dd8-cf1b9e02d237 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:40.558682 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:40.567906 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1363/2728] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:22:40 2022] PUT /identity/v3/projects/4b54e1e504af4419803b6d6fa4bb64f5/users/5914cda85e5e4c7b8c1b16453a0c1270/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:40.577650 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0107f-aa36-4f09-8b48-9e6806f591b9 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:40.577932 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0107f-aa36-4f09-8b48-9e6806f591b9 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:40.578204 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0107f-aa36-4f09-8b48-9e6806f591b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:40.606239 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-18f0107f-aa36-4f09-8b48-9e6806f591b9 None None] MFA Rules not processed for user `5914cda85e5e4c7b8c1b16453a0c1270`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:22:40.607424 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-18f0107f-aa36-4f09-8b48-9e6806f591b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:40.675919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1366/2729] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:22:40 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:22:40.686762 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563debc-7bba-467a-9dd8-cf1b9e02d237 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:40.688451 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d563debc-7bba-467a-9dd8-cf1b9e02d237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:40.744405 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563debc-7bba-467a-9dd8-cf1b9e02d237 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:40.747987 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76dd8e-5084-4a9c-a158-930f8d7a7d4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:40.748575 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76dd8e-5084-4a9c-a158-930f8d7a7d4e service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:40.748851 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76dd8e-5084-4a9c-a158-930f8d7a7d4e service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:40.749133 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76dd8e-5084-4a9c-a158-930f8d7a7d4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:40.757833 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76dd8e-5084-4a9c-a158-930f8d7a7d4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:40.759228 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76dd8e-5084-4a9c-a158-930f8d7a7d4e service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:40.768253 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1364/2730] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:22:40 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:22:40.900869 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0107f-aa36-4f09-8b48-9e6806f591b9 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:40.963138 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0107f-aa36-4f09-8b48-9e6806f591b9 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:40.967721 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72413a-4ace-4b59-9f12-86fe6b1cb35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:40.968495 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72413a-4ace-4b59-9f12-86fe6b1cb35f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:40.968815 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72413a-4ace-4b59-9f12-86fe6b1cb35f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:40.969089 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72413a-4ace-4b59-9f12-86fe6b1cb35f admin admin] PATH_INFO: `/v3/users/62b76bf204484730b242c2453a3f7092` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:40.970236 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72413a-4ace-4b59-9f12-86fe6b1cb35f admin admin] RBAC: Authorizing `identity:delete_user(user_id=62b76bf204484730b242c2453a3f7092)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:40.972163 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72413a-4ace-4b59-9f12-86fe6b1cb35f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:41.016423 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9e72413a-4ace-4b59-9f12-86fe6b1cb35f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62b76bf204484730b242c2453a3f7092'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:41.024981 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9e72413a-4ace-4b59-9f12-86fe6b1cb35f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62b76bf204484730b242c2453a3f7092'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:41.037522 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9e72413a-4ace-4b59-9f12-86fe6b1cb35f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62b76bf204484730b242c2453a3f7092'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:41.038178 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9e72413a-4ace-4b59-9f12-86fe6b1cb35f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62b76bf204484730b242c2453a3f7092'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:41.042950 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:41.046928 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9e72413a-4ace-4b59-9f12-86fe6b1cb35f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62b76bf204484730b242c2453a3f7092'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:41.053750 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1367/2731] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:22:40 2022] DELETE /identity/v3/users/62b76bf204484730b242c2453a3f7092 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:41.058181 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330b48b-64e4-4c09-b1c2-5dbccdae5b00 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:41.058460 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330b48b-64e4-4c09-b1c2-5dbccdae5b00 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:41.058732 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330b48b-64e4-4c09-b1c2-5dbccdae5b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:41.077824 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-2330b48b-64e4-4c09-b1c2-5dbccdae5b00 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:22:41.079175 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2330b48b-64e4-4c09-b1c2-5dbccdae5b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:41.136524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1365/2732] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:22:41.146698 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72413a-4ace-4b59-9f12-86fe6b1cb35f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:41.148122 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9e72413a-4ace-4b59-9f12-86fe6b1cb35f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:41.205818 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72413a-4ace-4b59-9f12-86fe6b1cb35f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:41.210015 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da8aab-6aec-4c60-8e9b-52f5c9fdfaff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:41.210607 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da8aab-6aec-4c60-8e9b-52f5c9fdfaff service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:41.210879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da8aab-6aec-4c60-8e9b-52f5c9fdfaff service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:41.211144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da8aab-6aec-4c60-8e9b-52f5c9fdfaff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:41.219971 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da8aab-6aec-4c60-8e9b-52f5c9fdfaff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:41.221361 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da8aab-6aec-4c60-8e9b-52f5c9fdfaff service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:41.230679 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1368/2733] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:22:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:22:41.496393 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330b48b-64e4-4c09-b1c2-5dbccdae5b00 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:41.497878 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2330b48b-64e4-4c09-b1c2-5dbccdae5b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:41.510484 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330b48b-64e4-4c09-b1c2-5dbccdae5b00 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:41.515159 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc21d8-a201-4325-a9a2-668210bd52dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:41.515784 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc21d8-a201-4325-a9a2-668210bd52dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:41.516057 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc21d8-a201-4325-a9a2-668210bd52dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:41.516327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc21d8-a201-4325-a9a2-668210bd52dd admin admin] PATH_INFO: `/v3/projects/332744b7db6f45bc9255b9ec6a8e9be1` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:41.517840 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc21d8-a201-4325-a9a2-668210bd52dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=332744b7db6f45bc9255b9ec6a8e9be1)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:41.519409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc21d8-a201-4325-a9a2-668210bd52dd admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:41.565307 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-41cc21d8-a201-4325-a9a2-668210bd52dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '332744b7db6f45bc9255b9ec6a8e9be1', 'request_id': 'req-41cc21d8-a201-4325-a9a2-668210bd52dd'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:41.572965 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-41cc21d8-a201-4325-a9a2-668210bd52dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '332744b7db6f45bc9255b9ec6a8e9be1', 'request_id': 'req-41cc21d8-a201-4325-a9a2-668210bd52dd'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:41.578865 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-41cc21d8-a201-4325-a9a2-668210bd52dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '332744b7db6f45bc9255b9ec6a8e9be1', 'request_id': 'req-41cc21d8-a201-4325-a9a2-668210bd52dd'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:41.590010 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-41cc21d8-a201-4325-a9a2-668210bd52dd admin admin] The token cache is being invalidate because project 332744b7db6f45bc9255b9ec6a8e9be1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:22:41.590296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-41cc21d8-a201-4325-a9a2-668210bd52dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:41.590933 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-41cc21d8-a201-4325-a9a2-668210bd52dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:41.592407 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1366/2734] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:22:41 2022] DELETE /identity/v3/projects/332744b7db6f45bc9255b9ec6a8e9be1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:41.596403 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da8aab-6aec-4c60-8e9b-52f5c9fdfaff service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:41.606108 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da8aab-6aec-4c60-8e9b-52f5c9fdfaff service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:41.663528 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe07c67-1f07-4e2e-98f6-55909be8fec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:41.664152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe07c67-1f07-4e2e-98f6-55909be8fec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:41.664431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe07c67-1f07-4e2e-98f6-55909be8fec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:41.664704 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe07c67-1f07-4e2e-98f6-55909be8fec3 admin admin] PATH_INFO: `/v3/users/5914cda85e5e4c7b8c1b16453a0c1270` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:41.665853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe07c67-1f07-4e2e-98f6-55909be8fec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5914cda85e5e4c7b8c1b16453a0c1270)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:41.667777 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe07c67-1f07-4e2e-98f6-55909be8fec3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:41.712141 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2fe07c67-1f07-4e2e-98f6-55909be8fec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5914cda85e5e4c7b8c1b16453a0c1270'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:41.720271 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2fe07c67-1f07-4e2e-98f6-55909be8fec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5914cda85e5e4c7b8c1b16453a0c1270'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:41.735441 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2fe07c67-1f07-4e2e-98f6-55909be8fec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5914cda85e5e4c7b8c1b16453a0c1270'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:41.736168 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2fe07c67-1f07-4e2e-98f6-55909be8fec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5914cda85e5e4c7b8c1b16453a0c1270'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:41.744160 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2fe07c67-1f07-4e2e-98f6-55909be8fec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5914cda85e5e4c7b8c1b16453a0c1270'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:41.750150 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1369/2735] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:22:41 2022] DELETE /identity/v3/users/5914cda85e5e4c7b8c1b16453a0c1270 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:42.012734 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc21d8-a201-4325-a9a2-668210bd52dd admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:42.014202 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-41cc21d8-a201-4325-a9a2-668210bd52dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:42.027370 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc21d8-a201-4325-a9a2-668210bd52dd admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:42.045365 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:42.086641 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090af18-d457-4853-ba8c-726a722adac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:42.087271 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090af18-d457-4853-ba8c-726a722adac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:42.087520 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090af18-d457-4853-ba8c-726a722adac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:42.087785 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090af18-d457-4853-ba8c-726a722adac7 admin admin] PATH_INFO: `/v3/projects/4b54e1e504af4419803b6d6fa4bb64f5` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:42.088874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090af18-d457-4853-ba8c-726a722adac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b54e1e504af4419803b6d6fa4bb64f5)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:42.090790 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090af18-d457-4853-ba8c-726a722adac7 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:42.134982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-e090af18-d457-4853-ba8c-726a722adac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b54e1e504af4419803b6d6fa4bb64f5', 'request_id': 'req-e090af18-d457-4853-ba8c-726a722adac7'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:42.141485 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-e090af18-d457-4853-ba8c-726a722adac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b54e1e504af4419803b6d6fa4bb64f5', 'request_id': 'req-e090af18-d457-4853-ba8c-726a722adac7'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:42.147455 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-e090af18-d457-4853-ba8c-726a722adac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b54e1e504af4419803b6d6fa4bb64f5', 'request_id': 'req-e090af18-d457-4853-ba8c-726a722adac7'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:42.158448 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-e090af18-d457-4853-ba8c-726a722adac7 admin admin] The token cache is being invalidate because project 4b54e1e504af4419803b6d6fa4bb64f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:22:42.158729 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-e090af18-d457-4853-ba8c-726a722adac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:42.159438 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-e090af18-d457-4853-ba8c-726a722adac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:42.161537 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1367/2736] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:22:42 2022] DELETE /identity/v3/projects/4b54e1e504af4419803b6d6fa4bb64f5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:42.166329 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598ebae-8343-484e-8aea-c8f01e8b7d7e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:42.166785 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598ebae-8343-484e-8aea-c8f01e8b7d7e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:42.166981 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598ebae-8343-484e-8aea-c8f01e8b7d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:42.186172 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-1598ebae-8343-484e-8aea-c8f01e8b7d7e None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:22:42.187393 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1598ebae-8343-484e-8aea-c8f01e8b7d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:42.196758 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:42.248601 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1370/2737] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:22:42.256482 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048252e-4cd9-4c7c-a242-0e72d3ace1c0 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:42.256703 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048252e-4cd9-4c7c-a242-0e72d3ace1c0 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:42.256974 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048252e-4cd9-4c7c-a242-0e72d3ace1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:42.277510 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-0048252e-4cd9-4c7c-a242-0e72d3ace1c0 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:22:42.278684 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0048252e-4cd9-4c7c-a242-0e72d3ace1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:42.287185 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1368/2738] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:22:42.291292 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598ebae-8343-484e-8aea-c8f01e8b7d7e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:42.302519 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598ebae-8343-484e-8aea-c8f01e8b7d7e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:42.309503 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d66cc-4d9f-4c5d-a1c8-c3a57498cb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:42.310057 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d66cc-4d9f-4c5d-a1c8-c3a57498cb89 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:42.310411 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d66cc-4d9f-4c5d-a1c8-c3a57498cb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:42.310650 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d66cc-4d9f-4c5d-a1c8-c3a57498cb89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:42.311431 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d66cc-4d9f-4c5d-a1c8-c3a57498cb89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:22:42.311749 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d66cc-4d9f-4c5d-a1c8-c3a57498cb89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:42.313464 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d66cc-4d9f-4c5d-a1c8-c3a57498cb89 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:42.326105 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1371/2739] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:22:42.330429 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048252e-4cd9-4c7c-a242-0e72d3ace1c0 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:42.340124 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048252e-4cd9-4c7c-a242-0e72d3ace1c0 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:42.344707 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2e106-2390-4a77-865e-42a060edf080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:42.345306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2e106-2390-4a77-865e-42a060edf080 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:42.345578 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2e106-2390-4a77-865e-42a060edf080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:42.345841 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2e106-2390-4a77-865e-42a060edf080 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:42.346451 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e2e106-2390-4a77-865e-42a060edf080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:42.348939 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e2e106-2390-4a77-865e-42a060edf080 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:42.374815 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1369/2740] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:22:42 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:22:42.378903 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d66cc-4d9f-4c5d-a1c8-c3a57498cb89 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:42.389254 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d66cc-4d9f-4c5d-a1c8-c3a57498cb89 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:42.447189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64baa5-0a7e-48a8-92fe-dbb18c378617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:42.447783 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64baa5-0a7e-48a8-92fe-dbb18c378617 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:42.448056 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64baa5-0a7e-48a8-92fe-dbb18c378617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:42.448322 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64baa5-0a7e-48a8-92fe-dbb18c378617 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:42.448942 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64baa5-0a7e-48a8-92fe-dbb18c378617 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:42.450910 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64baa5-0a7e-48a8-92fe-dbb18c378617 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:42.471960 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1372/2741] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:22:42 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:22:42.476141 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2e106-2390-4a77-865e-42a060edf080 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:42.486208 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2e106-2390-4a77-865e-42a060edf080 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:42.490850 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd6993-d026-4607-96f7-3340d5ab1272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:42.491434 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd6993-d026-4607-96f7-3340d5ab1272 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:42.491707 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd6993-d026-4607-96f7-3340d5ab1272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:42.491973 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd6993-d026-4607-96f7-3340d5ab1272 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:42.492602 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd6993-d026-4607-96f7-3340d5ab1272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:42.494216 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd6993-d026-4607-96f7-3340d5ab1272 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:42.504871 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1370/2742] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:22:42.508722 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64baa5-0a7e-48a8-92fe-dbb18c378617 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:42.518306 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64baa5-0a7e-48a8-92fe-dbb18c378617 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:42.523373 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfaab4-6ab2-4277-8171-9ab993ccd08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:42.523981 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfaab4-6ab2-4277-8171-9ab993ccd08d admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:42.524254 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfaab4-6ab2-4277-8171-9ab993ccd08d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:42.524519 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfaab4-6ab2-4277-8171-9ab993ccd08d admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:42.525177 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcfaab4-6ab2-4277-8171-9ab993ccd08d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:42.526750 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcfaab4-6ab2-4277-8171-9ab993ccd08d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:42.537439 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1373/2743] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:22:42.541342 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd6993-d026-4607-96f7-3340d5ab1272 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:42.551369 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd6993-d026-4607-96f7-3340d5ab1272 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:42.555984 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf79fd-a025-463f-87e7-4b68feabf674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:42.556613 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf79fd-a025-463f-87e7-4b68feabf674 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:42.556884 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf79fd-a025-463f-87e7-4b68feabf674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:42.557327 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf79fd-a025-463f-87e7-4b68feabf674 admin admin] PATH_INFO: `/v3/projects/7d8ee52f8ee44885b7793d9feb39a122/users/8ba2e51279f243099e13992914c71c80/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:42.572038 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf79fd-a025-463f-87e7-4b68feabf674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d8ee52f8ee44885b7793d9feb39a122, user_id=8ba2e51279f243099e13992914c71c80, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:42.574691 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf79fd-a025-463f-87e7-4b68feabf674 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:42.587656 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1371/2744] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:22:42 2022] PUT /identity/v3/projects/7d8ee52f8ee44885b7793d9feb39a122/users/8ba2e51279f243099e13992914c71c80/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:42.598670 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab808d-9b31-4b48-bfd0-4ea67d3b3c7f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:42.598960 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab808d-9b31-4b48-bfd0-4ea67d3b3c7f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:42.599236 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab808d-9b31-4b48-bfd0-4ea67d3b3c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:42.626550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-1dab808d-9b31-4b48-bfd0-4ea67d3b3c7f None None] MFA Rules not processed for user `8ba2e51279f243099e13992914c71c80`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:22:42.627771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1dab808d-9b31-4b48-bfd0-4ea67d3b3c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:42.691203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1374/2745] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:22:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:22:42.696155 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf79fd-a025-463f-87e7-4b68feabf674 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:42.743291 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:42.762637 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf79fd-a025-463f-87e7-4b68feabf674 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:42.767376 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e29cc-9b31-46ec-ad09-9e9404a6671d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:42.767972 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e29cc-9b31-46ec-ad09-9e9404a6671d admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:42.768248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e29cc-9b31-46ec-ad09-9e9404a6671d admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:42.768515 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e29cc-9b31-46ec-ad09-9e9404a6671d admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:42.769202 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e29cc-9b31-46ec-ad09-9e9404a6671d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:42.771130 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e29cc-9b31-46ec-ad09-9e9404a6671d admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:42.798147 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1372/2746] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:22:42 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:22:42.802767 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab808d-9b31-4b48-bfd0-4ea67d3b3c7f None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:42.814553 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab808d-9b31-4b48-bfd0-4ea67d3b3c7f None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:42.823096 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:42.872265 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bead5e-bb86-468b-8ac2-bd4a42593d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:42.872862 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bead5e-bb86-468b-8ac2-bd4a42593d9c admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:42.873176 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bead5e-bb86-468b-8ac2-bd4a42593d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:42.873458 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bead5e-bb86-468b-8ac2-bd4a42593d9c admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:42.874077 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bead5e-bb86-468b-8ac2-bd4a42593d9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:42.876000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bead5e-bb86-468b-8ac2-bd4a42593d9c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:42.896669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1375/2747] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:22:42 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:22:42.900672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e29cc-9b31-46ec-ad09-9e9404a6671d admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:42.911860 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e29cc-9b31-46ec-ad09-9e9404a6671d admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:42.916526 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1b77e-d6fd-4421-beb8-43f3fe64b6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:42.917135 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1b77e-d6fd-4421-beb8-43f3fe64b6aa admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:42.917409 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1b77e-d6fd-4421-beb8-43f3fe64b6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:42.917672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1b77e-d6fd-4421-beb8-43f3fe64b6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:42.918331 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1b77e-d6fd-4421-beb8-43f3fe64b6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:42.919938 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1b77e-d6fd-4421-beb8-43f3fe64b6aa admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:42.930433 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1373/2748] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:22:42.934502 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bead5e-bb86-468b-8ac2-bd4a42593d9c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:42.944383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bead5e-bb86-468b-8ac2-bd4a42593d9c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:42.948989 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41109817-5ccc-4613-bc81-86a08807d008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:42.949667 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41109817-5ccc-4613-bc81-86a08807d008 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:42.949949 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41109817-5ccc-4613-bc81-86a08807d008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:42.950225 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41109817-5ccc-4613-bc81-86a08807d008 admin admin] PATH_INFO: `/v3/projects/fa48d6064d1542598aca829dda955033/users/b59b47e556b74e41a7e9f65e2b97f2a8/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:42.965353 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41109817-5ccc-4613-bc81-86a08807d008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa48d6064d1542598aca829dda955033, user_id=b59b47e556b74e41a7e9f65e2b97f2a8, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:42.968020 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41109817-5ccc-4613-bc81-86a08807d008 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:42.980985 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1376/2749] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:22:42 2022] PUT /identity/v3/projects/fa48d6064d1542598aca829dda955033/users/b59b47e556b74e41a7e9f65e2b97f2a8/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:42.984812 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1b77e-d6fd-4421-beb8-43f3fe64b6aa admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:42.994844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1b77e-d6fd-4421-beb8-43f3fe64b6aa admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:43.050299 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1057b5e-7cc7-4539-ab25-a2fd00598112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:43.050817 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1057b5e-7cc7-4539-ab25-a2fd00598112 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:43.051116 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1057b5e-7cc7-4539-ab25-a2fd00598112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:43.051387 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1057b5e-7cc7-4539-ab25-a2fd00598112 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:43.052020 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1057b5e-7cc7-4539-ab25-a2fd00598112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:43.053660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1057b5e-7cc7-4539-ab25-a2fd00598112 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:43.063101 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1374/2750] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:22:43.067288 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41109817-5ccc-4613-bc81-86a08807d008 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:43.077687 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41109817-5ccc-4613-bc81-86a08807d008 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:43.082810 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63f669-3a26-4fe2-aaa1-e4979b7e07b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:43.083444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63f669-3a26-4fe2-aaa1-e4979b7e07b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:43.083715 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63f669-3a26-4fe2-aaa1-e4979b7e07b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:43.084000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63f669-3a26-4fe2-aaa1-e4979b7e07b3 admin admin] PATH_INFO: `/v3/projects/fa48d6064d1542598aca829dda955033/users/b59b47e556b74e41a7e9f65e2b97f2a8/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:43.085945 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63f669-3a26-4fe2-aaa1-e4979b7e07b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa48d6064d1542598aca829dda955033, user_id=b59b47e556b74e41a7e9f65e2b97f2a8, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:43.088589 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63f669-3a26-4fe2-aaa1-e4979b7e07b3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:43.099956 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1377/2751] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:22:43 2022] PUT /identity/v3/projects/fa48d6064d1542598aca829dda955033/users/b59b47e556b74e41a7e9f65e2b97f2a8/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:43.111091 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc286fe2-7e20-4a5b-a06c-5ceddb07b871 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:43.111575 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc286fe2-7e20-4a5b-a06c-5ceddb07b871 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:43.111692 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc286fe2-7e20-4a5b-a06c-5ceddb07b871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:43.139619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-bc286fe2-7e20-4a5b-a06c-5ceddb07b871 None None] MFA Rules not processed for user `b59b47e556b74e41a7e9f65e2b97f2a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:22:43.140807 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-bc286fe2-7e20-4a5b-a06c-5ceddb07b871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:43.208650 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1375/2752] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:22:43 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:22:43.220699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63f669-3a26-4fe2-aaa1-e4979b7e07b3 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:43.222439 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9d63f669-3a26-4fe2-aaa1-e4979b7e07b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:43.281809 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63f669-3a26-4fe2-aaa1-e4979b7e07b3 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:43.285455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5a39f-1a36-4faa-a762-7a514a0f210b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:43.286050 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5a39f-1a36-4faa-a762-7a514a0f210b service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:43.286326 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5a39f-1a36-4faa-a762-7a514a0f210b service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:43.286596 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5a39f-1a36-4faa-a762-7a514a0f210b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:43.295391 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad5a39f-1a36-4faa-a762-7a514a0f210b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:43.296805 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad5a39f-1a36-4faa-a762-7a514a0f210b service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:43.306181 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1378/2753] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:22:43 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:22:43.390165 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc286fe2-7e20-4a5b-a06c-5ceddb07b871 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:43.400360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc286fe2-7e20-4a5b-a06c-5ceddb07b871 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:43.403963 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac013dea-ca10-4e44-b3c3-158f3d5b8af3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:43.404549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac013dea-ca10-4e44-b3c3-158f3d5b8af3 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:43.405071 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac013dea-ca10-4e44-b3c3-158f3d5b8af3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:43.405377 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac013dea-ca10-4e44-b3c3-158f3d5b8af3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:43.446092 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:43.464116 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac013dea-ca10-4e44-b3c3-158f3d5b8af3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:43.465660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac013dea-ca10-4e44-b3c3-158f3d5b8af3 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:43.474789 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1376/2754] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:22:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:22:48.147857 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5a39f-1a36-4faa-a762-7a514a0f210b service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:48.209788 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5a39f-1a36-4faa-a762-7a514a0f210b service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:48.214844 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8f3bf-89c1-4cde-9b6b-964498716ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:48.215463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8f3bf-89c1-4cde-9b6b-964498716ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:48.215740 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8f3bf-89c1-4cde-9b6b-964498716ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:48.216011 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8f3bf-89c1-4cde-9b6b-964498716ccb admin admin] PATH_INFO: `/v3/users/8ba2e51279f243099e13992914c71c80` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:48.217145 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8f3bf-89c1-4cde-9b6b-964498716ccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ba2e51279f243099e13992914c71c80)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:48.219055 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8f3bf-89c1-4cde-9b6b-964498716ccb admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:48.224519 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:48.265136 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-68d8f3bf-89c1-4cde-9b6b-964498716ccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ba2e51279f243099e13992914c71c80'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:48.272432 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-68d8f3bf-89c1-4cde-9b6b-964498716ccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ba2e51279f243099e13992914c71c80'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:48.285420 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-68d8f3bf-89c1-4cde-9b6b-964498716ccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ba2e51279f243099e13992914c71c80'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:48.286072 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-68d8f3bf-89c1-4cde-9b6b-964498716ccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ba2e51279f243099e13992914c71c80'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:48.293170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-68d8f3bf-89c1-4cde-9b6b-964498716ccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ba2e51279f243099e13992914c71c80'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:48.298976 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1379/2755] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:22:48 2022] DELETE /identity/v3/users/8ba2e51279f243099e13992914c71c80 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:48.303594 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80836471-72bb-4381-ba87-d50daff1c91d None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:48.304062 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80836471-72bb-4381-ba87-d50daff1c91d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:48.304182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80836471-72bb-4381-ba87-d50daff1c91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:48.324026 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-80836471-72bb-4381-ba87-d50daff1c91d None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:22:48.325756 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-80836471-72bb-4381-ba87-d50daff1c91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:48.389389 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1377/2756] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:22:48.399121 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8f3bf-89c1-4cde-9b6b-964498716ccb admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:48.401234 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-68d8f3bf-89c1-4cde-9b6b-964498716ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:48.458482 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8f3bf-89c1-4cde-9b6b-964498716ccb admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:48.462659 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c91345-8a09-457d-8431-b40bec37381e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:48.463251 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c91345-8a09-457d-8431-b40bec37381e service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:48.463523 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c91345-8a09-457d-8431-b40bec37381e service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:48.463787 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c91345-8a09-457d-8431-b40bec37381e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:48.472573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c91345-8a09-457d-8431-b40bec37381e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:48.474049 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c91345-8a09-457d-8431-b40bec37381e service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:48.483249 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1380/2757] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:22:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:22:48.753065 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80836471-72bb-4381-ba87-d50daff1c91d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:48.755083 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-80836471-72bb-4381-ba87-d50daff1c91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:48.767728 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80836471-72bb-4381-ba87-d50daff1c91d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:48.772215 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130e290-64f5-43d1-b345-eba7a377fa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:48.772823 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130e290-64f5-43d1-b345-eba7a377fa08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:48.773114 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130e290-64f5-43d1-b345-eba7a377fa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:48.773388 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130e290-64f5-43d1-b345-eba7a377fa08 admin admin] PATH_INFO: `/v3/projects/7d8ee52f8ee44885b7793d9feb39a122` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:48.774555 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130e290-64f5-43d1-b345-eba7a377fa08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d8ee52f8ee44885b7793d9feb39a122)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:48.776445 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130e290-64f5-43d1-b345-eba7a377fa08 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:48.823563 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-8130e290-64f5-43d1-b345-eba7a377fa08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d8ee52f8ee44885b7793d9feb39a122', 'request_id': 'req-8130e290-64f5-43d1-b345-eba7a377fa08'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:48.830835 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-8130e290-64f5-43d1-b345-eba7a377fa08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d8ee52f8ee44885b7793d9feb39a122', 'request_id': 'req-8130e290-64f5-43d1-b345-eba7a377fa08'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:48.836508 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-8130e290-64f5-43d1-b345-eba7a377fa08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d8ee52f8ee44885b7793d9feb39a122', 'request_id': 'req-8130e290-64f5-43d1-b345-eba7a377fa08'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:48.847700 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-8130e290-64f5-43d1-b345-eba7a377fa08 admin admin] The token cache is being invalidate because project 7d8ee52f8ee44885b7793d9feb39a122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:22:48.847982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-8130e290-64f5-43d1-b345-eba7a377fa08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:48.848611 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-8130e290-64f5-43d1-b345-eba7a377fa08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:48.850128 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1378/2758] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:22:48 2022] DELETE /identity/v3/projects/7d8ee52f8ee44885b7793d9feb39a122 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:48.854079 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c91345-8a09-457d-8431-b40bec37381e service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:48.863428 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c91345-8a09-457d-8431-b40bec37381e service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:48.918578 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec1681-70f1-4b3b-8a13-1622aadab173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:48.919197 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec1681-70f1-4b3b-8a13-1622aadab173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:48.919474 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec1681-70f1-4b3b-8a13-1622aadab173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:48.919748 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec1681-70f1-4b3b-8a13-1622aadab173 admin admin] PATH_INFO: `/v3/users/b59b47e556b74e41a7e9f65e2b97f2a8` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:48.920860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec1681-70f1-4b3b-8a13-1622aadab173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b59b47e556b74e41a7e9f65e2b97f2a8)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:48.922833 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec1681-70f1-4b3b-8a13-1622aadab173 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:48.958807 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:48.973902 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7dec1681-70f1-4b3b-8a13-1622aadab173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b59b47e556b74e41a7e9f65e2b97f2a8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:48.983947 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7dec1681-70f1-4b3b-8a13-1622aadab173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b59b47e556b74e41a7e9f65e2b97f2a8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:48.996444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7dec1681-70f1-4b3b-8a13-1622aadab173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b59b47e556b74e41a7e9f65e2b97f2a8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:48.997072 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7dec1681-70f1-4b3b-8a13-1622aadab173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b59b47e556b74e41a7e9f65e2b97f2a8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:49.003929 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7dec1681-70f1-4b3b-8a13-1622aadab173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b59b47e556b74e41a7e9f65e2b97f2a8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:49.010415 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1381/2759] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:22:48 2022] DELETE /identity/v3/users/b59b47e556b74e41a7e9f65e2b97f2a8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:49.271968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130e290-64f5-43d1-b345-eba7a377fa08 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:49.273511 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8130e290-64f5-43d1-b345-eba7a377fa08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:49.289000 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130e290-64f5-43d1-b345-eba7a377fa08 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:49.347799 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca4ff6-29c3-4275-9011-5a116135866e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:49.348443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca4ff6-29c3-4275-9011-5a116135866e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:49.348674 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca4ff6-29c3-4275-9011-5a116135866e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:49.348938 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca4ff6-29c3-4275-9011-5a116135866e admin admin] PATH_INFO: `/v3/projects/fa48d6064d1542598aca829dda955033` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:49.350081 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca4ff6-29c3-4275-9011-5a116135866e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa48d6064d1542598aca829dda955033)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:49.352016 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca4ff6-29c3-4275-9011-5a116135866e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:49.358856 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:49.408297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-20ca4ff6-29c3-4275-9011-5a116135866e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa48d6064d1542598aca829dda955033', 'request_id': 'req-20ca4ff6-29c3-4275-9011-5a116135866e'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:49.421441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-20ca4ff6-29c3-4275-9011-5a116135866e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa48d6064d1542598aca829dda955033', 'request_id': 'req-20ca4ff6-29c3-4275-9011-5a116135866e'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:49.427440 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-20ca4ff6-29c3-4275-9011-5a116135866e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa48d6064d1542598aca829dda955033', 'request_id': 'req-20ca4ff6-29c3-4275-9011-5a116135866e'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:49.438526 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-20ca4ff6-29c3-4275-9011-5a116135866e admin admin] The token cache is being invalidate because project fa48d6064d1542598aca829dda955033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:22:49.438806 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-20ca4ff6-29c3-4275-9011-5a116135866e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:49.439423 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-20ca4ff6-29c3-4275-9011-5a116135866e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:22:49.440893 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1379/2760] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:22:49 2022] DELETE /identity/v3/projects/fa48d6064d1542598aca829dda955033 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:22:49.446599 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381c70b-c2cc-4517-80cf-aa49684dd5fd None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:49.447073 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381c70b-c2cc-4517-80cf-aa49684dd5fd None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:49.447171 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381c70b-c2cc-4517-80cf-aa49684dd5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:49.467337 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-6381c70b-c2cc-4517-80cf-aa49684dd5fd None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:22:49.468549 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6381c70b-c2cc-4517-80cf-aa49684dd5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:49.525354 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1382/2761] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:22:49.533564 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88995c85-d574-4864-a4b3-81f4f2fe6a41 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:49.533926 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88995c85-d574-4864-a4b3-81f4f2fe6a41 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:49.534195 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88995c85-d574-4864-a4b3-81f4f2fe6a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:49.554004 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-88995c85-d574-4864-a4b3-81f4f2fe6a41 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:22:49.555184 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-88995c85-d574-4864-a4b3-81f4f2fe6a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:49.562992 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1380/2762] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:22:49.567052 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381c70b-c2cc-4517-80cf-aa49684dd5fd None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:49.576608 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381c70b-c2cc-4517-80cf-aa49684dd5fd None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:49.581221 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47adf5a-eb22-4c7f-a80a-2801f6510ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:49.581840 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47adf5a-eb22-4c7f-a80a-2801f6510ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:49.582115 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47adf5a-eb22-4c7f-a80a-2801f6510ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:49.582383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47adf5a-eb22-4c7f-a80a-2801f6510ac3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:49.583034 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47adf5a-eb22-4c7f-a80a-2801f6510ac3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:22:49.583351 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47adf5a-eb22-4c7f-a80a-2801f6510ac3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:49.584948 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47adf5a-eb22-4c7f-a80a-2801f6510ac3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:49.596752 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1383/2763] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:22:49.600769 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88995c85-d574-4864-a4b3-81f4f2fe6a41 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:49.610399 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88995c85-d574-4864-a4b3-81f4f2fe6a41 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:49.615147 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b09c2-c418-450f-9795-0236dffc6251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:49.615872 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b09c2-c418-450f-9795-0236dffc6251 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:49.616173 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b09c2-c418-450f-9795-0236dffc6251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:49.616444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b09c2-c418-450f-9795-0236dffc6251 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:49.617069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b09c2-c418-450f-9795-0236dffc6251 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:49.619316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b09c2-c418-450f-9795-0236dffc6251 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:49.645490 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1381/2764] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:22:49 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:22:49.650509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47adf5a-eb22-4c7f-a80a-2801f6510ac3 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:49.660668 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47adf5a-eb22-4c7f-a80a-2801f6510ac3 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:49.715677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80338f-e363-4b62-a0e0-7be9040babf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:49.716276 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80338f-e363-4b62-a0e0-7be9040babf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:49.716553 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80338f-e363-4b62-a0e0-7be9040babf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:49.716820 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80338f-e363-4b62-a0e0-7be9040babf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:49.717491 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80338f-e363-4b62-a0e0-7be9040babf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:49.719398 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80338f-e363-4b62-a0e0-7be9040babf8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:49.745190 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1384/2765] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:22:49 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:22:49.749717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b09c2-c418-450f-9795-0236dffc6251 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:49.760412 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b09c2-c418-450f-9795-0236dffc6251 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:49.765037 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4ec14-2079-4f68-8d0c-70f8d61bbf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:49.765649 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4ec14-2079-4f68-8d0c-70f8d61bbf34 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:49.765924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4ec14-2079-4f68-8d0c-70f8d61bbf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:49.766194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4ec14-2079-4f68-8d0c-70f8d61bbf34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:49.766829 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4ec14-2079-4f68-8d0c-70f8d61bbf34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:49.768402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4ec14-2079-4f68-8d0c-70f8d61bbf34 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:49.778788 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1382/2766] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:22:49.782799 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80338f-e363-4b62-a0e0-7be9040babf8 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:49.792771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80338f-e363-4b62-a0e0-7be9040babf8 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:49.798032 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a17c74-a417-4a24-92ae-ca34a823505e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:49.798614 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a17c74-a417-4a24-92ae-ca34a823505e admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:49.798893 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a17c74-a417-4a24-92ae-ca34a823505e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:49.799164 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a17c74-a417-4a24-92ae-ca34a823505e admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:49.799797 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a17c74-a417-4a24-92ae-ca34a823505e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:49.801432 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a17c74-a417-4a24-92ae-ca34a823505e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:49.811813 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1385/2767] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:22:49.815665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4ec14-2079-4f68-8d0c-70f8d61bbf34 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:49.825986 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4ec14-2079-4f68-8d0c-70f8d61bbf34 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:49.830589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd9ef1-21f0-4c02-ace1-d738f4162ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:49.831219 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd9ef1-21f0-4c02-ace1-d738f4162ddc admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:49.831494 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd9ef1-21f0-4c02-ace1-d738f4162ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:49.831764 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd9ef1-21f0-4c02-ace1-d738f4162ddc admin admin] PATH_INFO: `/v3/projects/3cf226ed6adb4053a189c9b23087cc97/users/c22f23cda9634214876ce6a681b88008/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:49.846611 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd9ef1-21f0-4c02-ace1-d738f4162ddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf226ed6adb4053a189c9b23087cc97, user_id=c22f23cda9634214876ce6a681b88008, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:49.849282 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd9ef1-21f0-4c02-ace1-d738f4162ddc admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:49.862338 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1383/2768] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:22:49 2022] PUT /identity/v3/projects/3cf226ed6adb4053a189c9b23087cc97/users/c22f23cda9634214876ce6a681b88008/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:22:49.926779 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca772c4c-dc85-4b73-834e-cfd4234b5769 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:49.927059 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca772c4c-dc85-4b73-834e-cfd4234b5769 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:49.927329 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca772c4c-dc85-4b73-834e-cfd4234b5769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:49.952899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:49.955938 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ca772c4c-dc85-4b73-834e-cfd4234b5769 None None] MFA Rules not processed for user `c22f23cda9634214876ce6a681b88008`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:22:49.957943 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ca772c4c-dc85-4b73-834e-cfd4234b5769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:50.027076 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1386/2769] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:22:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:22:50.039797 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd9ef1-21f0-4c02-ace1-d738f4162ddc admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:22:50.041535 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a2fd9ef1-21f0-4c02-ace1-d738f4162ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:22:50.099879 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd9ef1-21f0-4c02-ace1-d738f4162ddc admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:22:50.103487 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b874d-2a46-474c-a7a9-fe77a38a5548 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22959df6ef034036b5f6b3cda7918e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:22:50.104077 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b874d-2a46-474c-a7a9-fe77a38a5548 service glance] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:22:50.104350 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b874d-2a46-474c-a7a9-fe77a38a5548 service glance] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:22:50.104617 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b874d-2a46-474c-a7a9-fe77a38a5548 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:22:50.112783 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b874d-2a46-474c-a7a9-fe77a38a5548 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:22:50.114194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b874d-2a46-474c-a7a9-fe77a38a5548 service glance] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:22:50.122739 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1384/2770] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:22:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:23:00.023426 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=26 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:23:00.118784 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=75,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:23:08.793974 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca772c4c-dc85-4b73-834e-cfd4234b5769 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:08.855146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca772c4c-dc85-4b73-834e-cfd4234b5769 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:08.859632 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f967624-23c6-43d1-9110-60bfb0f5713c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:08.860253 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f967624-23c6-43d1-9110-60bfb0f5713c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:08.860527 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f967624-23c6-43d1-9110-60bfb0f5713c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:08.860797 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f967624-23c6-43d1-9110-60bfb0f5713c admin admin] PATH_INFO: `/v3/users/c22f23cda9634214876ce6a681b88008` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:08.861935 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f967624-23c6-43d1-9110-60bfb0f5713c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c22f23cda9634214876ce6a681b88008)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:08.863855 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f967624-23c6-43d1-9110-60bfb0f5713c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:08.909498 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9f967624-23c6-43d1-9110-60bfb0f5713c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c22f23cda9634214876ce6a681b88008'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:08.916858 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9f967624-23c6-43d1-9110-60bfb0f5713c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c22f23cda9634214876ce6a681b88008'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:08.928548 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9f967624-23c6-43d1-9110-60bfb0f5713c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c22f23cda9634214876ce6a681b88008'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:08.929205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9f967624-23c6-43d1-9110-60bfb0f5713c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c22f23cda9634214876ce6a681b88008'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:08.937138 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9f967624-23c6-43d1-9110-60bfb0f5713c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c22f23cda9634214876ce6a681b88008'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:08.942989 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1387/2771] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:23:08 2022] DELETE /identity/v3/users/c22f23cda9634214876ce6a681b88008 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:23:08.948095 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc14d14-fbad-47bb-9f3b-d655770ae4e4 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:08.948520 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc14d14-fbad-47bb-9f3b-d655770ae4e4 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:08.948622 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc14d14-fbad-47bb-9f3b-d655770ae4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:08.967087 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-adc14d14-fbad-47bb-9f3b-d655770ae4e4 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:23:08.968269 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-adc14d14-fbad-47bb-9f3b-d655770ae4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:09.024756 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1385/2772] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:23:09.034793 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f967624-23c6-43d1-9110-60bfb0f5713c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:09.036206 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9f967624-23c6-43d1-9110-60bfb0f5713c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:09.093090 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f967624-23c6-43d1-9110-60bfb0f5713c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:09.096662 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc92656-4a2a-4db9-98c0-ccf744b0683f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:09.097292 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc92656-4a2a-4db9-98c0-ccf744b0683f service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:09.097569 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc92656-4a2a-4db9-98c0-ccf744b0683f service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:09.097888 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc92656-4a2a-4db9-98c0-ccf744b0683f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:09.106717 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc92656-4a2a-4db9-98c0-ccf744b0683f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:09.108125 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc92656-4a2a-4db9-98c0-ccf744b0683f service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:09.117424 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1388/2773] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:23:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:23:09.376523 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc14d14-fbad-47bb-9f3b-d655770ae4e4 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:09.378319 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-adc14d14-fbad-47bb-9f3b-d655770ae4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:09.390822 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc14d14-fbad-47bb-9f3b-d655770ae4e4 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:09.398136 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f0bc4-0a7c-4fe5-9d21-208abaaeaa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:09.398778 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f0bc4-0a7c-4fe5-9d21-208abaaeaa71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:09.399059 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f0bc4-0a7c-4fe5-9d21-208abaaeaa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:09.399331 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f0bc4-0a7c-4fe5-9d21-208abaaeaa71 admin admin] PATH_INFO: `/v3/projects/3cf226ed6adb4053a189c9b23087cc97` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:09.400714 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f0bc4-0a7c-4fe5-9d21-208abaaeaa71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf226ed6adb4053a189c9b23087cc97)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:09.403268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f0bc4-0a7c-4fe5-9d21-208abaaeaa71 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:09.451620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-618f0bc4-0a7c-4fe5-9d21-208abaaeaa71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf226ed6adb4053a189c9b23087cc97', 'request_id': 'req-618f0bc4-0a7c-4fe5-9d21-208abaaeaa71'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:09.458966 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-618f0bc4-0a7c-4fe5-9d21-208abaaeaa71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf226ed6adb4053a189c9b23087cc97', 'request_id': 'req-618f0bc4-0a7c-4fe5-9d21-208abaaeaa71'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:09.464288 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-618f0bc4-0a7c-4fe5-9d21-208abaaeaa71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf226ed6adb4053a189c9b23087cc97', 'request_id': 'req-618f0bc4-0a7c-4fe5-9d21-208abaaeaa71'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:09.475572 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-618f0bc4-0a7c-4fe5-9d21-208abaaeaa71 admin admin] The token cache is being invalidate because project 3cf226ed6adb4053a189c9b23087cc97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:23:09.475893 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-618f0bc4-0a7c-4fe5-9d21-208abaaeaa71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:09.476520 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-618f0bc4-0a7c-4fe5-9d21-208abaaeaa71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:09.478030 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1386/2774] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:23:09 2022] DELETE /identity/v3/projects/3cf226ed6adb4053a189c9b23087cc97 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:23:09.483487 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21e70a-0857-4192-86a5-4848d2714364 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:09.483772 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21e70a-0857-4192-86a5-4848d2714364 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:09.484045 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21e70a-0857-4192-86a5-4848d2714364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:09.503684 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-4b21e70a-0857-4192-86a5-4848d2714364 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:23:09.504878 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4b21e70a-0857-4192-86a5-4848d2714364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:09.521499 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:23:09.565062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1389/2775] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:23:09.572867 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdb1ed-1621-4004-bcc0-e83a193ca695 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:09.573560 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdb1ed-1621-4004-bcc0-e83a193ca695 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:09.573867 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdb1ed-1621-4004-bcc0-e83a193ca695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:09.593899 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-fcbdb1ed-1621-4004-bcc0-e83a193ca695 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:23:09.595100 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-fcbdb1ed-1621-4004-bcc0-e83a193ca695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:09.602961 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1387/2776] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:23:09.607624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21e70a-0857-4192-86a5-4848d2714364 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:09.617346 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21e70a-0857-4192-86a5-4848d2714364 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:09.621953 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea022b6-ca73-49da-a13a-c301e34bf5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:09.622548 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea022b6-ca73-49da-a13a-c301e34bf5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:09.622846 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea022b6-ca73-49da-a13a-c301e34bf5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:09.623110 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea022b6-ca73-49da-a13a-c301e34bf5a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:09.623743 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea022b6-ca73-49da-a13a-c301e34bf5a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:23:09.624037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea022b6-ca73-49da-a13a-c301e34bf5a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:09.625667 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea022b6-ca73-49da-a13a-c301e34bf5a2 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:09.637478 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1390/2777] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:23:09.641725 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdb1ed-1621-4004-bcc0-e83a193ca695 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:09.651627 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdb1ed-1621-4004-bcc0-e83a193ca695 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:09.656795 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794db72a-f169-407d-8537-63e98a63019d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:09.657416 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794db72a-f169-407d-8537-63e98a63019d admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:09.657694 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794db72a-f169-407d-8537-63e98a63019d admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:09.657963 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794db72a-f169-407d-8537-63e98a63019d admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:09.658585 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794db72a-f169-407d-8537-63e98a63019d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:09.660494 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794db72a-f169-407d-8537-63e98a63019d admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:09.687141 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1388/2778] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:23:09 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:23:09.691233 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea022b6-ca73-49da-a13a-c301e34bf5a2 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:09.702307 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea022b6-ca73-49da-a13a-c301e34bf5a2 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:09.762600 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7daf3c-887a-4783-b60e-2a953aec6758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:09.763116 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7daf3c-887a-4783-b60e-2a953aec6758 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:09.763390 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7daf3c-887a-4783-b60e-2a953aec6758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:09.763653 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7daf3c-887a-4783-b60e-2a953aec6758 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:09.764271 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7daf3c-887a-4783-b60e-2a953aec6758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:09.766251 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7daf3c-887a-4783-b60e-2a953aec6758 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:09.787509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1391/2779] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:23:09 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:23:09.792311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794db72a-f169-407d-8537-63e98a63019d admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:09.802696 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794db72a-f169-407d-8537-63e98a63019d admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:09.807357 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75846e-5e54-4e79-af6a-360fbcca145e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:09.807941 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75846e-5e54-4e79-af6a-360fbcca145e admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:09.808214 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75846e-5e54-4e79-af6a-360fbcca145e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:09.808477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75846e-5e54-4e79-af6a-360fbcca145e admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:09.809137 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75846e-5e54-4e79-af6a-360fbcca145e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:09.810708 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75846e-5e54-4e79-af6a-360fbcca145e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:09.820475 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1389/2780] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:23:09.825158 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7daf3c-887a-4783-b60e-2a953aec6758 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:09.834892 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7daf3c-887a-4783-b60e-2a953aec6758 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:09.839964 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd672b16-df9a-4bc9-9c66-30d78be1b6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:09.840544 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd672b16-df9a-4bc9-9c66-30d78be1b6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:09.840819 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd672b16-df9a-4bc9-9c66-30d78be1b6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:09.841086 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd672b16-df9a-4bc9-9c66-30d78be1b6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:09.841746 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd672b16-df9a-4bc9-9c66-30d78be1b6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:09.843318 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd672b16-df9a-4bc9-9c66-30d78be1b6e7 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:09.853684 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1392/2781] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:23:09.858148 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75846e-5e54-4e79-af6a-360fbcca145e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:09.867745 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75846e-5e54-4e79-af6a-360fbcca145e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:09.872546 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7cf3b-b505-4c8c-ae22-e38e382085fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:09.873228 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7cf3b-b505-4c8c-ae22-e38e382085fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:09.873513 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7cf3b-b505-4c8c-ae22-e38e382085fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:09.873888 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7cf3b-b505-4c8c-ae22-e38e382085fe admin admin] PATH_INFO: `/v3/projects/9338e36ee29e469c81cefc9564e6700f/users/8e92cd65ce8540a58492fa9deb362eef/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:09.888081 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7cf3b-b505-4c8c-ae22-e38e382085fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9338e36ee29e469c81cefc9564e6700f, user_id=8e92cd65ce8540a58492fa9deb362eef, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:09.890745 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7cf3b-b505-4c8c-ae22-e38e382085fe admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:09.905442 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1390/2782] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:23:09 2022] PUT /identity/v3/projects/9338e36ee29e469c81cefc9564e6700f/users/8e92cd65ce8540a58492fa9deb362eef/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:23:09.916821 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fbdc4-be0d-4ff1-8427-93972172543e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:09.917211 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fbdc4-be0d-4ff1-8427-93972172543e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:09.917518 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fbdc4-be0d-4ff1-8427-93972172543e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:09.944878 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-729fbdc4-be0d-4ff1-8427-93972172543e None None] MFA Rules not processed for user `8e92cd65ce8540a58492fa9deb362eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:23:09.946197 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-729fbdc4-be0d-4ff1-8427-93972172543e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:10.009372 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1393/2783] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:23:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:23:10.020691 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7cf3b-b505-4c8c-ae22-e38e382085fe admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:10.022388 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5ba7cf3b-b505-4c8c-ae22-e38e382085fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:10.048060 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:23:10.089034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7cf3b-b505-4c8c-ae22-e38e382085fe admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:10.092783 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8527af-8e6d-49ad-b831-1d2a23a10103 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:10.093411 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8527af-8e6d-49ad-b831-1d2a23a10103 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:10.093691 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8527af-8e6d-49ad-b831-1d2a23a10103 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:10.093969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8527af-8e6d-49ad-b831-1d2a23a10103 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:10.102284 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8527af-8e6d-49ad-b831-1d2a23a10103 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:10.103699 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8527af-8e6d-49ad-b831-1d2a23a10103 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:10.112443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1391/2784] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:23:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:23:13.105253 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fbdc4-be0d-4ff1-8427-93972172543e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:13.123646 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:23:13.168471 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fbdc4-be0d-4ff1-8427-93972172543e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:13.173000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0b037-25c0-44dc-a1d3-84cd9f653934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:13.173645 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0b037-25c0-44dc-a1d3-84cd9f653934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:13.173929 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0b037-25c0-44dc-a1d3-84cd9f653934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:13.174200 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0b037-25c0-44dc-a1d3-84cd9f653934 admin admin] PATH_INFO: `/v3/users/8e92cd65ce8540a58492fa9deb362eef` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:13.175318 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0b037-25c0-44dc-a1d3-84cd9f653934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e92cd65ce8540a58492fa9deb362eef)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:13.177283 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0b037-25c0-44dc-a1d3-84cd9f653934 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:13.222899 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-12b0b037-25c0-44dc-a1d3-84cd9f653934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e92cd65ce8540a58492fa9deb362eef'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:13.229976 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-12b0b037-25c0-44dc-a1d3-84cd9f653934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e92cd65ce8540a58492fa9deb362eef'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:13.242137 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-12b0b037-25c0-44dc-a1d3-84cd9f653934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e92cd65ce8540a58492fa9deb362eef'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:13.242771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-12b0b037-25c0-44dc-a1d3-84cd9f653934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e92cd65ce8540a58492fa9deb362eef'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:13.249713 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-12b0b037-25c0-44dc-a1d3-84cd9f653934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e92cd65ce8540a58492fa9deb362eef'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:13.255507 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1394/2785] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:23:13 2022] DELETE /identity/v3/users/8e92cd65ce8540a58492fa9deb362eef => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:23:13.260486 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e244f7b-9ef0-4005-9bb3-0470b32378a0 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:13.260956 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e244f7b-9ef0-4005-9bb3-0470b32378a0 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:13.261053 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e244f7b-9ef0-4005-9bb3-0470b32378a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:13.281007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-7e244f7b-9ef0-4005-9bb3-0470b32378a0 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:23:13.282230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7e244f7b-9ef0-4005-9bb3-0470b32378a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:13.338508 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1392/2786] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:23:13.348112 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0b037-25c0-44dc-a1d3-84cd9f653934 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:13.349569 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-12b0b037-25c0-44dc-a1d3-84cd9f653934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:13.406185 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0b037-25c0-44dc-a1d3-84cd9f653934 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:13.410073 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa0b86-19bf-45b0-8c03-537edd96db7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:13.410677 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa0b86-19bf-45b0-8c03-537edd96db7b service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:13.410946 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa0b86-19bf-45b0-8c03-537edd96db7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:13.411214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa0b86-19bf-45b0-8c03-537edd96db7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:13.422452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa0b86-19bf-45b0-8c03-537edd96db7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:13.424205 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa0b86-19bf-45b0-8c03-537edd96db7b service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:13.434832 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1395/2787] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:23:13.693263 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e244f7b-9ef0-4005-9bb3-0470b32378a0 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:13.694702 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7e244f7b-9ef0-4005-9bb3-0470b32378a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:13.706996 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e244f7b-9ef0-4005-9bb3-0470b32378a0 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:13.711644 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4100c-451f-4bdf-8600-2f5c9ecc48e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:13.712252 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4100c-451f-4bdf-8600-2f5c9ecc48e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:13.712521 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4100c-451f-4bdf-8600-2f5c9ecc48e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:13.712787 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4100c-451f-4bdf-8600-2f5c9ecc48e4 admin admin] PATH_INFO: `/v3/projects/9338e36ee29e469c81cefc9564e6700f` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:13.713957 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4100c-451f-4bdf-8600-2f5c9ecc48e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9338e36ee29e469c81cefc9564e6700f)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:13.715844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4100c-451f-4bdf-8600-2f5c9ecc48e4 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:13.764053 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7ca4100c-451f-4bdf-8600-2f5c9ecc48e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9338e36ee29e469c81cefc9564e6700f', 'request_id': 'req-7ca4100c-451f-4bdf-8600-2f5c9ecc48e4'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:13.773875 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7ca4100c-451f-4bdf-8600-2f5c9ecc48e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9338e36ee29e469c81cefc9564e6700f', 'request_id': 'req-7ca4100c-451f-4bdf-8600-2f5c9ecc48e4'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:13.781401 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7ca4100c-451f-4bdf-8600-2f5c9ecc48e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9338e36ee29e469c81cefc9564e6700f', 'request_id': 'req-7ca4100c-451f-4bdf-8600-2f5c9ecc48e4'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:13.794090 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7ca4100c-451f-4bdf-8600-2f5c9ecc48e4 admin admin] The token cache is being invalidate because project 9338e36ee29e469c81cefc9564e6700f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:23:13.794378 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7ca4100c-451f-4bdf-8600-2f5c9ecc48e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:13.795020 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7ca4100c-451f-4bdf-8600-2f5c9ecc48e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:13.796505 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1393/2788] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:23:13 2022] DELETE /identity/v3/projects/9338e36ee29e469c81cefc9564e6700f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:23:13.801539 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea14704-8e73-44ae-b71c-46245c6fd4ab None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:13.801822 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea14704-8e73-44ae-b71c-46245c6fd4ab None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:13.802091 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea14704-8e73-44ae-b71c-46245c6fd4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:13.822093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-dea14704-8e73-44ae-b71c-46245c6fd4ab None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:23:13.823287 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-dea14704-8e73-44ae-b71c-46245c6fd4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:13.856080 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:23:13.882998 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1396/2789] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:23:13.890714 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fbdfa-dad4-4765-9689-f025caeed8fe None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:13.891023 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fbdfa-dad4-4765-9689-f025caeed8fe None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:13.891324 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fbdfa-dad4-4765-9689-f025caeed8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:13.910894 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-396fbdfa-dad4-4765-9689-f025caeed8fe None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:23:13.912084 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-396fbdfa-dad4-4765-9689-f025caeed8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:13.920346 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1394/2790] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:23:13.924605 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea14704-8e73-44ae-b71c-46245c6fd4ab None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:13.934748 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea14704-8e73-44ae-b71c-46245c6fd4ab None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:13.939277 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220eaada-39c1-4b7a-a11f-f26ac8e9384e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:13.939858 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220eaada-39c1-4b7a-a11f-f26ac8e9384e admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:13.940131 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220eaada-39c1-4b7a-a11f-f26ac8e9384e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:13.940402 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220eaada-39c1-4b7a-a11f-f26ac8e9384e admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:13.941031 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220eaada-39c1-4b7a-a11f-f26ac8e9384e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:23:13.941359 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220eaada-39c1-4b7a-a11f-f26ac8e9384e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:13.942949 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220eaada-39c1-4b7a-a11f-f26ac8e9384e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:13.954132 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1397/2791] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:23:13.958142 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fbdfa-dad4-4765-9689-f025caeed8fe None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:13.968074 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fbdfa-dad4-4765-9689-f025caeed8fe None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:13.972679 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7df4c-9578-4eb4-9b2b-9c69e93781e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:13.973318 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7df4c-9578-4eb4-9b2b-9c69e93781e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:13.973597 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7df4c-9578-4eb4-9b2b-9c69e93781e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:13.973864 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7df4c-9578-4eb4-9b2b-9c69e93781e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:13.974488 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7df4c-9578-4eb4-9b2b-9c69e93781e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:13.976357 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7df4c-9578-4eb4-9b2b-9c69e93781e0 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:14.004149 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1395/2792] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:23:13 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:23:14.008360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220eaada-39c1-4b7a-a11f-f26ac8e9384e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:14.018569 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220eaada-39c1-4b7a-a11f-f26ac8e9384e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:14.074905 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37443b05-9915-441d-b4d9-05dbaadd2fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:14.075430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37443b05-9915-441d-b4d9-05dbaadd2fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:14.075706 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37443b05-9915-441d-b4d9-05dbaadd2fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:14.075974 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37443b05-9915-441d-b4d9-05dbaadd2fe3 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:14.076592 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37443b05-9915-441d-b4d9-05dbaadd2fe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:14.078712 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37443b05-9915-441d-b4d9-05dbaadd2fe3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:14.099457 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1398/2793] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:23:14 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:23:14.104204 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7df4c-9578-4eb4-9b2b-9c69e93781e0 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:14.114437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7df4c-9578-4eb4-9b2b-9c69e93781e0 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:14.118993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9858d7-fbcb-4d11-a3d8-90ea27e33c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:14.119581 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9858d7-fbcb-4d11-a3d8-90ea27e33c86 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:14.119858 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9858d7-fbcb-4d11-a3d8-90ea27e33c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:14.120126 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9858d7-fbcb-4d11-a3d8-90ea27e33c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:14.120764 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9858d7-fbcb-4d11-a3d8-90ea27e33c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:14.122395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9858d7-fbcb-4d11-a3d8-90ea27e33c86 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:14.132212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1396/2794] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:23:14.136140 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37443b05-9915-441d-b4d9-05dbaadd2fe3 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:14.145884 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37443b05-9915-441d-b4d9-05dbaadd2fe3 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:14.150993 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654c34e-3b11-4477-a5a2-8b30c0c484e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:14.151571 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654c34e-3b11-4477-a5a2-8b30c0c484e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:14.151853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654c34e-3b11-4477-a5a2-8b30c0c484e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:14.152118 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654c34e-3b11-4477-a5a2-8b30c0c484e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:14.152746 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654c34e-3b11-4477-a5a2-8b30c0c484e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:14.154403 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654c34e-3b11-4477-a5a2-8b30c0c484e8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:14.165015 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1399/2795] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:23:14.169518 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9858d7-fbcb-4d11-a3d8-90ea27e33c86 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:14.179491 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9858d7-fbcb-4d11-a3d8-90ea27e33c86 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:14.184232 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fe3e1-b673-4b18-a41a-eee156d5a629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:14.184866 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fe3e1-b673-4b18-a41a-eee156d5a629 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:14.185183 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fe3e1-b673-4b18-a41a-eee156d5a629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:14.185464 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fe3e1-b673-4b18-a41a-eee156d5a629 admin admin] PATH_INFO: `/v3/projects/07980f75c04348fa9c735306ffef6888/users/740d242479814b6eb618a7ae0d637700/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:14.187693 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:23:14.203035 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17fe3e1-b673-4b18-a41a-eee156d5a629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07980f75c04348fa9c735306ffef6888, user_id=740d242479814b6eb618a7ae0d637700, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:14.205771 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17fe3e1-b673-4b18-a41a-eee156d5a629 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:14.218518 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1397/2796] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:23:14 2022] PUT /identity/v3/projects/07980f75c04348fa9c735306ffef6888/users/740d242479814b6eb618a7ae0d637700/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:23:14.229275 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6f785-6514-4368-8163-9b3bf90e6c7f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:14.229565 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6f785-6514-4368-8163-9b3bf90e6c7f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:14.229835 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6f785-6514-4368-8163-9b3bf90e6c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:14.257083 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-cbe6f785-6514-4368-8163-9b3bf90e6c7f None None] MFA Rules not processed for user `740d242479814b6eb618a7ae0d637700`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:23:14.258314 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cbe6f785-6514-4368-8163-9b3bf90e6c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:14.324521 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1400/2797] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:23:14 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:23:14.335149 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fe3e1-b673-4b18-a41a-eee156d5a629 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:14.336982 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a17fe3e1-b673-4b18-a41a-eee156d5a629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:14.394212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fe3e1-b673-4b18-a41a-eee156d5a629 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:14.397810 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51e3ae-cce5-4898-a9bf-a102e4fe4dbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:14.398396 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51e3ae-cce5-4898-a9bf-a102e4fe4dbf service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:14.398667 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51e3ae-cce5-4898-a9bf-a102e4fe4dbf service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:14.398931 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51e3ae-cce5-4898-a9bf-a102e4fe4dbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:14.407787 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51e3ae-cce5-4898-a9bf-a102e4fe4dbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:14.409227 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51e3ae-cce5-4898-a9bf-a102e4fe4dbf service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:14.418436 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1398/2798] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:23:14 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:23:23.606108 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6f785-6514-4368-8163-9b3bf90e6c7f None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:23.607580 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cbe6f785-6514-4368-8163-9b3bf90e6c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:23.649156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:23:23.667776 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6f785-6514-4368-8163-9b3bf90e6c7f None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:23.671365 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f89f9d-482b-41e1-83f8-b02f55b08a5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:23.671958 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f89f9d-482b-41e1-83f8-b02f55b08a5c service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:23.672238 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f89f9d-482b-41e1-83f8-b02f55b08a5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:23.672509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f89f9d-482b-41e1-83f8-b02f55b08a5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:23.674507 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-74f89f9d-482b-41e1-83f8-b02f55b08a5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:23.745345 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f89f9d-482b-41e1-83f8-b02f55b08a5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:23.746812 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f89f9d-482b-41e1-83f8-b02f55b08a5c service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:23.757781 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1401/2799] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:23:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:23:24.413842 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:23:24.429906 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51e3ae-cce5-4898-a9bf-a102e4fe4dbf service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:24.493141 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51e3ae-cce5-4898-a9bf-a102e4fe4dbf service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:24.498392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a1666-43a7-4976-839e-7d8a5f03c92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:24.499000 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a1666-43a7-4976-839e-7d8a5f03c92d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:24.499277 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a1666-43a7-4976-839e-7d8a5f03c92d admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:24.499554 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a1666-43a7-4976-839e-7d8a5f03c92d admin admin] PATH_INFO: `/v3/users/740d242479814b6eb618a7ae0d637700` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:24.500714 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a1666-43a7-4976-839e-7d8a5f03c92d admin admin] RBAC: Authorizing `identity:delete_user(user_id=740d242479814b6eb618a7ae0d637700)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:24.502670 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a1666-43a7-4976-839e-7d8a5f03c92d admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:24.548515 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-798a1666-43a7-4976-839e-7d8a5f03c92d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '740d242479814b6eb618a7ae0d637700'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:24.554957 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-798a1666-43a7-4976-839e-7d8a5f03c92d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '740d242479814b6eb618a7ae0d637700'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:24.567657 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-798a1666-43a7-4976-839e-7d8a5f03c92d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '740d242479814b6eb618a7ae0d637700'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:24.568310 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-798a1666-43a7-4976-839e-7d8a5f03c92d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '740d242479814b6eb618a7ae0d637700'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:24.575178 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-798a1666-43a7-4976-839e-7d8a5f03c92d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '740d242479814b6eb618a7ae0d637700'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:24.580942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1399/2800] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:23:24 2022] DELETE /identity/v3/users/740d242479814b6eb618a7ae0d637700 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:23:24.585866 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c4b30-5eb1-4f23-b6fb-35a00f9297b3 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:24.586156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c4b30-5eb1-4f23-b6fb-35a00f9297b3 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:24.586428 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c4b30-5eb1-4f23-b6fb-35a00f9297b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:24.606172 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-028c4b30-5eb1-4f23-b6fb-35a00f9297b3 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:23:24.607357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-028c4b30-5eb1-4f23-b6fb-35a00f9297b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:24.665854 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1402/2801] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:23:24.676022 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a1666-43a7-4976-839e-7d8a5f03c92d admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:24.677425 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-798a1666-43a7-4976-839e-7d8a5f03c92d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:24.733981 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a1666-43a7-4976-839e-7d8a5f03c92d admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:24.737596 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4af2a7-3a84-4f10-b100-e0e61b3bc223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:24.738179 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4af2a7-3a84-4f10-b100-e0e61b3bc223 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:24.738452 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4af2a7-3a84-4f10-b100-e0e61b3bc223 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:24.738715 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4af2a7-3a84-4f10-b100-e0e61b3bc223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:24.747817 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4af2a7-3a84-4f10-b100-e0e61b3bc223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:24.749263 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4af2a7-3a84-4f10-b100-e0e61b3bc223 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:24.758507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1400/2802] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:23:24.944363 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c4b30-5eb1-4f23-b6fb-35a00f9297b3 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:24.954857 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c4b30-5eb1-4f23-b6fb-35a00f9297b3 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:24.958624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cfc3b-e50d-450e-bf07-88fc70445010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:24.959222 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cfc3b-e50d-450e-bf07-88fc70445010 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:24.959501 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cfc3b-e50d-450e-bf07-88fc70445010 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:24.959774 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cfc3b-e50d-450e-bf07-88fc70445010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:24.961579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-242cfc3b-e50d-450e-bf07-88fc70445010 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:25.025413 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4af2a7-3a84-4f10-b100-e0e61b3bc223 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:25.026971 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-dd4af2a7-3a84-4f10-b100-e0e61b3bc223 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:25.040576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242cfc3b-e50d-450e-bf07-88fc70445010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:25.042064 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242cfc3b-e50d-450e-bf07-88fc70445010 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:25.051619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4af2a7-3a84-4f10-b100-e0e61b3bc223 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:25.055739 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1403/2803] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:23:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:23:25.056460 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3109fba-d679-419c-87c0-f2d882cd9219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:25.057246 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3109fba-d679-419c-87c0-f2d882cd9219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:25.057673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3109fba-d679-419c-87c0-f2d882cd9219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:25.057959 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3109fba-d679-419c-87c0-f2d882cd9219 admin admin] PATH_INFO: `/v3/projects/07980f75c04348fa9c735306ffef6888` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:25.059169 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3109fba-d679-419c-87c0-f2d882cd9219 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07980f75c04348fa9c735306ffef6888)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:25.061071 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3109fba-d679-419c-87c0-f2d882cd9219 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:25.080735 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:23:25.116979 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b3109fba-d679-419c-87c0-f2d882cd9219 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07980f75c04348fa9c735306ffef6888', 'request_id': 'req-b3109fba-d679-419c-87c0-f2d882cd9219'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:25.125169 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b3109fba-d679-419c-87c0-f2d882cd9219 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07980f75c04348fa9c735306ffef6888', 'request_id': 'req-b3109fba-d679-419c-87c0-f2d882cd9219'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:25.131835 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b3109fba-d679-419c-87c0-f2d882cd9219 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07980f75c04348fa9c735306ffef6888', 'request_id': 'req-b3109fba-d679-419c-87c0-f2d882cd9219'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:25.144576 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b3109fba-d679-419c-87c0-f2d882cd9219 admin admin] The token cache is being invalidate because project 07980f75c04348fa9c735306ffef6888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:23:25.144858 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b3109fba-d679-419c-87c0-f2d882cd9219 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:25.145530 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b3109fba-d679-419c-87c0-f2d882cd9219 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:23:25.147224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1401/2804] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:23:25 2022] DELETE /identity/v3/projects/07980f75c04348fa9c735306ffef6888 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:23:29.547442 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9aaf12-6d19-4bf7-9dd9-a5d33d1b9a6a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:29.547988 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9aaf12-6d19-4bf7-9dd9-a5d33d1b9a6a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:29.547988 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9aaf12-6d19-4bf7-9dd9-a5d33d1b9a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:29.555209 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:23:29.568194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-3b9aaf12-6d19-4bf7-9dd9-a5d33d1b9a6a None None] MFA Rules not processed for user `5b7bb09021514c2e81eee138657d8682`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:23:29.569500 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3b9aaf12-6d19-4bf7-9dd9-a5d33d1b9a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:29.623568 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1404/2805] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:23:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:23:29.939514 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3109fba-d679-419c-87c0-f2d882cd9219 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:29.941046 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b3109fba-d679-419c-87c0-f2d882cd9219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:29.998598 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3109fba-d679-419c-87c0-f2d882cd9219 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:30.002126 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85735e-1cdd-4012-bfd3-d7231c6dc2c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:30.002720 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85735e-1cdd-4012-bfd3-d7231c6dc2c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:30.002992 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85735e-1cdd-4012-bfd3-d7231c6dc2c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:30.003257 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85735e-1cdd-4012-bfd3-d7231c6dc2c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:30.004921 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-6d85735e-1cdd-4012-bfd3-d7231c6dc2c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:30.014919 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85735e-1cdd-4012-bfd3-d7231c6dc2c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:30.016322 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85735e-1cdd-4012-bfd3-d7231c6dc2c3 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:30.024217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1402/2806] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:23:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:23:30.345109 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9aaf12-6d19-4bf7-9dd9-a5d33d1b9a6a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:30.346512 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3b9aaf12-6d19-4bf7-9dd9-a5d33d1b9a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:30.416839 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9aaf12-6d19-4bf7-9dd9-a5d33d1b9a6a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:30.422448 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a456524-d628-48bb-ac00-3ccd66e73b1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311397bfe2c04569852fca0cfcdbad66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:30.423058 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a456524-d628-48bb-ac00-3ccd66e73b1f service placement] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:30.423333 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a456524-d628-48bb-ac00-3ccd66e73b1f service placement] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:30.423606 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a456524-d628-48bb-ac00-3ccd66e73b1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:30.425392 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8a456524-d628-48bb-ac00-3ccd66e73b1f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:30.438184 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a456524-d628-48bb-ac00-3ccd66e73b1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:30.440181 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a456524-d628-48bb-ac00-3ccd66e73b1f service placement] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:30.451021 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1405/2807] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:23:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:23:32.245200 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85735e-1cdd-4012-bfd3-d7231c6dc2c3 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:32.246738 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-6d85735e-1cdd-4012-bfd3-d7231c6dc2c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:32.257356 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85735e-1cdd-4012-bfd3-d7231c6dc2c3 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:32.261004 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b751b7-50d2-46b0-b37a-33b87b4ff01f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:32.261636 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b751b7-50d2-46b0-b37a-33b87b4ff01f service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:32.261956 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b751b7-50d2-46b0-b37a-33b87b4ff01f service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:32.262179 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b751b7-50d2-46b0-b37a-33b87b4ff01f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:32.263848 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-60b751b7-50d2-46b0-b37a-33b87b4ff01f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:32.273116 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b751b7-50d2-46b0-b37a-33b87b4ff01f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:32.274526 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b751b7-50d2-46b0-b37a-33b87b4ff01f service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:32.283207 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1403/2808] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:23:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:23:36.986778 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a456524-d628-48bb-ac00-3ccd66e73b1f service placement] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:36.988258 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8a456524-d628-48bb-ac00-3ccd66e73b1f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:37.064170 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a456524-d628-48bb-ac00-3ccd66e73b1f service placement] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:37.069624 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4afeef3-29c5-4635-a741-0a62bbde15be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:37.070222 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afeef3-29c5-4635-a741-0a62bbde15be service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:37.070500 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afeef3-29c5-4635-a741-0a62bbde15be service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:37.070770 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afeef3-29c5-4635-a741-0a62bbde15be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:37.072476 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e4afeef3-29c5-4635-a741-0a62bbde15be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:37.084975 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4afeef3-29c5-4635-a741-0a62bbde15be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:37.086578 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4afeef3-29c5-4635-a741-0a62bbde15be service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:37.097570 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1406/2809] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:23:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:23:41.101964 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b751b7-50d2-46b0-b37a-33b87b4ff01f service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:23:41.103984 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-60b751b7-50d2-46b0-b37a-33b87b4ff01f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:41.123566 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b751b7-50d2-46b0-b37a-33b87b4ff01f service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:23:41.130048 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37618815-26f6-4038-b829-adcb55005544 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:23:41.130649 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37618815-26f6-4038-b829-adcb55005544 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:23:41.130921 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37618815-26f6-4038-b829-adcb55005544 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:23:41.131186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37618815-26f6-4038-b829-adcb55005544 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:23:41.132970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-37618815-26f6-4038-b829-adcb55005544 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:23:41.146918 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37618815-26f6-4038-b829-adcb55005544 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:23:41.148498 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37618815-26f6-4038-b829-adcb55005544 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:23:41.159297 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1404/2810] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:23:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:23:47.093053 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:23:51.154549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:24:45.699439 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4afeef3-29c5-4635-a741-0a62bbde15be service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:24:45.710978 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4afeef3-29c5-4635-a741-0a62bbde15be service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:24:45.716434 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2a85d-0a79-47f2-8f11-979dc039942c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:24:45.717578 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2a85d-0a79-47f2-8f11-979dc039942c service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:24:45.717860 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2a85d-0a79-47f2-8f11-979dc039942c service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:24:45.718131 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2a85d-0a79-47f2-8f11-979dc039942c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:24:45.719851 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b9c2a85d-0a79-47f2-8f11-979dc039942c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:24:45.730005 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2a85d-0a79-47f2-8f11-979dc039942c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:24:45.731576 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2a85d-0a79-47f2-8f11-979dc039942c service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:24:45.741049 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1407/2811] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:24:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:24:55.736908 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=6 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:00.340555 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37618815-26f6-4038-b829-adcb55005544 service nova] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:00.362239 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37618815-26f6-4038-b829-adcb55005544 service nova] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:00.369306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895ffbc-0e28-4a14-9044-8e0d24c6626b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:00.369922 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895ffbc-0e28-4a14-9044-8e0d24c6626b service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:00.370192 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895ffbc-0e28-4a14-9044-8e0d24c6626b service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:00.370459 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895ffbc-0e28-4a14-9044-8e0d24c6626b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:00.372234 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1895ffbc-0e28-4a14-9044-8e0d24c6626b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:00.385748 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895ffbc-0e28-4a14-9044-8e0d24c6626b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:00.387329 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895ffbc-0e28-4a14-9044-8e0d24c6626b service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:00.409281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1405/2812] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:25:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:25:05.940993 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2a85d-0a79-47f2-8f11-979dc039942c service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:05.950268 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2a85d-0a79-47f2-8f11-979dc039942c service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:05.954426 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e8f14-2081-498e-bbfd-a7a6ca4d03c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:05.955012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e8f14-2081-498e-bbfd-a7a6ca4d03c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:05.955284 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e8f14-2081-498e-bbfd-a7a6ca4d03c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:05.955548 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e8f14-2081-498e-bbfd-a7a6ca4d03c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:05.957277 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cd2e8f14-2081-498e-bbfd-a7a6ca4d03c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:06.020288 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e8f14-2081-498e-bbfd-a7a6ca4d03c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:06.021745 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e8f14-2081-498e-bbfd-a7a6ca4d03c0 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:06.031496 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1408/2813] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:25:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:25:08.823234 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895ffbc-0e28-4a14-9044-8e0d24c6626b service nova] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:08.838434 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895ffbc-0e28-4a14-9044-8e0d24c6626b service nova] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:08.849486 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7c7bc-e1e5-4d99-a456-138a37d0ef7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311397bfe2c04569852fca0cfcdbad66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:08.850106 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7c7bc-e1e5-4d99-a456-138a37d0ef7c service placement] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:08.851253 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7c7bc-e1e5-4d99-a456-138a37d0ef7c service placement] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:08.851554 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7c7bc-e1e5-4d99-a456-138a37d0ef7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:08.853660 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-61f7c7bc-e1e5-4d99-a456-138a37d0ef7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:08.880366 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7c7bc-e1e5-4d99-a456-138a37d0ef7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:08.884349 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7c7bc-e1e5-4d99-a456-138a37d0ef7c service placement] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:08.885445 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e8f14-2081-498e-bbfd-a7a6ca4d03c0 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:08.887044 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cd2e8f14-2081-498e-bbfd-a7a6ca4d03c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:08.897816 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1406/2814] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:25:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:25:08.911603 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e8f14-2081-498e-bbfd-a7a6ca4d03c0 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:08.917492 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111aace-1693-4961-b860-e975096f1c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:08.918129 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111aace-1693-4961-b860-e975096f1c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:08.918407 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111aace-1693-4961-b860-e975096f1c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:08.918676 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111aace-1693-4961-b860-e975096f1c6b admin admin] PATH_INFO: `/v3/users/5b7bb09021514c2e81eee138657d8682` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:08.920345 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111aace-1693-4961-b860-e975096f1c6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b7bb09021514c2e81eee138657d8682)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:08.922732 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111aace-1693-4961-b860-e975096f1c6b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:08.975679 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-6111aace-1693-4961-b860-e975096f1c6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b7bb09021514c2e81eee138657d8682'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:08.983004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-6111aace-1693-4961-b860-e975096f1c6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b7bb09021514c2e81eee138657d8682'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:08.996491 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-6111aace-1693-4961-b860-e975096f1c6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b7bb09021514c2e81eee138657d8682'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:08.997311 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-6111aace-1693-4961-b860-e975096f1c6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b7bb09021514c2e81eee138657d8682'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:09.009469 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-6111aace-1693-4961-b860-e975096f1c6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b7bb09021514c2e81eee138657d8682'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:09.017300 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1409/2815] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:25:08 2022] DELETE /identity/v3/users/5b7bb09021514c2e81eee138657d8682 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:25:09.204265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7c7bc-e1e5-4d99-a456-138a37d0ef7c service placement] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:09.214995 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7c7bc-e1e5-4d99-a456-138a37d0ef7c service placement] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:09.271520 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9a29c-931d-487d-8bf7-dca2a204c9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:09.272139 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9a29c-931d-487d-8bf7-dca2a204c9fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:09.272415 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9a29c-931d-487d-8bf7-dca2a204c9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:09.272686 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9a29c-931d-487d-8bf7-dca2a204c9fb admin admin] PATH_INFO: `/v3/projects/8a9c6d7e987f4eeaae50d21d9f34ba56` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:09.273834 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9a29c-931d-487d-8bf7-dca2a204c9fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a9c6d7e987f4eeaae50d21d9f34ba56)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:09.275738 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9a29c-931d-487d-8bf7-dca2a204c9fb admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:09.321488 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-76f9a29c-931d-487d-8bf7-dca2a204c9fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a9c6d7e987f4eeaae50d21d9f34ba56', 'request_id': 'req-76f9a29c-931d-487d-8bf7-dca2a204c9fb'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:09.328468 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-76f9a29c-931d-487d-8bf7-dca2a204c9fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a9c6d7e987f4eeaae50d21d9f34ba56', 'request_id': 'req-76f9a29c-931d-487d-8bf7-dca2a204c9fb'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:09.334632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-76f9a29c-931d-487d-8bf7-dca2a204c9fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a9c6d7e987f4eeaae50d21d9f34ba56', 'request_id': 'req-76f9a29c-931d-487d-8bf7-dca2a204c9fb'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:09.345843 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-76f9a29c-931d-487d-8bf7-dca2a204c9fb admin admin] The token cache is being invalidate because project 8a9c6d7e987f4eeaae50d21d9f34ba56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:25:09.346128 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-76f9a29c-931d-487d-8bf7-dca2a204c9fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:09.346743 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-76f9a29c-931d-487d-8bf7-dca2a204c9fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:09.348182 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1407/2816] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:25:09 2022] DELETE /identity/v3/projects/8a9c6d7e987f4eeaae50d21d9f34ba56 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:25:09.353143 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68be33-fdcd-4b2b-bde9-d6114b60c043 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:09.353465 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68be33-fdcd-4b2b-bde9-d6114b60c043 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:09.353738 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68be33-fdcd-4b2b-bde9-d6114b60c043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:09.373705 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-6b68be33-fdcd-4b2b-bde9-d6114b60c043 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:09.375549 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6b68be33-fdcd-4b2b-bde9-d6114b60c043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:09.435308 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1410/2817] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:25:09.443121 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6976b8d-ca79-4021-b85a-3f5b83e2ca3f None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:09.443400 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6976b8d-ca79-4021-b85a-3f5b83e2ca3f None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:09.443671 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6976b8d-ca79-4021-b85a-3f5b83e2ca3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:09.463074 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-f6976b8d-ca79-4021-b85a-3f5b83e2ca3f None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:09.464275 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f6976b8d-ca79-4021-b85a-3f5b83e2ca3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:09.472558 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1408/2818] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:25:09.476562 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68be33-fdcd-4b2b-bde9-d6114b60c043 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:09.486662 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68be33-fdcd-4b2b-bde9-d6114b60c043 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:09.491284 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f809a46-ce16-42bd-8584-83a9b5ba5db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:09.491868 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f809a46-ce16-42bd-8584-83a9b5ba5db3 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:09.492152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f809a46-ce16-42bd-8584-83a9b5ba5db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:09.492419 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f809a46-ce16-42bd-8584-83a9b5ba5db3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:09.493050 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f809a46-ce16-42bd-8584-83a9b5ba5db3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:25:09.493382 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f809a46-ce16-42bd-8584-83a9b5ba5db3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:09.494997 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f809a46-ce16-42bd-8584-83a9b5ba5db3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:09.496447 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:09.509229 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1411/2819] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:25:09.513054 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6976b8d-ca79-4021-b85a-3f5b83e2ca3f None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:09.522349 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6976b8d-ca79-4021-b85a-3f5b83e2ca3f None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:09.527020 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a544d9-6b8e-4af0-b69a-1aeabd385da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:09.527600 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a544d9-6b8e-4af0-b69a-1aeabd385da3 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:09.527879 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a544d9-6b8e-4af0-b69a-1aeabd385da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:09.528150 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a544d9-6b8e-4af0-b69a-1aeabd385da3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:09.528781 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a544d9-6b8e-4af0-b69a-1aeabd385da3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:09.531507 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a544d9-6b8e-4af0-b69a-1aeabd385da3 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:09.558763 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1409/2820] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:25:09 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:25:09.562915 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f809a46-ce16-42bd-8584-83a9b5ba5db3 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:09.572755 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f809a46-ce16-42bd-8584-83a9b5ba5db3 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:09.629403 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661cace-98f8-46d0-9b2a-acd7ad936da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:09.630008 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661cace-98f8-46d0-9b2a-acd7ad936da7 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:09.630283 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661cace-98f8-46d0-9b2a-acd7ad936da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:09.630550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661cace-98f8-46d0-9b2a-acd7ad936da7 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:09.631177 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661cace-98f8-46d0-9b2a-acd7ad936da7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:09.633087 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661cace-98f8-46d0-9b2a-acd7ad936da7 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:09.653877 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1412/2821] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:25:09 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:25:09.658993 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a544d9-6b8e-4af0-b69a-1aeabd385da3 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:09.669184 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a544d9-6b8e-4af0-b69a-1aeabd385da3 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:09.674439 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7df9a-b799-4eef-9b7c-0b53c20b9c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:09.675024 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7df9a-b799-4eef-9b7c-0b53c20b9c22 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:09.675300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7df9a-b799-4eef-9b7c-0b53c20b9c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:09.675570 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7df9a-b799-4eef-9b7c-0b53c20b9c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:09.676257 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7df9a-b799-4eef-9b7c-0b53c20b9c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:09.678011 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7df9a-b799-4eef-9b7c-0b53c20b9c22 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:09.687835 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1410/2822] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:25:09.691840 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661cace-98f8-46d0-9b2a-acd7ad936da7 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:09.701626 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661cace-98f8-46d0-9b2a-acd7ad936da7 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:09.706229 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ed807-71e5-4169-9579-0154a9802df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:09.706813 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ed807-71e5-4169-9579-0154a9802df2 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:09.707089 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ed807-71e5-4169-9579-0154a9802df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:09.707360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ed807-71e5-4169-9579-0154a9802df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:09.707990 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ed807-71e5-4169-9579-0154a9802df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:09.709617 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ed807-71e5-4169-9579-0154a9802df2 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:09.720506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1413/2823] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:25:09.724258 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7df9a-b799-4eef-9b7c-0b53c20b9c22 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:09.734624 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7df9a-b799-4eef-9b7c-0b53c20b9c22 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:09.739306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da612d-410b-4898-95c9-ca1ce08b81bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:09.739933 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da612d-410b-4898-95c9-ca1ce08b81bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:09.740211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da612d-410b-4898-95c9-ca1ce08b81bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:09.740483 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da612d-410b-4898-95c9-ca1ce08b81bb admin admin] PATH_INFO: `/v3/projects/d583c92e97ba454cbbe9c223fba5ac8e/users/fe7685a506074636a5fd562aa75e2cbb/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:09.754840 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da612d-410b-4898-95c9-ca1ce08b81bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d583c92e97ba454cbbe9c223fba5ac8e, user_id=fe7685a506074636a5fd562aa75e2cbb, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:09.757543 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da612d-410b-4898-95c9-ca1ce08b81bb admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:09.767316 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:09.772187 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1411/2824] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:25:09 2022] PUT /identity/v3/projects/d583c92e97ba454cbbe9c223fba5ac8e/users/fe7685a506074636a5fd562aa75e2cbb/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:25:09.784748 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084db3c-e52b-475c-96df-96f883c7cc26 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:09.785037 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084db3c-e52b-475c-96df-96f883c7cc26 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:09.785364 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084db3c-e52b-475c-96df-96f883c7cc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:09.812789 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a084db3c-e52b-475c-96df-96f883c7cc26 None None] MFA Rules not processed for user `fe7685a506074636a5fd562aa75e2cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:09.814038 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a084db3c-e52b-475c-96df-96f883c7cc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:09.876864 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1414/2825] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:25:09.881246 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da612d-410b-4898-95c9-ca1ce08b81bb admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:09.942442 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da612d-410b-4898-95c9-ca1ce08b81bb admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:09.947034 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8692b13-8e0d-42da-821c-bee37b8521e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:09.947622 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8692b13-8e0d-42da-821c-bee37b8521e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:09.947898 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8692b13-8e0d-42da-821c-bee37b8521e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:09.948165 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8692b13-8e0d-42da-821c-bee37b8521e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:09.948787 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8692b13-8e0d-42da-821c-bee37b8521e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:09.950738 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8692b13-8e0d-42da-821c-bee37b8521e5 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:09.978036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1412/2826] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:25:09 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:25:09.982279 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084db3c-e52b-475c-96df-96f883c7cc26 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:09.992904 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084db3c-e52b-475c-96df-96f883c7cc26 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:10.047980 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26ab04-4842-4259-8cfd-14c8b53c4d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:10.048575 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26ab04-4842-4259-8cfd-14c8b53c4d9c admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:10.048848 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26ab04-4842-4259-8cfd-14c8b53c4d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:10.049134 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26ab04-4842-4259-8cfd-14c8b53c4d9c admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:10.049746 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26ab04-4842-4259-8cfd-14c8b53c4d9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:10.051650 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26ab04-4842-4259-8cfd-14c8b53c4d9c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:10.060299 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:10.072273 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1415/2827] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:25:09 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:25:10.076715 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8692b13-8e0d-42da-821c-bee37b8521e5 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:10.087477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8692b13-8e0d-42da-821c-bee37b8521e5 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:10.092113 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90faee61-324e-4898-b45e-798feac61a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:10.092699 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90faee61-324e-4898-b45e-798feac61a1f admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:10.093064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90faee61-324e-4898-b45e-798feac61a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:10.093863 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90faee61-324e-4898-b45e-798feac61a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:10.094499 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90faee61-324e-4898-b45e-798feac61a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:10.096104 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90faee61-324e-4898-b45e-798feac61a1f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:10.106420 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1413/2828] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:25:10.110573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26ab04-4842-4259-8cfd-14c8b53c4d9c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:10.120715 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26ab04-4842-4259-8cfd-14c8b53c4d9c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:10.126064 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c38980-29a5-47a8-8dd2-9018d602e819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:10.126712 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c38980-29a5-47a8-8dd2-9018d602e819 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:10.127043 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c38980-29a5-47a8-8dd2-9018d602e819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:10.127260 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c38980-29a5-47a8-8dd2-9018d602e819 admin admin] PATH_INFO: `/v3/projects/9b6213a0984f425c88536aa39bd7cf02/users/048d093e331d410fb103e6345e7f6c03/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:10.142003 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c38980-29a5-47a8-8dd2-9018d602e819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b6213a0984f425c88536aa39bd7cf02, user_id=048d093e331d410fb103e6345e7f6c03, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:10.144684 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c38980-29a5-47a8-8dd2-9018d602e819 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:10.158255 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1416/2829] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:25:10 2022] PUT /identity/v3/projects/9b6213a0984f425c88536aa39bd7cf02/users/048d093e331d410fb103e6345e7f6c03/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:25:10.162216 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90faee61-324e-4898-b45e-798feac61a1f admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:10.172885 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90faee61-324e-4898-b45e-798feac61a1f admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:10.227790 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020ba7e-5aa5-4b92-97da-344047ec636f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:10.228395 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020ba7e-5aa5-4b92-97da-344047ec636f admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:10.228678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020ba7e-5aa5-4b92-97da-344047ec636f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:10.228950 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020ba7e-5aa5-4b92-97da-344047ec636f admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:10.229634 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020ba7e-5aa5-4b92-97da-344047ec636f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:10.231223 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020ba7e-5aa5-4b92-97da-344047ec636f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:10.241509 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1414/2830] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:25:10.245573 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c38980-29a5-47a8-8dd2-9018d602e819 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:10.255863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c38980-29a5-47a8-8dd2-9018d602e819 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:10.260477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf039f1-4813-4b72-a601-49726ec321ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:10.261150 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf039f1-4813-4b72-a601-49726ec321ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:10.261432 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf039f1-4813-4b72-a601-49726ec321ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:10.261703 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf039f1-4813-4b72-a601-49726ec321ab admin admin] PATH_INFO: `/v3/projects/9b6213a0984f425c88536aa39bd7cf02/users/048d093e331d410fb103e6345e7f6c03/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:10.263623 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf039f1-4813-4b72-a601-49726ec321ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b6213a0984f425c88536aa39bd7cf02, user_id=048d093e331d410fb103e6345e7f6c03, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:10.266322 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf039f1-4813-4b72-a601-49726ec321ab admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:10.276467 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1417/2831] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:25:10 2022] PUT /identity/v3/projects/9b6213a0984f425c88536aa39bd7cf02/users/048d093e331d410fb103e6345e7f6c03/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:25:10.287717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4624cb-986f-4876-ae2f-ebe38b0b8799 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:10.287999 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4624cb-986f-4876-ae2f-ebe38b0b8799 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:10.288267 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4624cb-986f-4876-ae2f-ebe38b0b8799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:10.316933 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-1e4624cb-986f-4876-ae2f-ebe38b0b8799 None None] MFA Rules not processed for user `048d093e331d410fb103e6345e7f6c03`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:10.318164 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1e4624cb-986f-4876-ae2f-ebe38b0b8799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:10.377648 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:10.387031 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1415/2832] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:25:10.397591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf039f1-4813-4b72-a601-49726ec321ab admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:10.399308 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-bcf039f1-4813-4b72-a601-49726ec321ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:10.457448 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf039f1-4813-4b72-a601-49726ec321ab admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:10.461077 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebddf7-4e79-47ac-b2e1-be376c4d429b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:10.461703 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebddf7-4e79-47ac-b2e1-be376c4d429b service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:10.461979 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebddf7-4e79-47ac-b2e1-be376c4d429b service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:10.462248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebddf7-4e79-47ac-b2e1-be376c4d429b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:10.471670 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebddf7-4e79-47ac-b2e1-be376c4d429b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:10.473125 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebddf7-4e79-47ac-b2e1-be376c4d429b service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:10.482548 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1418/2833] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:25:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:25:10.589926 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4624cb-986f-4876-ae2f-ebe38b0b8799 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:10.600008 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4624cb-986f-4876-ae2f-ebe38b0b8799 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:10.603760 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02251b8-f099-4a6d-99ec-11d93e72359b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:10.604339 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02251b8-f099-4a6d-99ec-11d93e72359b service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:10.604612 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02251b8-f099-4a6d-99ec-11d93e72359b service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:10.604877 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02251b8-f099-4a6d-99ec-11d93e72359b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:10.661386 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02251b8-f099-4a6d-99ec-11d93e72359b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:10.662736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02251b8-f099-4a6d-99ec-11d93e72359b service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:10.671969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1416/2834] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:25:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:25:13.254877 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebddf7-4e79-47ac-b2e1-be376c4d429b service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:13.316923 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebddf7-4e79-47ac-b2e1-be376c4d429b service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:13.321658 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bc350-cf8e-4575-adc4-0e77b56ab9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:13.322266 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bc350-cf8e-4575-adc4-0e77b56ab9b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:13.322537 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bc350-cf8e-4575-adc4-0e77b56ab9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:13.322803 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bc350-cf8e-4575-adc4-0e77b56ab9b6 admin admin] PATH_INFO: `/v3/users/fe7685a506074636a5fd562aa75e2cbb` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:13.323897 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bc350-cf8e-4575-adc4-0e77b56ab9b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe7685a506074636a5fd562aa75e2cbb)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:13.325853 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bc350-cf8e-4575-adc4-0e77b56ab9b6 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:13.370736 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8c3bc350-cf8e-4575-adc4-0e77b56ab9b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe7685a506074636a5fd562aa75e2cbb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:13.378345 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8c3bc350-cf8e-4575-adc4-0e77b56ab9b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe7685a506074636a5fd562aa75e2cbb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:13.382880 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:13.393131 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8c3bc350-cf8e-4575-adc4-0e77b56ab9b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe7685a506074636a5fd562aa75e2cbb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:13.394036 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8c3bc350-cf8e-4575-adc4-0e77b56ab9b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe7685a506074636a5fd562aa75e2cbb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:13.400981 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-8c3bc350-cf8e-4575-adc4-0e77b56ab9b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe7685a506074636a5fd562aa75e2cbb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:13.407157 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1419/2835] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:25:13 2022] DELETE /identity/v3/users/fe7685a506074636a5fd562aa75e2cbb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:25:13.411789 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bb14e-e251-4fcc-9b24-3ee7d6f5d4cf None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:13.412249 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bb14e-e251-4fcc-9b24-3ee7d6f5d4cf None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:13.412348 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bb14e-e251-4fcc-9b24-3ee7d6f5d4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:13.432462 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-007bb14e-e251-4fcc-9b24-3ee7d6f5d4cf None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:13.433688 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-007bb14e-e251-4fcc-9b24-3ee7d6f5d4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:13.491306 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1417/2836] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:25:13.501584 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bc350-cf8e-4575-adc4-0e77b56ab9b6 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:13.502999 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8c3bc350-cf8e-4575-adc4-0e77b56ab9b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:13.559813 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bc350-cf8e-4575-adc4-0e77b56ab9b6 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:13.564142 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aff448-2559-43a3-b341-4e9cb9f820f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:13.564730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aff448-2559-43a3-b341-4e9cb9f820f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:13.565007 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aff448-2559-43a3-b341-4e9cb9f820f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:13.565427 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aff448-2559-43a3-b341-4e9cb9f820f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:13.574305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aff448-2559-43a3-b341-4e9cb9f820f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:13.575722 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aff448-2559-43a3-b341-4e9cb9f820f6 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:13.585080 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1420/2837] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:25:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:25:13.849414 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bb14e-e251-4fcc-9b24-3ee7d6f5d4cf None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:13.850854 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-007bb14e-e251-4fcc-9b24-3ee7d6f5d4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:13.863463 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bb14e-e251-4fcc-9b24-3ee7d6f5d4cf None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:13.868185 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262550e8-f7f9-4af7-b8b7-a0c99b420038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:13.868805 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262550e8-f7f9-4af7-b8b7-a0c99b420038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:13.869081 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262550e8-f7f9-4af7-b8b7-a0c99b420038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:13.869377 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262550e8-f7f9-4af7-b8b7-a0c99b420038 admin admin] PATH_INFO: `/v3/projects/d583c92e97ba454cbbe9c223fba5ac8e` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:13.870497 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262550e8-f7f9-4af7-b8b7-a0c99b420038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d583c92e97ba454cbbe9c223fba5ac8e)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:13.872390 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262550e8-f7f9-4af7-b8b7-a0c99b420038 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:13.918563 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-262550e8-f7f9-4af7-b8b7-a0c99b420038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd583c92e97ba454cbbe9c223fba5ac8e', 'request_id': 'req-262550e8-f7f9-4af7-b8b7-a0c99b420038'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:13.926341 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-262550e8-f7f9-4af7-b8b7-a0c99b420038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd583c92e97ba454cbbe9c223fba5ac8e', 'request_id': 'req-262550e8-f7f9-4af7-b8b7-a0c99b420038'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:13.931913 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-262550e8-f7f9-4af7-b8b7-a0c99b420038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd583c92e97ba454cbbe9c223fba5ac8e', 'request_id': 'req-262550e8-f7f9-4af7-b8b7-a0c99b420038'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:13.942815 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-262550e8-f7f9-4af7-b8b7-a0c99b420038 admin admin] The token cache is being invalidate because project d583c92e97ba454cbbe9c223fba5ac8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:25:13.943092 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-262550e8-f7f9-4af7-b8b7-a0c99b420038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:13.943707 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-262550e8-f7f9-4af7-b8b7-a0c99b420038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:13.945212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1418/2838] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:25:13 2022] DELETE /identity/v3/projects/d583c92e97ba454cbbe9c223fba5ac8e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:25:13.949308 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aff448-2559-43a3-b341-4e9cb9f820f6 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:13.958714 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aff448-2559-43a3-b341-4e9cb9f820f6 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:14.014575 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7273d5-2ef1-450d-afd9-c1446d6fa3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:14.015203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7273d5-2ef1-450d-afd9-c1446d6fa3f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:14.015482 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7273d5-2ef1-450d-afd9-c1446d6fa3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:14.015760 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7273d5-2ef1-450d-afd9-c1446d6fa3f6 admin admin] PATH_INFO: `/v3/users/048d093e331d410fb103e6345e7f6c03` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:14.016882 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7273d5-2ef1-450d-afd9-c1446d6fa3f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=048d093e331d410fb103e6345e7f6c03)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:14.018864 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7273d5-2ef1-450d-afd9-c1446d6fa3f6 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:14.063869 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3f7273d5-2ef1-450d-afd9-c1446d6fa3f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '048d093e331d410fb103e6345e7f6c03'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:14.070591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3f7273d5-2ef1-450d-afd9-c1446d6fa3f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '048d093e331d410fb103e6345e7f6c03'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:14.082910 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3f7273d5-2ef1-450d-afd9-c1446d6fa3f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '048d093e331d410fb103e6345e7f6c03'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:14.083567 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3f7273d5-2ef1-450d-afd9-c1446d6fa3f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '048d093e331d410fb103e6345e7f6c03'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:14.090451 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3f7273d5-2ef1-450d-afd9-c1446d6fa3f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '048d093e331d410fb103e6345e7f6c03'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:14.091895 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:14.097789 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1421/2839] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:25:13 2022] DELETE /identity/v3/users/048d093e331d410fb103e6345e7f6c03 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:25:14.368172 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262550e8-f7f9-4af7-b8b7-a0c99b420038 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:14.369612 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-262550e8-f7f9-4af7-b8b7-a0c99b420038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:14.389052 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262550e8-f7f9-4af7-b8b7-a0c99b420038 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:14.402197 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:14.447912 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a0590-7663-4ba9-9477-b76c3eaa6582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:14.448537 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a0590-7663-4ba9-9477-b76c3eaa6582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:14.448790 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a0590-7663-4ba9-9477-b76c3eaa6582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:14.449054 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a0590-7663-4ba9-9477-b76c3eaa6582 admin admin] PATH_INFO: `/v3/projects/9b6213a0984f425c88536aa39bd7cf02` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:14.450186 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a0590-7663-4ba9-9477-b76c3eaa6582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b6213a0984f425c88536aa39bd7cf02)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:14.452064 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a0590-7663-4ba9-9477-b76c3eaa6582 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:14.497524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d92a0590-7663-4ba9-9477-b76c3eaa6582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b6213a0984f425c88536aa39bd7cf02', 'request_id': 'req-d92a0590-7663-4ba9-9477-b76c3eaa6582'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:14.505239 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d92a0590-7663-4ba9-9477-b76c3eaa6582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b6213a0984f425c88536aa39bd7cf02', 'request_id': 'req-d92a0590-7663-4ba9-9477-b76c3eaa6582'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:14.510769 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d92a0590-7663-4ba9-9477-b76c3eaa6582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b6213a0984f425c88536aa39bd7cf02', 'request_id': 'req-d92a0590-7663-4ba9-9477-b76c3eaa6582'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:14.522196 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d92a0590-7663-4ba9-9477-b76c3eaa6582 admin admin] The token cache is being invalidate because project 9b6213a0984f425c88536aa39bd7cf02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:25:14.522480 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d92a0590-7663-4ba9-9477-b76c3eaa6582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:14.523111 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d92a0590-7663-4ba9-9477-b76c3eaa6582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:14.524579 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1419/2840] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:25:14 2022] DELETE /identity/v3/projects/9b6213a0984f425c88536aa39bd7cf02 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:25:14.529478 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba8ef0-fa10-4358-b5df-a26c451567c6 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:14.530222 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba8ef0-fa10-4358-b5df-a26c451567c6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:14.530491 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba8ef0-fa10-4358-b5df-a26c451567c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:14.549969 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-95ba8ef0-fa10-4358-b5df-a26c451567c6 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:14.551153 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-95ba8ef0-fa10-4358-b5df-a26c451567c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:14.608365 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1422/2841] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:25:14.617644 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c65215-d215-4d01-bac5-8652bcd5ec43 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:14.617926 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c65215-d215-4d01-bac5-8652bcd5ec43 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:14.618197 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c65215-d215-4d01-bac5-8652bcd5ec43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:14.638572 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-f2c65215-d215-4d01-bac5-8652bcd5ec43 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:14.640392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f2c65215-d215-4d01-bac5-8652bcd5ec43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:14.648361 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1420/2842] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:25:14.652583 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba8ef0-fa10-4358-b5df-a26c451567c6 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:14.662763 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba8ef0-fa10-4358-b5df-a26c451567c6 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:14.667397 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76579acc-0e70-4a58-97d9-d034adfd830f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:14.667990 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76579acc-0e70-4a58-97d9-d034adfd830f admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:14.668266 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76579acc-0e70-4a58-97d9-d034adfd830f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:14.668536 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76579acc-0e70-4a58-97d9-d034adfd830f admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:14.669218 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76579acc-0e70-4a58-97d9-d034adfd830f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:25:14.669521 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76579acc-0e70-4a58-97d9-d034adfd830f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:14.671117 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76579acc-0e70-4a58-97d9-d034adfd830f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:14.682506 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1423/2843] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:25:14.686542 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c65215-d215-4d01-bac5-8652bcd5ec43 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:14.696267 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c65215-d215-4d01-bac5-8652bcd5ec43 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:14.700897 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659d123-3e6c-40f3-820d-12eda79aa656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:14.701572 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659d123-3e6c-40f3-820d-12eda79aa656 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:14.701849 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659d123-3e6c-40f3-820d-12eda79aa656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:14.702116 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659d123-3e6c-40f3-820d-12eda79aa656 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:14.703301 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659d123-3e6c-40f3-820d-12eda79aa656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:14.705203 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659d123-3e6c-40f3-820d-12eda79aa656 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:14.731257 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1421/2844] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:25:14 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:25:14.735343 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76579acc-0e70-4a58-97d9-d034adfd830f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:14.745447 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76579acc-0e70-4a58-97d9-d034adfd830f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:14.805885 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f448be5-6881-4c57-b10e-907ce5144664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:14.806493 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f448be5-6881-4c57-b10e-907ce5144664 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:14.806770 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f448be5-6881-4c57-b10e-907ce5144664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:14.807041 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f448be5-6881-4c57-b10e-907ce5144664 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:14.807663 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f448be5-6881-4c57-b10e-907ce5144664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:14.809607 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f448be5-6881-4c57-b10e-907ce5144664 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:14.831711 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1424/2845] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:25:14 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:25:14.836069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659d123-3e6c-40f3-820d-12eda79aa656 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:14.846505 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659d123-3e6c-40f3-820d-12eda79aa656 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:14.851094 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169f7fc-2b61-4b55-abe7-a273ace1b4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:14.851699 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169f7fc-2b61-4b55-abe7-a273ace1b4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:14.851954 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169f7fc-2b61-4b55-abe7-a273ace1b4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:14.852222 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169f7fc-2b61-4b55-abe7-a273ace1b4e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:14.852855 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169f7fc-2b61-4b55-abe7-a273ace1b4e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:14.854481 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169f7fc-2b61-4b55-abe7-a273ace1b4e4 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:14.864247 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1422/2846] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:25:14.868003 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f448be5-6881-4c57-b10e-907ce5144664 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:14.878403 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f448be5-6881-4c57-b10e-907ce5144664 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:14.882998 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cce2c-b1f1-44d0-9f0c-5cdc40a1ac5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:14.883658 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cce2c-b1f1-44d0-9f0c-5cdc40a1ac5e admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:14.883933 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cce2c-b1f1-44d0-9f0c-5cdc40a1ac5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:14.884200 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cce2c-b1f1-44d0-9f0c-5cdc40a1ac5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:14.885127 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cce2c-b1f1-44d0-9f0c-5cdc40a1ac5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:14.886811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cce2c-b1f1-44d0-9f0c-5cdc40a1ac5e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:14.897811 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1425/2847] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:25:14.901929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169f7fc-2b61-4b55-abe7-a273ace1b4e4 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:14.911924 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169f7fc-2b61-4b55-abe7-a273ace1b4e4 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:14.916545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84772937-b5ae-487e-9fc7-fb4b1cb707f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:14.917204 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84772937-b5ae-487e-9fc7-fb4b1cb707f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:14.917483 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84772937-b5ae-487e-9fc7-fb4b1cb707f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:14.917750 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84772937-b5ae-487e-9fc7-fb4b1cb707f3 admin admin] PATH_INFO: `/v3/projects/453958d423eb43129c98b0cd33762dad/users/fce8037449c44471b5e5410de0c60902/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:14.933086 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84772937-b5ae-487e-9fc7-fb4b1cb707f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=453958d423eb43129c98b0cd33762dad, user_id=fce8037449c44471b5e5410de0c60902, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:14.935754 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84772937-b5ae-487e-9fc7-fb4b1cb707f3 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:14.949143 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1423/2848] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:25:14 2022] PUT /identity/v3/projects/453958d423eb43129c98b0cd33762dad/users/fce8037449c44471b5e5410de0c60902/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:25:14.959951 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e363fa-30a9-444f-b961-17b6e093e98a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:14.960236 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e363fa-30a9-444f-b961-17b6e093e98a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:14.960503 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e363fa-30a9-444f-b961-17b6e093e98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:14.987621 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b4e363fa-30a9-444f-b961-17b6e093e98a None None] MFA Rules not processed for user `fce8037449c44471b5e5410de0c60902`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:14.988913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b4e363fa-30a9-444f-b961-17b6e093e98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:15.042897 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:15.055104 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1426/2849] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:25:15.059554 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84772937-b5ae-487e-9fc7-fb4b1cb707f3 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:15.104007 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:15.121510 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84772937-b5ae-487e-9fc7-fb4b1cb707f3 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:15.126603 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141b3e2-b0fe-4c73-be8b-ed1b08ac871e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:15.127196 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141b3e2-b0fe-4c73-be8b-ed1b08ac871e admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:15.127473 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141b3e2-b0fe-4c73-be8b-ed1b08ac871e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:15.127743 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141b3e2-b0fe-4c73-be8b-ed1b08ac871e admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:15.128374 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141b3e2-b0fe-4c73-be8b-ed1b08ac871e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:15.130299 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141b3e2-b0fe-4c73-be8b-ed1b08ac871e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:15.156103 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1424/2850] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:25:15 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:25:15.160149 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e363fa-30a9-444f-b961-17b6e093e98a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:15.170802 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e363fa-30a9-444f-b961-17b6e093e98a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:15.226466 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fbf57-aff5-43dc-9274-428b8218bd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:15.227062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fbf57-aff5-43dc-9274-428b8218bd9b admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:15.227338 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fbf57-aff5-43dc-9274-428b8218bd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:15.227662 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fbf57-aff5-43dc-9274-428b8218bd9b admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:15.228289 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729fbf57-aff5-43dc-9274-428b8218bd9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:15.230235 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729fbf57-aff5-43dc-9274-428b8218bd9b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:15.252470 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1427/2851] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:25:15 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:25:15.256408 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141b3e2-b0fe-4c73-be8b-ed1b08ac871e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:15.266702 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141b3e2-b0fe-4c73-be8b-ed1b08ac871e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:15.271392 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c123d-2fe8-43ab-a18e-c8682a4e6e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:15.271981 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c123d-2fe8-43ab-a18e-c8682a4e6e59 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:15.272268 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c123d-2fe8-43ab-a18e-c8682a4e6e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:15.272541 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c123d-2fe8-43ab-a18e-c8682a4e6e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:15.273217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c123d-2fe8-43ab-a18e-c8682a4e6e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:15.274806 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c123d-2fe8-43ab-a18e-c8682a4e6e59 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:15.285615 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1425/2852] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:25:15.289684 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fbf57-aff5-43dc-9274-428b8218bd9b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:15.300069 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fbf57-aff5-43dc-9274-428b8218bd9b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:15.304729 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce4d2c-56d9-4d99-af88-2ea3e3292bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:15.305403 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce4d2c-56d9-4d99-af88-2ea3e3292bd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:15.305689 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce4d2c-56d9-4d99-af88-2ea3e3292bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:15.305963 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce4d2c-56d9-4d99-af88-2ea3e3292bd3 admin admin] PATH_INFO: `/v3/projects/27b913e647dc494eaade98a8be6d1f37/users/70ecaacc16a443ec8eacbdfa282a834f/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:15.322329 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce4d2c-56d9-4d99-af88-2ea3e3292bd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27b913e647dc494eaade98a8be6d1f37, user_id=70ecaacc16a443ec8eacbdfa282a834f, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:15.325036 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce4d2c-56d9-4d99-af88-2ea3e3292bd3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:15.337662 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1428/2853] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:25:15 2022] PUT /identity/v3/projects/27b913e647dc494eaade98a8be6d1f37/users/70ecaacc16a443ec8eacbdfa282a834f/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:25:15.341610 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c123d-2fe8-43ab-a18e-c8682a4e6e59 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:15.351384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c123d-2fe8-43ab-a18e-c8682a4e6e59 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:15.407699 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481e5d8-2af4-40f8-b2e1-25ca563b2d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:15.408217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481e5d8-2af4-40f8-b2e1-25ca563b2d18 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:15.408489 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481e5d8-2af4-40f8-b2e1-25ca563b2d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:15.408755 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481e5d8-2af4-40f8-b2e1-25ca563b2d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:15.409420 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481e5d8-2af4-40f8-b2e1-25ca563b2d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:15.411004 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481e5d8-2af4-40f8-b2e1-25ca563b2d18 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:15.420616 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1426/2854] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:25:15.425533 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce4d2c-56d9-4d99-af88-2ea3e3292bd3 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:15.435762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce4d2c-56d9-4d99-af88-2ea3e3292bd3 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:15.440304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50dbbd2-7cc2-4f79-87bb-40020b55ad6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:15.440944 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50dbbd2-7cc2-4f79-87bb-40020b55ad6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:15.441264 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50dbbd2-7cc2-4f79-87bb-40020b55ad6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:15.441528 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50dbbd2-7cc2-4f79-87bb-40020b55ad6c admin admin] PATH_INFO: `/v3/projects/27b913e647dc494eaade98a8be6d1f37/users/70ecaacc16a443ec8eacbdfa282a834f/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:15.443425 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50dbbd2-7cc2-4f79-87bb-40020b55ad6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=27b913e647dc494eaade98a8be6d1f37, user_id=70ecaacc16a443ec8eacbdfa282a834f, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:15.446118 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50dbbd2-7cc2-4f79-87bb-40020b55ad6c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:15.456082 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1429/2855] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:25:15 2022] PUT /identity/v3/projects/27b913e647dc494eaade98a8be6d1f37/users/70ecaacc16a443ec8eacbdfa282a834f/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:25:15.466191 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04367a3b-4368-4ccf-8f28-e8f45d1189d2 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:15.466655 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04367a3b-4368-4ccf-8f28-e8f45d1189d2 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:15.466754 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04367a3b-4368-4ccf-8f28-e8f45d1189d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:15.495214 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-04367a3b-4368-4ccf-8f28-e8f45d1189d2 None None] MFA Rules not processed for user `70ecaacc16a443ec8eacbdfa282a834f`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:15.496416 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-04367a3b-4368-4ccf-8f28-e8f45d1189d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:15.564417 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1427/2856] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:25:15.575093 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50dbbd2-7cc2-4f79-87bb-40020b55ad6c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:15.576840 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d50dbbd2-7cc2-4f79-87bb-40020b55ad6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:15.634928 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50dbbd2-7cc2-4f79-87bb-40020b55ad6c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:15.638539 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9a024-9255-477d-b5a2-a9c884d601c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:15.639131 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9a024-9255-477d-b5a2-a9c884d601c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:15.639404 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9a024-9255-477d-b5a2-a9c884d601c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:15.639680 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9a024-9255-477d-b5a2-a9c884d601c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:15.649766 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9a024-9255-477d-b5a2-a9c884d601c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:15.651202 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9a024-9255-477d-b5a2-a9c884d601c4 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:15.661642 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1430/2857] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:25:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:25:16.018472 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04367a3b-4368-4ccf-8f28-e8f45d1189d2 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:16.059887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:16.080626 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04367a3b-4368-4ccf-8f28-e8f45d1189d2 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:16.085088 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848d451-aa28-4896-a585-35b2748457ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:16.085714 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848d451-aa28-4896-a585-35b2748457ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:16.085983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848d451-aa28-4896-a585-35b2748457ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:16.086248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848d451-aa28-4896-a585-35b2748457ff admin admin] PATH_INFO: `/v3/users/fce8037449c44471b5e5410de0c60902` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:16.087338 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848d451-aa28-4896-a585-35b2748457ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=fce8037449c44471b5e5410de0c60902)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:16.089261 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848d451-aa28-4896-a585-35b2748457ff admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:16.133699 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a848d451-aa28-4896-a585-35b2748457ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fce8037449c44471b5e5410de0c60902'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:16.141157 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a848d451-aa28-4896-a585-35b2748457ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fce8037449c44471b5e5410de0c60902'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:16.152922 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a848d451-aa28-4896-a585-35b2748457ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fce8037449c44471b5e5410de0c60902'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:16.153618 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a848d451-aa28-4896-a585-35b2748457ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fce8037449c44471b5e5410de0c60902'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:16.160780 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a848d451-aa28-4896-a585-35b2748457ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fce8037449c44471b5e5410de0c60902'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:16.166605 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1428/2858] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:25:16 2022] DELETE /identity/v3/users/fce8037449c44471b5e5410de0c60902 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:25:16.171027 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98368207-1068-4be3-899e-02346bfdf283 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:16.171315 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98368207-1068-4be3-899e-02346bfdf283 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:16.171590 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98368207-1068-4be3-899e-02346bfdf283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:16.190806 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-98368207-1068-4be3-899e-02346bfdf283 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:16.192016 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-98368207-1068-4be3-899e-02346bfdf283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:16.234512 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:16.254018 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1431/2859] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:25:16.263827 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848d451-aa28-4896-a585-35b2748457ff admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:16.265840 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a848d451-aa28-4896-a585-35b2748457ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:16.334378 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848d451-aa28-4896-a585-35b2748457ff admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:16.338215 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731afad-c910-41c0-b278-4f3e8abc50cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:16.338797 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731afad-c910-41c0-b278-4f3e8abc50cf service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:16.339073 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731afad-c910-41c0-b278-4f3e8abc50cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:16.339339 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731afad-c910-41c0-b278-4f3e8abc50cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:16.348441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731afad-c910-41c0-b278-4f3e8abc50cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:16.349892 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731afad-c910-41c0-b278-4f3e8abc50cf service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:16.359202 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1429/2860] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:25:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:25:16.622597 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98368207-1068-4be3-899e-02346bfdf283 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:16.624082 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-98368207-1068-4be3-899e-02346bfdf283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:16.636922 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98368207-1068-4be3-899e-02346bfdf283 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:16.641533 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24466ee-32a0-4717-8527-94cb97f1a978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:16.642184 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24466ee-32a0-4717-8527-94cb97f1a978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:16.642457 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24466ee-32a0-4717-8527-94cb97f1a978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:16.642844 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24466ee-32a0-4717-8527-94cb97f1a978 admin admin] PATH_INFO: `/v3/projects/453958d423eb43129c98b0cd33762dad` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:16.643955 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24466ee-32a0-4717-8527-94cb97f1a978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=453958d423eb43129c98b0cd33762dad)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:16.645897 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24466ee-32a0-4717-8527-94cb97f1a978 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:16.693468 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c24466ee-32a0-4717-8527-94cb97f1a978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '453958d423eb43129c98b0cd33762dad', 'request_id': 'req-c24466ee-32a0-4717-8527-94cb97f1a978'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:16.699845 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c24466ee-32a0-4717-8527-94cb97f1a978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '453958d423eb43129c98b0cd33762dad', 'request_id': 'req-c24466ee-32a0-4717-8527-94cb97f1a978'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:16.706500 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c24466ee-32a0-4717-8527-94cb97f1a978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '453958d423eb43129c98b0cd33762dad', 'request_id': 'req-c24466ee-32a0-4717-8527-94cb97f1a978'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:16.716745 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c24466ee-32a0-4717-8527-94cb97f1a978 admin admin] The token cache is being invalidate because project 453958d423eb43129c98b0cd33762dad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:25:16.717033 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c24466ee-32a0-4717-8527-94cb97f1a978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:16.717680 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c24466ee-32a0-4717-8527-94cb97f1a978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:16.719189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1432/2861] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:25:16 2022] DELETE /identity/v3/projects/453958d423eb43129c98b0cd33762dad => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:25:16.723356 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731afad-c910-41c0-b278-4f3e8abc50cf service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:16.732963 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731afad-c910-41c0-b278-4f3e8abc50cf service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:16.789032 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac38fb-1e80-4c8b-97c9-503de2487987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:16.789678 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac38fb-1e80-4c8b-97c9-503de2487987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:16.789954 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac38fb-1e80-4c8b-97c9-503de2487987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:16.790226 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac38fb-1e80-4c8b-97c9-503de2487987 admin admin] PATH_INFO: `/v3/users/70ecaacc16a443ec8eacbdfa282a834f` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:16.791336 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac38fb-1e80-4c8b-97c9-503de2487987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70ecaacc16a443ec8eacbdfa282a834f)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:16.793283 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac38fb-1e80-4c8b-97c9-503de2487987 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:16.795622 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:16.842670 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-9dac38fb-1e80-4c8b-97c9-503de2487987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70ecaacc16a443ec8eacbdfa282a834f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:16.849845 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-9dac38fb-1e80-4c8b-97c9-503de2487987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70ecaacc16a443ec8eacbdfa282a834f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:16.862460 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-9dac38fb-1e80-4c8b-97c9-503de2487987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70ecaacc16a443ec8eacbdfa282a834f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:16.863095 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-9dac38fb-1e80-4c8b-97c9-503de2487987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70ecaacc16a443ec8eacbdfa282a834f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:16.870333 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-9dac38fb-1e80-4c8b-97c9-503de2487987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70ecaacc16a443ec8eacbdfa282a834f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:16.876916 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1430/2862] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:25:16 2022] DELETE /identity/v3/users/70ecaacc16a443ec8eacbdfa282a834f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:25:17.143625 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24466ee-32a0-4717-8527-94cb97f1a978 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:17.145058 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c24466ee-32a0-4717-8527-94cb97f1a978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:17.159943 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24466ee-32a0-4717-8527-94cb97f1a978 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:17.216512 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f0b4b-2028-4f6f-9ec4-dcd0ad188524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:17.217066 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f0b4b-2028-4f6f-9ec4-dcd0ad188524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:17.217383 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f0b4b-2028-4f6f-9ec4-dcd0ad188524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:17.217652 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f0b4b-2028-4f6f-9ec4-dcd0ad188524 admin admin] PATH_INFO: `/v3/projects/27b913e647dc494eaade98a8be6d1f37` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:17.219303 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f0b4b-2028-4f6f-9ec4-dcd0ad188524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27b913e647dc494eaade98a8be6d1f37)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:17.221282 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f0b4b-2028-4f6f-9ec4-dcd0ad188524 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:17.267303 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-108f0b4b-2028-4f6f-9ec4-dcd0ad188524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27b913e647dc494eaade98a8be6d1f37', 'request_id': 'req-108f0b4b-2028-4f6f-9ec4-dcd0ad188524'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:17.273547 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-108f0b4b-2028-4f6f-9ec4-dcd0ad188524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27b913e647dc494eaade98a8be6d1f37', 'request_id': 'req-108f0b4b-2028-4f6f-9ec4-dcd0ad188524'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:17.281781 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-108f0b4b-2028-4f6f-9ec4-dcd0ad188524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27b913e647dc494eaade98a8be6d1f37', 'request_id': 'req-108f0b4b-2028-4f6f-9ec4-dcd0ad188524'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:17.292391 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-108f0b4b-2028-4f6f-9ec4-dcd0ad188524 admin admin] The token cache is being invalidate because project 27b913e647dc494eaade98a8be6d1f37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:25:17.292709 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-108f0b4b-2028-4f6f-9ec4-dcd0ad188524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:17.293362 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-108f0b4b-2028-4f6f-9ec4-dcd0ad188524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:17.294831 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1433/2863] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:25:17 2022] DELETE /identity/v3/projects/27b913e647dc494eaade98a8be6d1f37 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:25:17.299811 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbc5bf-ba71-45a3-af08-94434e2fb0e1 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:17.300094 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbc5bf-ba71-45a3-af08-94434e2fb0e1 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:17.300366 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbc5bf-ba71-45a3-af08-94434e2fb0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:17.320038 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-fcdbc5bf-ba71-45a3-af08-94434e2fb0e1 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:17.321279 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-fcdbc5bf-ba71-45a3-af08-94434e2fb0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:17.379786 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1431/2864] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:25:17.387350 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886eba0-68a0-4d6c-a282-4127f1252dbe None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:17.387639 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886eba0-68a0-4d6c-a282-4127f1252dbe None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:17.387913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886eba0-68a0-4d6c-a282-4127f1252dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:17.396463 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:17.411098 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-4886eba0-68a0-4d6c-a282-4127f1252dbe None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:17.412310 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4886eba0-68a0-4d6c-a282-4127f1252dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:17.420373 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1434/2865] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:25:17.424534 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdbc5bf-ba71-45a3-af08-94434e2fb0e1 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:17.434656 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdbc5bf-ba71-45a3-af08-94434e2fb0e1 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:17.439418 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4653bc-cd1f-4a4e-a39c-4d216a10375a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:17.440009 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4653bc-cd1f-4a4e-a39c-4d216a10375a admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:17.440289 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4653bc-cd1f-4a4e-a39c-4d216a10375a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:17.440563 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4653bc-cd1f-4a4e-a39c-4d216a10375a admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:17.441258 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4653bc-cd1f-4a4e-a39c-4d216a10375a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:25:17.441566 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4653bc-cd1f-4a4e-a39c-4d216a10375a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:17.443158 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4653bc-cd1f-4a4e-a39c-4d216a10375a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:17.455158 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1432/2866] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 14:25:17.459377 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886eba0-68a0-4d6c-a282-4127f1252dbe None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:17.469305 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886eba0-68a0-4d6c-a282-4127f1252dbe None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:17.473908 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b2c35-15a9-4027-9bdd-20d4d9607bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:17.474496 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b2c35-15a9-4027-9bdd-20d4d9607bfb admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:17.474775 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b2c35-15a9-4027-9bdd-20d4d9607bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:17.475043 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b2c35-15a9-4027-9bdd-20d4d9607bfb admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:17.475671 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b2c35-15a9-4027-9bdd-20d4d9607bfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:17.477669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b2c35-15a9-4027-9bdd-20d4d9607bfb admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:17.503866 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1435/2867] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:25:17 2022] POST /identity/v3/projects => generated 359 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:25:17.507736 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4653bc-cd1f-4a4e-a39c-4d216a10375a admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:17.518764 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4653bc-cd1f-4a4e-a39c-4d216a10375a admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:17.574440 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05b06a-3af3-4a25-9459-b0bf22b10d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:17.575031 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05b06a-3af3-4a25-9459-b0bf22b10d81 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:17.575312 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05b06a-3af3-4a25-9459-b0bf22b10d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:17.575585 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05b06a-3af3-4a25-9459-b0bf22b10d81 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:17.576215 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05b06a-3af3-4a25-9459-b0bf22b10d81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:17.578672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05b06a-3af3-4a25-9459-b0bf22b10d81 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:17.594245 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:17.600717 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1433/2868] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:25:17 2022] POST /identity/v3/users => generated 280 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:25:17.604950 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b2c35-15a9-4027-9bdd-20d4d9607bfb admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:17.615412 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b2c35-15a9-4027-9bdd-20d4d9607bfb admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:17.620291 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10f531-7054-451a-a13d-f5f3b528f3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:17.620896 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10f531-7054-451a-a13d-f5f3b528f3f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:17.621211 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10f531-7054-451a-a13d-f5f3b528f3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:17.621488 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10f531-7054-451a-a13d-f5f3b528f3f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:17.622135 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10f531-7054-451a-a13d-f5f3b528f3f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:17.623740 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10f531-7054-451a-a13d-f5f3b528f3f1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:17.634493 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1436/2869] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:25:17.638481 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05b06a-3af3-4a25-9459-b0bf22b10d81 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:17.648825 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05b06a-3af3-4a25-9459-b0bf22b10d81 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:17.653543 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24322b37-9e02-4c7b-9f6a-fa8528e6394d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:17.654140 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24322b37-9e02-4c7b-9f6a-fa8528e6394d admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:17.654455 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24322b37-9e02-4c7b-9f6a-fa8528e6394d admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:17.654689 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24322b37-9e02-4c7b-9f6a-fa8528e6394d admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:17.655619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24322b37-9e02-4c7b-9f6a-fa8528e6394d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:17.657243 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24322b37-9e02-4c7b-9f6a-fa8528e6394d admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:17.667696 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1434/2870] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:25:17.671695 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10f531-7054-451a-a13d-f5f3b528f3f1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:17.681837 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10f531-7054-451a-a13d-f5f3b528f3f1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:17.687050 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36148e7b-2504-45b4-b222-e4f19f8fc66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:17.687692 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36148e7b-2504-45b4-b222-e4f19f8fc66f admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:17.687969 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36148e7b-2504-45b4-b222-e4f19f8fc66f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:17.688270 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36148e7b-2504-45b4-b222-e4f19f8fc66f admin admin] PATH_INFO: `/v3/projects/c89ebcc9c8404218b9a26550e7377716/users/ba4bda616c9e4fc588d0925a058877d5/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:17.703213 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36148e7b-2504-45b4-b222-e4f19f8fc66f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89ebcc9c8404218b9a26550e7377716, user_id=ba4bda616c9e4fc588d0925a058877d5, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:17.705909 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36148e7b-2504-45b4-b222-e4f19f8fc66f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:17.718301 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1437/2871] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:25:17 2022] PUT /identity/v3/projects/c89ebcc9c8404218b9a26550e7377716/users/ba4bda616c9e4fc588d0925a058877d5/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:25:17.728811 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6a09b-8e6f-417b-8f85-6397781c996d None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:17.729311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6a09b-8e6f-417b-8f85-6397781c996d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:17.729443 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6a09b-8e6f-417b-8f85-6397781c996d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:17.756835 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-5ac6a09b-8e6f-417b-8f85-6397781c996d None None] MFA Rules not processed for user `ba4bda616c9e4fc588d0925a058877d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:17.758052 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5ac6a09b-8e6f-417b-8f85-6397781c996d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:17.820580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1435/2872] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:25:17.854984 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36148e7b-2504-45b4-b222-e4f19f8fc66f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:17.856678 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-36148e7b-2504-45b4-b222-e4f19f8fc66f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:17.913168 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36148e7b-2504-45b4-b222-e4f19f8fc66f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:17.916876 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30abb25-84aa-448c-a149-2ec95d7ab2c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:17.917509 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30abb25-84aa-448c-a149-2ec95d7ab2c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:17.917813 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30abb25-84aa-448c-a149-2ec95d7ab2c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:17.918085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30abb25-84aa-448c-a149-2ec95d7ab2c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:17.926345 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30abb25-84aa-448c-a149-2ec95d7ab2c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:17.927770 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30abb25-84aa-448c-a149-2ec95d7ab2c9 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:17.936437 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1438/2873] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:25:17 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:25:17.952801 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6a09b-8e6f-417b-8f85-6397781c996d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:18.015631 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6a09b-8e6f-417b-8f85-6397781c996d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:18.020175 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81a28c-83ba-46e3-a185-1a2137adbc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:18.020785 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81a28c-83ba-46e3-a185-1a2137adbc40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:18.021062 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81a28c-83ba-46e3-a185-1a2137adbc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:18.021368 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81a28c-83ba-46e3-a185-1a2137adbc40 admin admin] PATH_INFO: `/v3/users/ba4bda616c9e4fc588d0925a058877d5` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:18.022526 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81a28c-83ba-46e3-a185-1a2137adbc40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba4bda616c9e4fc588d0925a058877d5)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:18.024424 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81a28c-83ba-46e3-a185-1a2137adbc40 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:18.070822 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2b81a28c-83ba-46e3-a185-1a2137adbc40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba4bda616c9e4fc588d0925a058877d5'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:18.077901 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2b81a28c-83ba-46e3-a185-1a2137adbc40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba4bda616c9e4fc588d0925a058877d5'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:18.089728 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2b81a28c-83ba-46e3-a185-1a2137adbc40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba4bda616c9e4fc588d0925a058877d5'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:18.090360 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2b81a28c-83ba-46e3-a185-1a2137adbc40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba4bda616c9e4fc588d0925a058877d5'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:18.095655 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:18.097809 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2b81a28c-83ba-46e3-a185-1a2137adbc40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba4bda616c9e4fc588d0925a058877d5'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:18.104807 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1436/2874] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:25:17 2022] DELETE /identity/v3/users/ba4bda616c9e4fc588d0925a058877d5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:25:18.109800 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a1e35-4102-47e9-845e-4e898d5f4c42 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:18.110086 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a1e35-4102-47e9-845e-4e898d5f4c42 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:18.110359 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a1e35-4102-47e9-845e-4e898d5f4c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:18.130919 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-1a9a1e35-4102-47e9-845e-4e898d5f4c42 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:18.132133 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1a9a1e35-4102-47e9-845e-4e898d5f4c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:18.190030 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1439/2875] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:25:18.200179 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81a28c-83ba-46e3-a185-1a2137adbc40 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:18.201647 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2b81a28c-83ba-46e3-a185-1a2137adbc40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:18.258768 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81a28c-83ba-46e3-a185-1a2137adbc40 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:18.262435 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cc6b1-d23a-429e-a28f-781c6fbde917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:18.263030 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cc6b1-d23a-429e-a28f-781c6fbde917 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:18.263310 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cc6b1-d23a-429e-a28f-781c6fbde917 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:18.263583 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cc6b1-d23a-429e-a28f-781c6fbde917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:18.272577 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cc6b1-d23a-429e-a28f-781c6fbde917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:18.273964 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cc6b1-d23a-429e-a28f-781c6fbde917 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:18.283586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1437/2876] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:25:18.776106 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a1e35-4102-47e9-845e-4e898d5f4c42 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:18.777575 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1a9a1e35-4102-47e9-845e-4e898d5f4c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:18.791443 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a1e35-4102-47e9-845e-4e898d5f4c42 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:18.796203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cabf3-4241-40b7-914c-1b40bae128de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:18.796850 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cabf3-4241-40b7-914c-1b40bae128de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:18.797149 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cabf3-4241-40b7-914c-1b40bae128de admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:18.797420 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cabf3-4241-40b7-914c-1b40bae128de admin admin] PATH_INFO: `/v3/projects/c89ebcc9c8404218b9a26550e7377716` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:18.799225 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231cabf3-4241-40b7-914c-1b40bae128de admin admin] RBAC: Authorizing `identity:delete_project(project_id=c89ebcc9c8404218b9a26550e7377716)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:18.801297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231cabf3-4241-40b7-914c-1b40bae128de admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:18.839083 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:18.850689 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-231cabf3-4241-40b7-914c-1b40bae128de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c89ebcc9c8404218b9a26550e7377716', 'request_id': 'req-231cabf3-4241-40b7-914c-1b40bae128de'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:18.856915 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-231cabf3-4241-40b7-914c-1b40bae128de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c89ebcc9c8404218b9a26550e7377716', 'request_id': 'req-231cabf3-4241-40b7-914c-1b40bae128de'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:18.864486 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-231cabf3-4241-40b7-914c-1b40bae128de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c89ebcc9c8404218b9a26550e7377716', 'request_id': 'req-231cabf3-4241-40b7-914c-1b40bae128de'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:18.875295 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-231cabf3-4241-40b7-914c-1b40bae128de admin admin] The token cache is being invalidate because project c89ebcc9c8404218b9a26550e7377716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:25:18.875578 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-231cabf3-4241-40b7-914c-1b40bae128de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:18.876196 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-231cabf3-4241-40b7-914c-1b40bae128de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:18.877721 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1440/2877] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:25:18 2022] DELETE /identity/v3/projects/c89ebcc9c8404218b9a26550e7377716 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:25:18.882562 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74ffed-fee4-470f-b373-69eb0d99a3ef None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:18.883025 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74ffed-fee4-470f-b373-69eb0d99a3ef None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:18.883125 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74ffed-fee4-470f-b373-69eb0d99a3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:18.902999 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-ec74ffed-fee4-470f-b373-69eb0d99a3ef None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:18.904196 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ec74ffed-fee4-470f-b373-69eb0d99a3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:18.974349 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1438/2878] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 14:25:18.982955 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edce25-9e5f-4c93-af7b-4f5263b949f5 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:18.983237 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edce25-9e5f-4c93-af7b-4f5263b949f5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:18.983565 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edce25-9e5f-4c93-af7b-4f5263b949f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:19.003085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-29edce25-9e5f-4c93-af7b-4f5263b949f5 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:19.004279 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-29edce25-9e5f-4c93-af7b-4f5263b949f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:19.012091 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1441/2879] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:25:19.016669 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74ffed-fee4-470f-b373-69eb0d99a3ef None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:19.026361 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74ffed-fee4-470f-b373-69eb0d99a3ef None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:19.031922 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3ee3c-eb13-4dbc-842a-3f631c72a32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:19.032510 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3ee3c-eb13-4dbc-842a-3f631c72a32e admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:19.032789 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3ee3c-eb13-4dbc-842a-3f631c72a32e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:19.033058 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3ee3c-eb13-4dbc-842a-3f631c72a32e admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:19.033729 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3ee3c-eb13-4dbc-842a-3f631c72a32e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:25:19.034036 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3ee3c-eb13-4dbc-842a-3f631c72a32e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:19.035626 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3ee3c-eb13-4dbc-842a-3f631c72a32e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:19.047367 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1439/2880] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:25:19.051507 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edce25-9e5f-4c93-af7b-4f5263b949f5 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:19.060683 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edce25-9e5f-4c93-af7b-4f5263b949f5 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:19.065340 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca928fd-69ff-40f1-a51d-c8c3925f431d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:19.065917 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca928fd-69ff-40f1-a51d-c8c3925f431d admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:19.066190 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca928fd-69ff-40f1-a51d-c8c3925f431d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:19.066455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca928fd-69ff-40f1-a51d-c8c3925f431d admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:19.067076 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca928fd-69ff-40f1-a51d-c8c3925f431d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:19.068952 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca928fd-69ff-40f1-a51d-c8c3925f431d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:19.096465 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1442/2881] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:25:19 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:25:19.100525 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3ee3c-eb13-4dbc-842a-3f631c72a32e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:19.110437 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3ee3c-eb13-4dbc-842a-3f631c72a32e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:19.165596 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ef0cb-32fb-4687-8dfd-82cedb73e304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:19.166180 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ef0cb-32fb-4687-8dfd-82cedb73e304 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:19.166454 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ef0cb-32fb-4687-8dfd-82cedb73e304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:19.166720 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ef0cb-32fb-4687-8dfd-82cedb73e304 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:19.167326 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ef0cb-32fb-4687-8dfd-82cedb73e304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:19.169262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ef0cb-32fb-4687-8dfd-82cedb73e304 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:19.191069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1440/2882] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:25:19 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:25:19.195214 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca928fd-69ff-40f1-a51d-c8c3925f431d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:19.206049 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca928fd-69ff-40f1-a51d-c8c3925f431d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:19.210575 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc4ae7-2cb9-4273-9196-1e4a77981597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:19.211154 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc4ae7-2cb9-4273-9196-1e4a77981597 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:19.211428 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc4ae7-2cb9-4273-9196-1e4a77981597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:19.211693 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc4ae7-2cb9-4273-9196-1e4a77981597 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:19.212326 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc4ae7-2cb9-4273-9196-1e4a77981597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:19.213950 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc4ae7-2cb9-4273-9196-1e4a77981597 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:19.223673 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1443/2883] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:25:19.227518 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ef0cb-32fb-4687-8dfd-82cedb73e304 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:19.237150 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ef0cb-32fb-4687-8dfd-82cedb73e304 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:19.241668 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d7083-2305-42bd-9782-ac78756d0474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:19.242242 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d7083-2305-42bd-9782-ac78756d0474 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:19.242514 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d7083-2305-42bd-9782-ac78756d0474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:19.242779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d7083-2305-42bd-9782-ac78756d0474 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:19.243402 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d7083-2305-42bd-9782-ac78756d0474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:19.244978 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d7083-2305-42bd-9782-ac78756d0474 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:19.255817 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1441/2884] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:25:19.260204 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc4ae7-2cb9-4273-9196-1e4a77981597 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:19.271418 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc4ae7-2cb9-4273-9196-1e4a77981597 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:19.276040 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968deee-fbf4-4078-a02e-e1369edebb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:19.276681 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968deee-fbf4-4078-a02e-e1369edebb56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:19.276964 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968deee-fbf4-4078-a02e-e1369edebb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:19.277290 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968deee-fbf4-4078-a02e-e1369edebb56 admin admin] PATH_INFO: `/v3/projects/4b9910775174408193fc74dc21d3681b/users/8c7b2e1a496047c8abfdd8a9de91f6d6/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:19.291880 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968deee-fbf4-4078-a02e-e1369edebb56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b9910775174408193fc74dc21d3681b, user_id=8c7b2e1a496047c8abfdd8a9de91f6d6, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:19.294636 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968deee-fbf4-4078-a02e-e1369edebb56 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:19.307116 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1444/2885] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:25:19 2022] PUT /identity/v3/projects/4b9910775174408193fc74dc21d3681b/users/8c7b2e1a496047c8abfdd8a9de91f6d6/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:25:19.370218 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd83a4-9ffb-4a3e-ade0-9810efeeb8f1 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:19.370433 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd83a4-9ffb-4a3e-ade0-9810efeeb8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:19.370669 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd83a4-9ffb-4a3e-ade0-9810efeeb8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:19.378852 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:19.399733 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-32fd83a4-9ffb-4a3e-ade0-9810efeeb8f1 None None] MFA Rules not processed for user `8c7b2e1a496047c8abfdd8a9de91f6d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:19.400930 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-32fd83a4-9ffb-4a3e-ade0-9810efeeb8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:19.464734 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1442/2886] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:25:19.469935 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968deee-fbf4-4078-a02e-e1369edebb56 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:19.532381 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968deee-fbf4-4078-a02e-e1369edebb56 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:19.537003 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96568c4-e3a1-4017-85d0-5c8c133dca3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:19.537618 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96568c4-e3a1-4017-85d0-5c8c133dca3a admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:19.537894 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96568c4-e3a1-4017-85d0-5c8c133dca3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:19.538159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96568c4-e3a1-4017-85d0-5c8c133dca3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:19.538776 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96568c4-e3a1-4017-85d0-5c8c133dca3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:19.540659 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96568c4-e3a1-4017-85d0-5c8c133dca3a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:19.566194 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1445/2887] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:25:19 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:25:19.570322 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd83a4-9ffb-4a3e-ade0-9810efeeb8f1 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:19.581620 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd83a4-9ffb-4a3e-ade0-9810efeeb8f1 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:19.637851 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dcf4e3-341d-42d1-acca-db7354b68f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:19.638386 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcf4e3-341d-42d1-acca-db7354b68f2a admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:19.638659 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcf4e3-341d-42d1-acca-db7354b68f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:19.638983 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcf4e3-341d-42d1-acca-db7354b68f2a admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:19.640111 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dcf4e3-341d-42d1-acca-db7354b68f2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:19.642063 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dcf4e3-341d-42d1-acca-db7354b68f2a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:19.663524 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1443/2888] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:25:19 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:25:19.667540 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96568c4-e3a1-4017-85d0-5c8c133dca3a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:19.677716 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96568c4-e3a1-4017-85d0-5c8c133dca3a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:19.682296 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2d2f5-4f0c-4ddd-966b-52a32a45dca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:19.682884 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2d2f5-4f0c-4ddd-966b-52a32a45dca2 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:19.683161 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2d2f5-4f0c-4ddd-966b-52a32a45dca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:19.683430 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2d2f5-4f0c-4ddd-966b-52a32a45dca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:19.684079 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea2d2f5-4f0c-4ddd-966b-52a32a45dca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:19.685834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea2d2f5-4f0c-4ddd-966b-52a32a45dca2 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:19.696221 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1446/2889] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:25:19.700254 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dcf4e3-341d-42d1-acca-db7354b68f2a admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:19.710793 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dcf4e3-341d-42d1-acca-db7354b68f2a admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:19.715422 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5853eca-1d41-471f-8f82-ef7ac9e2b2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:19.716009 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5853eca-1d41-471f-8f82-ef7ac9e2b2ba admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:19.716280 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5853eca-1d41-471f-8f82-ef7ac9e2b2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:19.716546 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5853eca-1d41-471f-8f82-ef7ac9e2b2ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:19.717223 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5853eca-1d41-471f-8f82-ef7ac9e2b2ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:19.719371 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5853eca-1d41-471f-8f82-ef7ac9e2b2ba admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:19.729167 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1444/2890] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:25:19.733208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2d2f5-4f0c-4ddd-966b-52a32a45dca2 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:19.743117 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2d2f5-4f0c-4ddd-966b-52a32a45dca2 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:19.747829 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de196eae-1d65-4e39-b169-553a382cc30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:19.748470 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de196eae-1d65-4e39-b169-553a382cc30a admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:19.748748 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de196eae-1d65-4e39-b169-553a382cc30a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:19.749021 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de196eae-1d65-4e39-b169-553a382cc30a admin admin] PATH_INFO: `/v3/projects/3d928e6a4a2c4a58be631570de89028c/users/f5156a2890444245829c0d2e8f7979dc/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:19.763271 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de196eae-1d65-4e39-b169-553a382cc30a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d928e6a4a2c4a58be631570de89028c, user_id=f5156a2890444245829c0d2e8f7979dc, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:19.766484 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de196eae-1d65-4e39-b169-553a382cc30a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:19.779006 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1447/2891] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:25:19 2022] PUT /identity/v3/projects/3d928e6a4a2c4a58be631570de89028c/users/f5156a2890444245829c0d2e8f7979dc/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:25:19.789835 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a56114-745c-49c1-a056-93d2f6179659 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:19.790141 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a56114-745c-49c1-a056-93d2f6179659 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:19.790468 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a56114-745c-49c1-a056-93d2f6179659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:19.817577 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-a4a56114-745c-49c1-a056-93d2f6179659 None None] MFA Rules not processed for user `f5156a2890444245829c0d2e8f7979dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:19.818758 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a4a56114-745c-49c1-a056-93d2f6179659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:19.881914 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1445/2892] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:25:19.886424 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de196eae-1d65-4e39-b169-553a382cc30a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:19.899547 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:19.949759 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de196eae-1d65-4e39-b169-553a382cc30a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:19.955013 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fce8b1-e90d-476d-a5a4-e4f611fed7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:19.955610 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fce8b1-e90d-476d-a5a4-e4f611fed7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:19.955891 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fce8b1-e90d-476d-a5a4-e4f611fed7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:19.956160 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fce8b1-e90d-476d-a5a4-e4f611fed7c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:19.956778 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fce8b1-e90d-476d-a5a4-e4f611fed7c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:19.958755 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fce8b1-e90d-476d-a5a4-e4f611fed7c8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:19.984913 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1448/2893] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:25:19 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:25:19.989241 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a56114-745c-49c1-a056-93d2f6179659 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:19.994647 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:20.001495 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a56114-745c-49c1-a056-93d2f6179659 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:20.059608 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fbcf7-26f4-4a7d-8600-8ef19273f419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:20.060203 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fbcf7-26f4-4a7d-8600-8ef19273f419 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:20.060477 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fbcf7-26f4-4a7d-8600-8ef19273f419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:20.060745 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fbcf7-26f4-4a7d-8600-8ef19273f419 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:20.061957 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fbcf7-26f4-4a7d-8600-8ef19273f419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:20.063889 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fbcf7-26f4-4a7d-8600-8ef19273f419 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:20.084891 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1446/2894] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:25:19 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 14:25:20.088964 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fce8b1-e90d-476d-a5a4-e4f611fed7c8 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:20.099269 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fce8b1-e90d-476d-a5a4-e4f611fed7c8 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:20.103946 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50115e1-461f-4591-95d5-9884ca7b113d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:20.104538 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50115e1-461f-4591-95d5-9884ca7b113d admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:20.104816 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50115e1-461f-4591-95d5-9884ca7b113d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:20.105088 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50115e1-461f-4591-95d5-9884ca7b113d admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:20.105750 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50115e1-461f-4591-95d5-9884ca7b113d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:20.107393 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50115e1-461f-4591-95d5-9884ca7b113d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:20.117895 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1449/2895] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:25:20.121783 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fbcf7-26f4-4a7d-8600-8ef19273f419 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:20.132237 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fbcf7-26f4-4a7d-8600-8ef19273f419 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:20.136775 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7c98d-b639-4834-a26a-90872fac6290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:20.137438 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7c98d-b639-4834-a26a-90872fac6290 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:20.137711 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7c98d-b639-4834-a26a-90872fac6290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:20.137975 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7c98d-b639-4834-a26a-90872fac6290 admin admin] PATH_INFO: `/v3/projects/ea57608f03624662a87ee040ec381ea9/users/474204d272414b93adbe598baac397ef/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:20.153000 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7c98d-b639-4834-a26a-90872fac6290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea57608f03624662a87ee040ec381ea9, user_id=474204d272414b93adbe598baac397ef, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:20.155891 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7c98d-b639-4834-a26a-90872fac6290 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:20.168516 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1447/2896] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:25:20 2022] PUT /identity/v3/projects/ea57608f03624662a87ee040ec381ea9/users/474204d272414b93adbe598baac397ef/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:25:20.172574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50115e1-461f-4591-95d5-9884ca7b113d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:20.182580 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50115e1-461f-4591-95d5-9884ca7b113d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:20.238288 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204b981-d4b0-4b72-be71-92a445e790ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:20.238879 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204b981-d4b0-4b72-be71-92a445e790ea admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:20.239160 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204b981-d4b0-4b72-be71-92a445e790ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:20.239434 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204b981-d4b0-4b72-be71-92a445e790ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:20.240063 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204b981-d4b0-4b72-be71-92a445e790ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:20.241702 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204b981-d4b0-4b72-be71-92a445e790ea admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:20.251771 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1450/2897] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:25:20.255992 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7c98d-b639-4834-a26a-90872fac6290 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:20.266585 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7c98d-b639-4834-a26a-90872fac6290 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:20.271151 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7063a-fe4f-4604-82c7-efb4268d719d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:20.271787 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7063a-fe4f-4604-82c7-efb4268d719d admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:20.272062 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7063a-fe4f-4604-82c7-efb4268d719d admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:20.272332 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7063a-fe4f-4604-82c7-efb4268d719d admin admin] PATH_INFO: `/v3/projects/ea57608f03624662a87ee040ec381ea9/users/474204d272414b93adbe598baac397ef/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:20.274242 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c7063a-fe4f-4604-82c7-efb4268d719d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea57608f03624662a87ee040ec381ea9, user_id=474204d272414b93adbe598baac397ef, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:20.276874 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c7063a-fe4f-4604-82c7-efb4268d719d admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:20.289861 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1448/2898] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:25:20 2022] PUT /identity/v3/projects/ea57608f03624662a87ee040ec381ea9/users/474204d272414b93adbe598baac397ef/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:25:20.303821 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dfb96-6371-42c8-a078-e1326c34c3b5 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:20.304105 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dfb96-6371-42c8-a078-e1326c34c3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:20.304105 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dfb96-6371-42c8-a078-e1326c34c3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:20.333639 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-087dfb96-6371-42c8-a078-e1326c34c3b5 None None] MFA Rules not processed for user `474204d272414b93adbe598baac397ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:20.334845 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-087dfb96-6371-42c8-a078-e1326c34c3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:20.401104 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1451/2899] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:25:20.412851 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7063a-fe4f-4604-82c7-efb4268d719d admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:20.414549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a1c7063a-fe4f-4604-82c7-efb4268d719d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:20.471877 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7063a-fe4f-4604-82c7-efb4268d719d admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:20.475473 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72943c0-364c-4b3b-acbf-86eefe2b6ad5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:20.476059 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72943c0-364c-4b3b-acbf-86eefe2b6ad5 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:20.476331 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72943c0-364c-4b3b-acbf-86eefe2b6ad5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:20.476600 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72943c0-364c-4b3b-acbf-86eefe2b6ad5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:20.532261 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72943c0-364c-4b3b-acbf-86eefe2b6ad5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:20.533720 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72943c0-364c-4b3b-acbf-86eefe2b6ad5 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:20.542546 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1449/2900] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:25:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:25:22.038217 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087dfb96-6371-42c8-a078-e1326c34c3b5 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:22.039585 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-087dfb96-6371-42c8-a078-e1326c34c3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:22.052388 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087dfb96-6371-42c8-a078-e1326c34c3b5 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:22.055967 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a3d0f-65ca-43d9-b3b1-59f922d235f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:22.056559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a3d0f-65ca-43d9-b3b1-59f922d235f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:22.056834 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a3d0f-65ca-43d9-b3b1-59f922d235f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:22.057118 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a3d0f-65ca-43d9-b3b1-59f922d235f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:22.061146 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:22.114608 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a3d0f-65ca-43d9-b3b1-59f922d235f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:22.116049 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a3d0f-65ca-43d9-b3b1-59f922d235f5 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:22.125878 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1452/2901] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:25:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:25:22.636763 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72943c0-364c-4b3b-acbf-86eefe2b6ad5 service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:22.646134 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72943c0-364c-4b3b-acbf-86eefe2b6ad5 service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:22.649693 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043507b-4070-4557-be3f-0e314b21e7b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:22.650285 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043507b-4070-4557-be3f-0e314b21e7b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:22.650563 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043507b-4070-4557-be3f-0e314b21e7b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:22.650835 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043507b-4070-4557-be3f-0e314b21e7b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:22.658501 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:22.660943 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043507b-4070-4557-be3f-0e314b21e7b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:22.663207 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043507b-4070-4557-be3f-0e314b21e7b4 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:22.673188 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1450/2902] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:25:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:25:26.532612 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a3d0f-65ca-43d9-b3b1-59f922d235f5 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:26.594248 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a3d0f-65ca-43d9-b3b1-59f922d235f5 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:26.599410 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a209345-b4b8-485f-955c-d039e159ae81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:26.600027 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a209345-b4b8-485f-955c-d039e159ae81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:26.600303 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a209345-b4b8-485f-955c-d039e159ae81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:26.600572 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a209345-b4b8-485f-955c-d039e159ae81 admin admin] PATH_INFO: `/v3/users/8c7b2e1a496047c8abfdd8a9de91f6d6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:26.601693 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a209345-b4b8-485f-955c-d039e159ae81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c7b2e1a496047c8abfdd8a9de91f6d6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:26.603606 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a209345-b4b8-485f-955c-d039e159ae81 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:26.648743 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2a209345-b4b8-485f-955c-d039e159ae81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c7b2e1a496047c8abfdd8a9de91f6d6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:26.656071 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2a209345-b4b8-485f-955c-d039e159ae81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c7b2e1a496047c8abfdd8a9de91f6d6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:26.668242 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2a209345-b4b8-485f-955c-d039e159ae81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c7b2e1a496047c8abfdd8a9de91f6d6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:26.668887 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2a209345-b4b8-485f-955c-d039e159ae81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c7b2e1a496047c8abfdd8a9de91f6d6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:26.676450 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-2a209345-b4b8-485f-955c-d039e159ae81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c7b2e1a496047c8abfdd8a9de91f6d6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:26.682280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1453/2903] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:25:26 2022] DELETE /identity/v3/users/8c7b2e1a496047c8abfdd8a9de91f6d6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:25:26.686732 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310420f-5542-43b6-9e39-0d3113567094 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:26.687190 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310420f-5542-43b6-9e39-0d3113567094 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:26.687311 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310420f-5542-43b6-9e39-0d3113567094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:26.706110 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-c310420f-5542-43b6-9e39-0d3113567094 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:26.707296 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c310420f-5542-43b6-9e39-0d3113567094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:26.764337 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1451/2904] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:25:26.773909 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a209345-b4b8-485f-955c-d039e159ae81 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:26.775304 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2a209345-b4b8-485f-955c-d039e159ae81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:26.804491 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:26.838981 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a209345-b4b8-485f-955c-d039e159ae81 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:26.842699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b4378-65a3-4d72-a0df-8dce1f21291c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:26.843303 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b4378-65a3-4d72-a0df-8dce1f21291c service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:26.843582 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b4378-65a3-4d72-a0df-8dce1f21291c service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:26.843854 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b4378-65a3-4d72-a0df-8dce1f21291c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:26.853494 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b4378-65a3-4d72-a0df-8dce1f21291c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:26.854924 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b4378-65a3-4d72-a0df-8dce1f21291c service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:26.865359 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1454/2905] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:25:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:25:27.132647 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310420f-5542-43b6-9e39-0d3113567094 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:27.134099 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c310420f-5542-43b6-9e39-0d3113567094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:27.146342 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310420f-5542-43b6-9e39-0d3113567094 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:27.150992 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb46128-fb39-4e9b-bd53-1e391b27cb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:27.151614 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb46128-fb39-4e9b-bd53-1e391b27cb67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:27.151887 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb46128-fb39-4e9b-bd53-1e391b27cb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:27.152159 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb46128-fb39-4e9b-bd53-1e391b27cb67 admin admin] PATH_INFO: `/v3/projects/4b9910775174408193fc74dc21d3681b` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:27.153304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb46128-fb39-4e9b-bd53-1e391b27cb67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b9910775174408193fc74dc21d3681b)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:27.155486 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb46128-fb39-4e9b-bd53-1e391b27cb67 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:27.201444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3bb46128-fb39-4e9b-bd53-1e391b27cb67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b9910775174408193fc74dc21d3681b', 'request_id': 'req-3bb46128-fb39-4e9b-bd53-1e391b27cb67'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:27.209321 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3bb46128-fb39-4e9b-bd53-1e391b27cb67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b9910775174408193fc74dc21d3681b', 'request_id': 'req-3bb46128-fb39-4e9b-bd53-1e391b27cb67'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:27.215244 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3bb46128-fb39-4e9b-bd53-1e391b27cb67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b9910775174408193fc74dc21d3681b', 'request_id': 'req-3bb46128-fb39-4e9b-bd53-1e391b27cb67'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:27.227162 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3bb46128-fb39-4e9b-bd53-1e391b27cb67 admin admin] The token cache is being invalidate because project 4b9910775174408193fc74dc21d3681b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:25:27.227444 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3bb46128-fb39-4e9b-bd53-1e391b27cb67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:27.228084 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3bb46128-fb39-4e9b-bd53-1e391b27cb67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:27.229656 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1452/2906] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:25:27 2022] DELETE /identity/v3/projects/4b9910775174408193fc74dc21d3681b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:25:27.233723 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b4378-65a3-4d72-a0df-8dce1f21291c service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:27.243359 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b4378-65a3-4d72-a0df-8dce1f21291c service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:27.299203 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3261d-6b3c-420b-8605-0b7948db5ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:27.299748 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3261d-6b3c-420b-8605-0b7948db5ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:27.300024 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3261d-6b3c-420b-8605-0b7948db5ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:27.300294 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3261d-6b3c-420b-8605-0b7948db5ad1 admin admin] PATH_INFO: `/v3/users/f5156a2890444245829c0d2e8f7979dc` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:27.301437 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3261d-6b3c-420b-8605-0b7948db5ad1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5156a2890444245829c0d2e8f7979dc)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:27.303353 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3261d-6b3c-420b-8605-0b7948db5ad1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:27.348734 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7fb3261d-6b3c-420b-8605-0b7948db5ad1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5156a2890444245829c0d2e8f7979dc'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:27.355666 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7fb3261d-6b3c-420b-8605-0b7948db5ad1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5156a2890444245829c0d2e8f7979dc'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:27.367482 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7fb3261d-6b3c-420b-8605-0b7948db5ad1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5156a2890444245829c0d2e8f7979dc'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:27.368135 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7fb3261d-6b3c-420b-8605-0b7948db5ad1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5156a2890444245829c0d2e8f7979dc'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:27.374969 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7fb3261d-6b3c-420b-8605-0b7948db5ad1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5156a2890444245829c0d2e8f7979dc'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:27.381297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1455/2907] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:25:27 2022] DELETE /identity/v3/users/f5156a2890444245829c0d2e8f7979dc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:25:27.658992 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb46128-fb39-4e9b-bd53-1e391b27cb67 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:27.660436 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-3bb46128-fb39-4e9b-bd53-1e391b27cb67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:27.679586 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb46128-fb39-4e9b-bd53-1e391b27cb67 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:27.736673 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad3f4d-730a-4cf8-8d84-a62e021f55c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:27.737384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad3f4d-730a-4cf8-8d84-a62e021f55c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:27.737583 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad3f4d-730a-4cf8-8d84-a62e021f55c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:27.737846 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad3f4d-730a-4cf8-8d84-a62e021f55c6 admin admin] PATH_INFO: `/v3/projects/3d928e6a4a2c4a58be631570de89028c` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:27.738948 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad3f4d-730a-4cf8-8d84-a62e021f55c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d928e6a4a2c4a58be631570de89028c)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:27.740840 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad3f4d-730a-4cf8-8d84-a62e021f55c6 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:27.763366 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:27.787127 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-43ad3f4d-730a-4cf8-8d84-a62e021f55c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d928e6a4a2c4a58be631570de89028c', 'request_id': 'req-43ad3f4d-730a-4cf8-8d84-a62e021f55c6'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:27.794313 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-43ad3f4d-730a-4cf8-8d84-a62e021f55c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d928e6a4a2c4a58be631570de89028c', 'request_id': 'req-43ad3f4d-730a-4cf8-8d84-a62e021f55c6'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:27.800287 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-43ad3f4d-730a-4cf8-8d84-a62e021f55c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d928e6a4a2c4a58be631570de89028c', 'request_id': 'req-43ad3f4d-730a-4cf8-8d84-a62e021f55c6'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:27.811220 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-43ad3f4d-730a-4cf8-8d84-a62e021f55c6 admin admin] The token cache is being invalidate because project 3d928e6a4a2c4a58be631570de89028c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:25:27.811504 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-43ad3f4d-730a-4cf8-8d84-a62e021f55c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:27.812128 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-43ad3f4d-730a-4cf8-8d84-a62e021f55c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:27.813627 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1453/2908] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:25:27 2022] DELETE /identity/v3/projects/3d928e6a4a2c4a58be631570de89028c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:25:27.818159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3261d-6b3c-420b-8605-0b7948db5ad1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:27.819550 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7fb3261d-6b3c-420b-8605-0b7948db5ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:27.832119 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3261d-6b3c-420b-8605-0b7948db5ad1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:27.877765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:27.892360 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74598d26-c529-420a-97e9-7ea478b2f3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:27.892989 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74598d26-c529-420a-97e9-7ea478b2f3f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:27.893302 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74598d26-c529-420a-97e9-7ea478b2f3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:27.893574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74598d26-c529-420a-97e9-7ea478b2f3f1 admin admin] PATH_INFO: `/v3/users/474204d272414b93adbe598baac397ef` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:27.894680 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74598d26-c529-420a-97e9-7ea478b2f3f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=474204d272414b93adbe598baac397ef)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:27.896720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74598d26-c529-420a-97e9-7ea478b2f3f1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:27.942975 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-74598d26-c529-420a-97e9-7ea478b2f3f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '474204d272414b93adbe598baac397ef'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:27.949604 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-74598d26-c529-420a-97e9-7ea478b2f3f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '474204d272414b93adbe598baac397ef'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:27.961580 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-74598d26-c529-420a-97e9-7ea478b2f3f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '474204d272414b93adbe598baac397ef'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:27.962213 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-74598d26-c529-420a-97e9-7ea478b2f3f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '474204d272414b93adbe598baac397ef'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:27.969079 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-74598d26-c529-420a-97e9-7ea478b2f3f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '474204d272414b93adbe598baac397ef'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:27.975068 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1456/2909] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:25:27 2022] DELETE /identity/v3/users/474204d272414b93adbe598baac397ef => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:25:28.246649 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad3f4d-730a-4cf8-8d84-a62e021f55c6 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:28.248294 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-43ad3f4d-730a-4cf8-8d84-a62e021f55c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:28.261364 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad3f4d-730a-4cf8-8d84-a62e021f55c6 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:28.319482 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36c421-561d-4668-9262-8abf960ed2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:28.320105 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36c421-561d-4668-9262-8abf960ed2c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:28.320382 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36c421-561d-4668-9262-8abf960ed2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:28.320652 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36c421-561d-4668-9262-8abf960ed2c7 admin admin] PATH_INFO: `/v3/projects/ea57608f03624662a87ee040ec381ea9` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:28.321790 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36c421-561d-4668-9262-8abf960ed2c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea57608f03624662a87ee040ec381ea9)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:28.323672 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36c421-561d-4668-9262-8abf960ed2c7 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:28.369639 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-df36c421-561d-4668-9262-8abf960ed2c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea57608f03624662a87ee040ec381ea9', 'request_id': 'req-df36c421-561d-4668-9262-8abf960ed2c7'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:28.376951 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-df36c421-561d-4668-9262-8abf960ed2c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea57608f03624662a87ee040ec381ea9', 'request_id': 'req-df36c421-561d-4668-9262-8abf960ed2c7'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:28.385367 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-df36c421-561d-4668-9262-8abf960ed2c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea57608f03624662a87ee040ec381ea9', 'request_id': 'req-df36c421-561d-4668-9262-8abf960ed2c7'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:28.396959 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-df36c421-561d-4668-9262-8abf960ed2c7 admin admin] The token cache is being invalidate because project ea57608f03624662a87ee040ec381ea9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:25:28.397398 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-df36c421-561d-4668-9262-8abf960ed2c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:28.398058 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-df36c421-561d-4668-9262-8abf960ed2c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:28.399549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1454/2910] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:25:28 2022] DELETE /identity/v3/projects/ea57608f03624662a87ee040ec381ea9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:25:28.406075 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7ab5c-96fc-43a9-b9c6-8098077aa75b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:28.406366 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7ab5c-96fc-43a9-b9c6-8098077aa75b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:28.406637 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7ab5c-96fc-43a9-b9c6-8098077aa75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:28.429863 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-caa7ab5c-96fc-43a9-b9c6-8098077aa75b None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:28.431567 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-caa7ab5c-96fc-43a9-b9c6-8098077aa75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:28.490085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1457/2911] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:25:28.498320 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd18ee-740d-4338-ab01-771a053df2da None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:28.498828 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd18ee-740d-4338-ab01-771a053df2da None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:28.499358 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd18ee-740d-4338-ab01-771a053df2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:28.520880 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-b2fd18ee-740d-4338-ab01-771a053df2da None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:28.522122 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b2fd18ee-740d-4338-ab01-771a053df2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:28.530211 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1455/2912] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:25:28.535028 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7ab5c-96fc-43a9-b9c6-8098077aa75b None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:28.544742 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7ab5c-96fc-43a9-b9c6-8098077aa75b None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:28.549422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935faa9-e4f6-459b-8ce9-f1bb4dbb894d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:28.550010 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935faa9-e4f6-459b-8ce9-f1bb4dbb894d admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:28.550288 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935faa9-e4f6-459b-8ce9-f1bb4dbb894d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:28.550559 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935faa9-e4f6-459b-8ce9-f1bb4dbb894d admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:28.551210 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935faa9-e4f6-459b-8ce9-f1bb4dbb894d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:25:28.551513 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935faa9-e4f6-459b-8ce9-f1bb4dbb894d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:28.553124 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935faa9-e4f6-459b-8ce9-f1bb4dbb894d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:28.564675 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1458/2913] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:25:28.568756 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd18ee-740d-4338-ab01-771a053df2da None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:28.577881 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd18ee-740d-4338-ab01-771a053df2da None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:28.583040 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab25d8f-63c0-4e97-b661-946574bf7255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:28.583619 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab25d8f-63c0-4e97-b661-946574bf7255 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:28.583894 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab25d8f-63c0-4e97-b661-946574bf7255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:28.584162 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab25d8f-63c0-4e97-b661-946574bf7255 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:28.584776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab25d8f-63c0-4e97-b661-946574bf7255 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:28.586714 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab25d8f-63c0-4e97-b661-946574bf7255 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:28.613076 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1456/2914] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:25:28 2022] POST /identity/v3/projects => generated 399 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:25:28.617271 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935faa9-e4f6-459b-8ce9-f1bb4dbb894d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:28.627452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935faa9-e4f6-459b-8ce9-f1bb4dbb894d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:28.676038 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:28.686444 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb68a8-575a-4811-b3a5-3594d6139433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:28.687186 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb68a8-575a-4811-b3a5-3594d6139433 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:28.687467 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb68a8-575a-4811-b3a5-3594d6139433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:28.687740 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb68a8-575a-4811-b3a5-3594d6139433 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:28.688376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb68a8-575a-4811-b3a5-3594d6139433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:28.690374 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb68a8-575a-4811-b3a5-3594d6139433 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:28.711733 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1459/2915] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:25:28 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:25:28.716000 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab25d8f-63c0-4e97-b661-946574bf7255 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:28.726969 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab25d8f-63c0-4e97-b661-946574bf7255 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:28.731607 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9fd10-fa36-4c57-962b-05033aa50669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:28.732194 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9fd10-fa36-4c57-962b-05033aa50669 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:28.732474 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9fd10-fa36-4c57-962b-05033aa50669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:28.732746 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9fd10-fa36-4c57-962b-05033aa50669 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:28.733419 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9fd10-fa36-4c57-962b-05033aa50669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:28.735018 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9fd10-fa36-4c57-962b-05033aa50669 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:28.740610 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:28.746219 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1457/2916] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:25:28.750156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb68a8-575a-4811-b3a5-3594d6139433 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:28.760352 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb68a8-575a-4811-b3a5-3594d6139433 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:28.764982 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a89a5a-ae1e-4a0d-b2b6-89e9168b8bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:28.765607 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a89a5a-ae1e-4a0d-b2b6-89e9168b8bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:28.765887 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a89a5a-ae1e-4a0d-b2b6-89e9168b8bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:28.766159 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a89a5a-ae1e-4a0d-b2b6-89e9168b8bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:28.766823 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a89a5a-ae1e-4a0d-b2b6-89e9168b8bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:28.768970 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a89a5a-ae1e-4a0d-b2b6-89e9168b8bc8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:28.779591 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1460/2917] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:25:28.784519 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9fd10-fa36-4c57-962b-05033aa50669 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:28.794456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9fd10-fa36-4c57-962b-05033aa50669 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:28.799505 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730ad5b-246c-45aa-8601-73d0431a68c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:28.800150 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730ad5b-246c-45aa-8601-73d0431a68c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:28.800427 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730ad5b-246c-45aa-8601-73d0431a68c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:28.800695 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730ad5b-246c-45aa-8601-73d0431a68c6 admin admin] PATH_INFO: `/v3/projects/ac87f9c99e684b74baff5d3e44825bd8/users/532170ead8a5459eb363e34b6d8fdecc/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:28.815564 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730ad5b-246c-45aa-8601-73d0431a68c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac87f9c99e684b74baff5d3e44825bd8, user_id=532170ead8a5459eb363e34b6d8fdecc, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:28.818247 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730ad5b-246c-45aa-8601-73d0431a68c6 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:28.831141 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1458/2918] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:25:28 2022] PUT /identity/v3/projects/ac87f9c99e684b74baff5d3e44825bd8/users/532170ead8a5459eb363e34b6d8fdecc/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:25:28.841378 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c469f37-f8dd-495e-a676-b28be69664ee None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:28.841835 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c469f37-f8dd-495e-a676-b28be69664ee None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:28.841935 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c469f37-f8dd-495e-a676-b28be69664ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:28.870877 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-3c469f37-f8dd-495e-a676-b28be69664ee None None] MFA Rules not processed for user `532170ead8a5459eb363e34b6d8fdecc`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:28.872080 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3c469f37-f8dd-495e-a676-b28be69664ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:28.934396 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1461/2919] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:28 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:25:28.945990 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730ad5b-246c-45aa-8601-73d0431a68c6 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:28.947646 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1730ad5b-246c-45aa-8601-73d0431a68c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:29.004401 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730ad5b-246c-45aa-8601-73d0431a68c6 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:29.008066 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99266c-239d-4e80-b85b-9e1297f14310 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052d3a21bd3c48c89dcc38ec1444d39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:29.008655 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99266c-239d-4e80-b85b-9e1297f14310 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:29.008932 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99266c-239d-4e80-b85b-9e1297f14310 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:29.009230 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99266c-239d-4e80-b85b-9e1297f14310 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:29.017592 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99266c-239d-4e80-b85b-9e1297f14310 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:29.019005 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99266c-239d-4e80-b85b-9e1297f14310 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:29.027737 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1459/2920] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:25:28 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:25:32.184156 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c469f37-f8dd-495e-a676-b28be69664ee None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:32.185583 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3c469f37-f8dd-495e-a676-b28be69664ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:32.258452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c469f37-f8dd-495e-a676-b28be69664ee None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:32.264025 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ff29d-c9b1-4e0a-b2dc-2443cae8ac75 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311397bfe2c04569852fca0cfcdbad66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:32.264625 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ff29d-c9b1-4e0a-b2dc-2443cae8ac75 service placement] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:32.264901 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ff29d-c9b1-4e0a-b2dc-2443cae8ac75 service placement] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:32.265207 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ff29d-c9b1-4e0a-b2dc-2443cae8ac75 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:32.267833 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d10ff29d-c9b1-4e0a-b2dc-2443cae8ac75 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:32.280844 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ff29d-c9b1-4e0a-b2dc-2443cae8ac75 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:32.282769 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ff29d-c9b1-4e0a-b2dc-2443cae8ac75 service placement] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:32.294951 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1462/2921] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:25:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:25:34.005060 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99266c-239d-4e80-b85b-9e1297f14310 service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:34.078584 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99266c-239d-4e80-b85b-9e1297f14310 service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:34.083387 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45e4ea-76f4-4f24-87d6-06d0f9a588bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:34.084005 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45e4ea-76f4-4f24-87d6-06d0f9a588bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:34.084277 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45e4ea-76f4-4f24-87d6-06d0f9a588bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:34.084545 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45e4ea-76f4-4f24-87d6-06d0f9a588bd admin admin] PATH_INFO: `/v3/users/532170ead8a5459eb363e34b6d8fdecc` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:34.085689 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45e4ea-76f4-4f24-87d6-06d0f9a588bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=532170ead8a5459eb363e34b6d8fdecc)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:34.087590 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45e4ea-76f4-4f24-87d6-06d0f9a588bd admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:34.132267 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6b45e4ea-76f4-4f24-87d6-06d0f9a588bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '532170ead8a5459eb363e34b6d8fdecc'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:34.140191 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6b45e4ea-76f4-4f24-87d6-06d0f9a588bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '532170ead8a5459eb363e34b6d8fdecc'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:34.152122 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6b45e4ea-76f4-4f24-87d6-06d0f9a588bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '532170ead8a5459eb363e34b6d8fdecc'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:34.152746 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6b45e4ea-76f4-4f24-87d6-06d0f9a588bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '532170ead8a5459eb363e34b6d8fdecc'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:34.160359 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6b45e4ea-76f4-4f24-87d6-06d0f9a588bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '532170ead8a5459eb363e34b6d8fdecc'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:34.161779 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:34.167754 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1460/2922] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:25:34 2022] DELETE /identity/v3/users/532170ead8a5459eb363e34b6d8fdecc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:25:34.172318 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe6cbc-009f-4441-bf1f-6eb6927fdbdd None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:34.172781 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe6cbc-009f-4441-bf1f-6eb6927fdbdd None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:34.172886 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe6cbc-009f-4441-bf1f-6eb6927fdbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:34.192130 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-aefe6cbc-009f-4441-bf1f-6eb6927fdbdd None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:34.193357 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-aefe6cbc-009f-4441-bf1f-6eb6927fdbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:34.239565 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:34.254871 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1463/2923] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:25:34.264834 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45e4ea-76f4-4f24-87d6-06d0f9a588bd admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:34.266262 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-6b45e4ea-76f4-4f24-87d6-06d0f9a588bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:34.326069 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45e4ea-76f4-4f24-87d6-06d0f9a588bd admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:34.330012 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ede0c-78d9-44aa-b15d-48ee7983bc41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:34.330674 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ede0c-78d9-44aa-b15d-48ee7983bc41 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:34.330948 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ede0c-78d9-44aa-b15d-48ee7983bc41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:34.331214 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ede0c-78d9-44aa-b15d-48ee7983bc41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:34.340800 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ede0c-78d9-44aa-b15d-48ee7983bc41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:34.342281 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ede0c-78d9-44aa-b15d-48ee7983bc41 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:34.352209 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1461/2924] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:25:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:25:34.620319 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe6cbc-009f-4441-bf1f-6eb6927fdbdd None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:34.621828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-aefe6cbc-009f-4441-bf1f-6eb6927fdbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:34.634429 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe6cbc-009f-4441-bf1f-6eb6927fdbdd None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:34.639245 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487953f4-f42e-4882-b86f-d6380f0ba6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:34.639954 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487953f4-f42e-4882-b86f-d6380f0ba6ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:34.640284 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487953f4-f42e-4882-b86f-d6380f0ba6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:34.640582 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487953f4-f42e-4882-b86f-d6380f0ba6ff admin admin] PATH_INFO: `/v3/projects/ac87f9c99e684b74baff5d3e44825bd8` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:34.641749 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487953f4-f42e-4882-b86f-d6380f0ba6ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac87f9c99e684b74baff5d3e44825bd8)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:34.645049 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487953f4-f42e-4882-b86f-d6380f0ba6ff admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:34.691589 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-487953f4-f42e-4882-b86f-d6380f0ba6ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac87f9c99e684b74baff5d3e44825bd8', 'request_id': 'req-487953f4-f42e-4882-b86f-d6380f0ba6ff'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:34.697722 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-487953f4-f42e-4882-b86f-d6380f0ba6ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac87f9c99e684b74baff5d3e44825bd8', 'request_id': 'req-487953f4-f42e-4882-b86f-d6380f0ba6ff'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:34.705457 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-487953f4-f42e-4882-b86f-d6380f0ba6ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac87f9c99e684b74baff5d3e44825bd8', 'request_id': 'req-487953f4-f42e-4882-b86f-d6380f0ba6ff'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:34.715804 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-487953f4-f42e-4882-b86f-d6380f0ba6ff admin admin] The token cache is being invalidate because project ac87f9c99e684b74baff5d3e44825bd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:25:34.716110 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-487953f4-f42e-4882-b86f-d6380f0ba6ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:34.716730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-487953f4-f42e-4882-b86f-d6380f0ba6ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:25:34.718225 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1464/2925] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:25:34 2022] DELETE /identity/v3/projects/ac87f9c99e684b74baff5d3e44825bd8 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:25:34.723650 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f222b5d-2434-458b-b91a-2a5f80a03799 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:34.723968 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f222b5d-2434-458b-b91a-2a5f80a03799 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:34.724239 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f222b5d-2434-458b-b91a-2a5f80a03799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:34.743335 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-2f222b5d-2434-458b-b91a-2a5f80a03799 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:34.744509 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2f222b5d-2434-458b-b91a-2a5f80a03799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:34.801346 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1462/2926] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:25:34.809295 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ae1b4-501c-48c7-8752-53aa96c5e5a8 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:34.809579 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ae1b4-501c-48c7-8752-53aa96c5e5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:34.809883 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ae1b4-501c-48c7-8752-53aa96c5e5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:34.831242 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-695ae1b4-501c-48c7-8752-53aa96c5e5a8 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:34.832436 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-695ae1b4-501c-48c7-8752-53aa96c5e5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:34.840246 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1465/2927] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:25:34.844369 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f222b5d-2434-458b-b91a-2a5f80a03799 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:34.854217 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f222b5d-2434-458b-b91a-2a5f80a03799 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:34.858871 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b84e38-240d-4c3d-8713-f5d456392be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:34.859452 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b84e38-240d-4c3d-8713-f5d456392be6 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:34.859725 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b84e38-240d-4c3d-8713-f5d456392be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:34.859990 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b84e38-240d-4c3d-8713-f5d456392be6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:34.860653 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b84e38-240d-4c3d-8713-f5d456392be6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 14:25:34.861020 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b84e38-240d-4c3d-8713-f5d456392be6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:34.862637 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b84e38-240d-4c3d-8713-f5d456392be6 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:34.873934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1463/2928] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Sep 13 14:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 14:25:34.878884 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ae1b4-501c-48c7-8752-53aa96c5e5a8 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:34.890640 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ae1b4-501c-48c7-8752-53aa96c5e5a8 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:34.895920 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817980c-d5b1-4e10-9483-c2274ddc4789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:34.896507 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817980c-d5b1-4e10-9483-c2274ddc4789 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:34.896786 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817980c-d5b1-4e10-9483-c2274ddc4789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:34.897059 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817980c-d5b1-4e10-9483-c2274ddc4789 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:34.897729 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6817980c-d5b1-4e10-9483-c2274ddc4789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:34.899632 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6817980c-d5b1-4e10-9483-c2274ddc4789 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:34.926048 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1466/2929] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:25:34 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:25:34.930265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b84e38-240d-4c3d-8713-f5d456392be6 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:34.941039 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b84e38-240d-4c3d-8713-f5d456392be6 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:34.996441 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d60f0c-954d-4753-94db-78c070018e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:34.997030 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d60f0c-954d-4753-94db-78c070018e30 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:34.997344 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d60f0c-954d-4753-94db-78c070018e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:34.997609 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d60f0c-954d-4753-94db-78c070018e30 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:34.998221 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d60f0c-954d-4753-94db-78c070018e30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:35.000146 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d60f0c-954d-4753-94db-78c070018e30 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:35.021735 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1464/2930] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:25:34 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:25:35.025769 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817980c-d5b1-4e10-9483-c2274ddc4789 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:35.036367 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817980c-d5b1-4e10-9483-c2274ddc4789 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:35.041062 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216b742-5e65-4d58-b754-3c2cd46a67fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:35.041690 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216b742-5e65-4d58-b754-3c2cd46a67fd admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:35.041971 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216b742-5e65-4d58-b754-3c2cd46a67fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:35.042247 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216b742-5e65-4d58-b754-3c2cd46a67fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:35.042887 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216b742-5e65-4d58-b754-3c2cd46a67fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:35.045019 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216b742-5e65-4d58-b754-3c2cd46a67fd admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:35.055017 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1467/2931] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:25:35.058649 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d60f0c-954d-4753-94db-78c070018e30 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:35.068844 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d60f0c-954d-4753-94db-78c070018e30 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:35.073440 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2433e-a761-44a8-aa33-1e4e76b9ec5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:35.074020 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2433e-a761-44a8-aa33-1e4e76b9ec5b admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:35.074295 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2433e-a761-44a8-aa33-1e4e76b9ec5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:35.074565 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2433e-a761-44a8-aa33-1e4e76b9ec5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:35.075198 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2433e-a761-44a8-aa33-1e4e76b9ec5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:35.076787 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2433e-a761-44a8-aa33-1e4e76b9ec5b admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:35.087763 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1465/2932] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:25:35.091659 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216b742-5e65-4d58-b754-3c2cd46a67fd admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:35.101502 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216b742-5e65-4d58-b754-3c2cd46a67fd admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:35.106083 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d119e1a-101b-44ea-89fb-80c993f9dd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:35.106713 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d119e1a-101b-44ea-89fb-80c993f9dd55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:35.106987 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d119e1a-101b-44ea-89fb-80c993f9dd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:35.107306 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d119e1a-101b-44ea-89fb-80c993f9dd55 admin admin] PATH_INFO: `/v3/projects/0bcf1d78e18a4abe97f13737af51a4a1/users/c52f5a2d80824692add1e030a0282756/roles/81a57b9863404b45acc1204670e387f2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:35.122001 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d119e1a-101b-44ea-89fb-80c993f9dd55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bcf1d78e18a4abe97f13737af51a4a1, user_id=c52f5a2d80824692add1e030a0282756, role_id=81a57b9863404b45acc1204670e387f2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:35.124669 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d119e1a-101b-44ea-89fb-80c993f9dd55 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:35.138211 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1468/2933] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:25:35 2022] PUT /identity/v3/projects/0bcf1d78e18a4abe97f13737af51a4a1/users/c52f5a2d80824692add1e030a0282756/roles/81a57b9863404b45acc1204670e387f2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:25:35.143652 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188783a-af8e-46ff-b4a1-a215f41881c2 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:35.143926 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188783a-af8e-46ff-b4a1-a215f41881c2 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:35.144199 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188783a-af8e-46ff-b4a1-a215f41881c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:35.157478 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:35.164406 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-9188783a-af8e-46ff-b4a1-a215f41881c2 None None] MFA Rules not processed for user `97bb92037c8b4cdabc69372647290362`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:35.165633 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-9188783a-af8e-46ff-b4a1-a215f41881c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:35.225929 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1466/2934] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:25:35.235404 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d119e1a-101b-44ea-89fb-80c993f9dd55 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:35.237270 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5d119e1a-101b-44ea-89fb-80c993f9dd55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:35.295085 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d119e1a-101b-44ea-89fb-80c993f9dd55 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:35.298840 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a71e4-571a-412d-910d-3c96abbd8509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:35.299439 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a71e4-571a-412d-910d-3c96abbd8509 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:35.299746 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a71e4-571a-412d-910d-3c96abbd8509 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:35.299995 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a71e4-571a-412d-910d-3c96abbd8509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:35.309036 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a71e4-571a-412d-910d-3c96abbd8509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:35.310437 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a71e4-571a-412d-910d-3c96abbd8509 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:35.319730 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1469/2935] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:25:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:25:39.013363 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba7bee-52b6-4b9c-b484-ce481a21e65b None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:39.013854 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba7bee-52b6-4b9c-b484-ce481a21e65b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:39.014051 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba7bee-52b6-4b9c-b484-ce481a21e65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:39.054608 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-4eba7bee-52b6-4b9c-b484-ce481a21e65b None None] MFA Rules not processed for user `c52f5a2d80824692add1e030a0282756`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:39.055992 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4eba7bee-52b6-4b9c-b484-ce481a21e65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:39.139819 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1467/2936] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:25:39.144549 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a71e4-571a-412d-910d-3c96abbd8509 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:39.155460 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a71e4-571a-412d-910d-3c96abbd8509 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:39.161959 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495cb75b-deb8-4eec-8524-88b112750a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:39.162574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495cb75b-deb8-4eec-8524-88b112750a51 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:39.162851 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495cb75b-deb8-4eec-8524-88b112750a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:39.163116 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495cb75b-deb8-4eec-8524-88b112750a51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:39.163755 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495cb75b-deb8-4eec-8524-88b112750a51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:39.165720 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495cb75b-deb8-4eec-8524-88b112750a51 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:39.177761 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:39.205269 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1470/2937] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Sep 13 14:25:39 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:25:39.206857 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba7bee-52b6-4b9c-b484-ce481a21e65b None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:39.219994 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba7bee-52b6-4b9c-b484-ce481a21e65b None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:39.283837 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c7d23-106e-40ba-bb67-1613426036cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:39.284520 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c7d23-106e-40ba-bb67-1613426036cd admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:39.284800 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c7d23-106e-40ba-bb67-1613426036cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:39.285065 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c7d23-106e-40ba-bb67-1613426036cd admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:39.285749 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c7d23-106e-40ba-bb67-1613426036cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:39.288122 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c7d23-106e-40ba-bb67-1613426036cd admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:39.317150 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1468/2938] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Sep 13 14:25:39 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 14:25:39.318594 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495cb75b-deb8-4eec-8524-88b112750a51 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:39.330280 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495cb75b-deb8-4eec-8524-88b112750a51 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:39.336900 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de5af7-a647-48fe-84e0-89edc123e1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:39.337618 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de5af7-a647-48fe-84e0-89edc123e1be admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:39.337967 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de5af7-a647-48fe-84e0-89edc123e1be admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:39.338309 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de5af7-a647-48fe-84e0-89edc123e1be admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:39.339027 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de5af7-a647-48fe-84e0-89edc123e1be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:39.340989 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de5af7-a647-48fe-84e0-89edc123e1be admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:39.355036 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1471/2939] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 14:25:39.359147 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c7d23-106e-40ba-bb67-1613426036cd admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:39.370602 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c7d23-106e-40ba-bb67-1613426036cd admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:39.379946 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2f5bd-53a8-4bd9-b404-58edc7e9e356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:39.380942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2f5bd-53a8-4bd9-b404-58edc7e9e356 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:39.380942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2f5bd-53a8-4bd9-b404-58edc7e9e356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:39.381181 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2f5bd-53a8-4bd9-b404-58edc7e9e356 admin admin] PATH_INFO: `/v3/projects/becd46bf23714399be34ceec782e5680/users/f359e3caf86a4f4db67270329be0ea97/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:39.408212 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2f5bd-53a8-4bd9-b404-58edc7e9e356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=becd46bf23714399be34ceec782e5680, user_id=f359e3caf86a4f4db67270329be0ea97, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:39.410973 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2f5bd-53a8-4bd9-b404-58edc7e9e356 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:39.429261 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1469/2940] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:25:39 2022] PUT /identity/v3/projects/becd46bf23714399be34ceec782e5680/users/f359e3caf86a4f4db67270329be0ea97/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:25:39.435607 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de5af7-a647-48fe-84e0-89edc123e1be admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:39.449882 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de5af7-a647-48fe-84e0-89edc123e1be admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:39.540477 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98879a39-4a53-408c-aa6e-b0271f8f9741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:39.541243 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98879a39-4a53-408c-aa6e-b0271f8f9741 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:39.541724 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98879a39-4a53-408c-aa6e-b0271f8f9741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:39.542111 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98879a39-4a53-408c-aa6e-b0271f8f9741 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:39.545144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98879a39-4a53-408c-aa6e-b0271f8f9741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:39.545144 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98879a39-4a53-408c-aa6e-b0271f8f9741 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:39.557802 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1472/2941] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Sep 13 14:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 14:25:39.561863 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2f5bd-53a8-4bd9-b404-58edc7e9e356 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:39.568040 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:39.577599 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2f5bd-53a8-4bd9-b404-58edc7e9e356 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:39.583680 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e347d6-983b-4fdf-8354-1d953edec94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:39.584347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e347d6-983b-4fdf-8354-1d953edec94a admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:39.584694 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e347d6-983b-4fdf-8354-1d953edec94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:39.585030 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e347d6-983b-4fdf-8354-1d953edec94a admin admin] PATH_INFO: `/v3/projects/becd46bf23714399be34ceec782e5680/users/f359e3caf86a4f4db67270329be0ea97/roles/6dcc8495d2b24b3eab63dd656eb4eb6d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:39.587088 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e347d6-983b-4fdf-8354-1d953edec94a admin admin] RBAC: Authorizing `identity:create_grant(project_id=becd46bf23714399be34ceec782e5680, user_id=f359e3caf86a4f4db67270329be0ea97, role_id=6dcc8495d2b24b3eab63dd656eb4eb6d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:39.589877 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e347d6-983b-4fdf-8354-1d953edec94a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:39.601265 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1470/2942] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Sep 13 14:25:39 2022] PUT /identity/v3/projects/becd46bf23714399be34ceec782e5680/users/f359e3caf86a4f4db67270329be0ea97/roles/6dcc8495d2b24b3eab63dd656eb4eb6d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 14:25:44.029452 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0aa45d-5cd1-41f9-891a-fa280ac92256 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:44.030232 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0aa45d-5cd1-41f9-891a-fa280ac92256 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:44.030232 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0aa45d-5cd1-41f9-891a-fa280ac92256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:44.062388 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-2c0aa45d-5cd1-41f9-891a-fa280ac92256 None None] MFA Rules not processed for user `f359e3caf86a4f4db67270329be0ea97`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:44.063636 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2c0aa45d-5cd1-41f9-891a-fa280ac92256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:44.149180 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1473/2943] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:25:44.166096 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e347d6-983b-4fdf-8354-1d953edec94a admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:25:44.168788 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-07e347d6-983b-4fdf-8354-1d953edec94a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:44.251632 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e347d6-983b-4fdf-8354-1d953edec94a admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:25:44.257300 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852a7bb-aa22-47d8-a4f8-ebb37c422db9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:25:44.257912 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852a7bb-aa22-47d8-a4f8-ebb37c422db9 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:44.258187 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852a7bb-aa22-47d8-a4f8-ebb37c422db9 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:44.258453 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852a7bb-aa22-47d8-a4f8-ebb37c422db9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:44.333313 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852a7bb-aa22-47d8-a4f8-ebb37c422db9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:25:44.336243 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852a7bb-aa22-47d8-a4f8-ebb37c422db9 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:25:44.348852 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1471/2944] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:25:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:25:46.327331 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a326e-4166-4d16-8e65-ff3097d84143 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:25:46.327866 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a326e-4166-4d16-8e65-ff3097d84143 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:25:46.327866 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a326e-4166-4d16-8e65-ff3097d84143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:25:46.350142 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-221a326e-4166-4d16-8e65-ff3097d84143 None None] MFA Rules not processed for user `c52f5a2d80824692add1e030a0282756`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:25:46.351498 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-221a326e-4166-4d16-8e65-ff3097d84143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:25:46.358864 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1474/2945] 10.222.0.26 () {58 vars in 958 bytes} [Tue Sep 13 14:25:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:25:54.343431 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=60,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:56.343224 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=74,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:26:03.986354 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852a7bb-aa22-47d8-a4f8-ebb37c422db9 service nova] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:26:03.988506 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b852a7bb-aa22-47d8-a4f8-ebb37c422db9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:26:04.044086 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852a7bb-aa22-47d8-a4f8-ebb37c422db9 service nova] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:26:04.047648 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ea6c3-11c3-41ec-82dc-c0b8f2b5bb88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:26:04.048234 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ea6c3-11c3-41ec-82dc-c0b8f2b5bb88 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:26:04.048531 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ea6c3-11c3-41ec-82dc-c0b8f2b5bb88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:26:04.048797 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ea6c3-11c3-41ec-82dc-c0b8f2b5bb88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:26:04.051272 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-961ea6c3-11c3-41ec-82dc-c0b8f2b5bb88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:26:04.062267 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ea6c3-11c3-41ec-82dc-c0b8f2b5bb88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:26:04.063725 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ea6c3-11c3-41ec-82dc-c0b8f2b5bb88 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:26:04.072552 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1472/2946] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:26:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:26:14.068866 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=26 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:26:16.427032 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a326e-4166-4d16-8e65-ff3097d84143 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:26:16.437294 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a326e-4166-4d16-8e65-ff3097d84143 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:26:16.440816 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b05624-54be-41d9-9213-72502cdbff73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:26:16.441461 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b05624-54be-41d9-9213-72502cdbff73 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:26:16.441737 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b05624-54be-41d9-9213-72502cdbff73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:26:16.442528 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b05624-54be-41d9-9213-72502cdbff73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:26:16.451336 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b05624-54be-41d9-9213-72502cdbff73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:26:16.452756 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b05624-54be-41d9-9213-72502cdbff73 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:26:16.462605 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1475/2947] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:26:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:26:26.458150 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=6 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:28:33.893532 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ea6c3-11c3-41ec-82dc-c0b8f2b5bb88 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:28:33.902403 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ea6c3-11c3-41ec-82dc-c0b8f2b5bb88 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:28:33.906981 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ac666-926e-4aa3-8374-beef238ff331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:28:33.907565 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ac666-926e-4aa3-8374-beef238ff331 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:28:33.907835 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ac666-926e-4aa3-8374-beef238ff331 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:28:33.908098 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ac666-926e-4aa3-8374-beef238ff331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:28:33.909792 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-961ac666-926e-4aa3-8374-beef238ff331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:28:33.919181 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ac666-926e-4aa3-8374-beef238ff331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:28:33.920574 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ac666-926e-4aa3-8374-beef238ff331 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:28:33.928476 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1473/2948] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:28:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:28:40.718047 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b05624-54be-41d9-9213-72502cdbff73 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:28:40.726828 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b05624-54be-41d9-9213-72502cdbff73 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:28:40.730437 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5c93e-58e9-4aa8-9794-63c8113fee16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:28:40.731015 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5c93e-58e9-4aa8-9794-63c8113fee16 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:28:40.731288 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5c93e-58e9-4aa8-9794-63c8113fee16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:28:40.731553 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5c93e-58e9-4aa8-9794-63c8113fee16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:28:40.733246 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a8b5c93e-58e9-4aa8-9794-63c8113fee16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:28:40.746292 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5c93e-58e9-4aa8-9794-63c8113fee16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:28:40.747693 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5c93e-58e9-4aa8-9794-63c8113fee16 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:28:40.758422 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1476/2949] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:28:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:28:41.946697 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ac666-926e-4aa3-8374-beef238ff331 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:28:41.955247 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ac666-926e-4aa3-8374-beef238ff331 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:28:41.958823 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5265ea-7fa7-4ad3-8749-df9d8cc7aec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:28:41.959400 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5265ea-7fa7-4ad3-8749-df9d8cc7aec4 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:28:41.959670 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5265ea-7fa7-4ad3-8749-df9d8cc7aec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:28:41.959934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5265ea-7fa7-4ad3-8749-df9d8cc7aec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:28:41.961650 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0b5265ea-7fa7-4ad3-8749-df9d8cc7aec4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:28:41.974942 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5265ea-7fa7-4ad3-8749-df9d8cc7aec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:28:41.976341 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5265ea-7fa7-4ad3-8749-df9d8cc7aec4 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:28:41.987627 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1474/2950] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:28:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:28:50.753536 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=6 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:28:51.982812 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=12 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:28:53.965527 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5c93e-58e9-4aa8-9794-63c8113fee16 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:28:53.975270 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5c93e-58e9-4aa8-9794-63c8113fee16 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:28:53.979000 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d3edd-0531-4277-bcfc-9d02ce8d4ca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:28:53.979594 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d3edd-0531-4277-bcfc-9d02ce8d4ca7 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:28:53.979876 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d3edd-0531-4277-bcfc-9d02ce8d4ca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:28:53.980147 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d3edd-0531-4277-bcfc-9d02ce8d4ca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:28:53.982420 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fa4d3edd-0531-4277-bcfc-9d02ce8d4ca7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:28:53.992546 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d3edd-0531-4277-bcfc-9d02ce8d4ca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:28:53.994081 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d3edd-0531-4277-bcfc-9d02ce8d4ca7 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:28:54.003650 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1477/2951] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:28:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:28:54.113361 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5265ea-7fa7-4ad3-8749-df9d8cc7aec4 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:28:54.122877 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5265ea-7fa7-4ad3-8749-df9d8cc7aec4 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:28:54.126834 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d333a-36aa-4521-bd3f-3b22635cb434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:28:54.127434 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d333a-36aa-4521-bd3f-3b22635cb434 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:28:54.127708 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d333a-36aa-4521-bd3f-3b22635cb434 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:28:54.127977 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d333a-36aa-4521-bd3f-3b22635cb434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:28:54.129714 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-278d333a-36aa-4521-bd3f-3b22635cb434 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:28:54.143117 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d333a-36aa-4521-bd3f-3b22635cb434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:28:54.144531 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d333a-36aa-4521-bd3f-3b22635cb434 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:28:54.155564 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1475/2952] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:28:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:28:54.214907 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc158f-ab20-4464-91f4-72be3efc7c48 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:28:54.215189 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc158f-ab20-4464-91f4-72be3efc7c48 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:28:54.215496 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc158f-ab20-4464-91f4-72be3efc7c48 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:28:54.216825 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1478/2953] 10.222.0.26 () {54 vars in 961 bytes} [Tue Sep 13 14:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 14:28:54.221674 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcba42-1bbb-4261-bdc8-9c6a30cccfdc None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:28:54.221957 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcba42-1bbb-4261-bdc8-9c6a30cccfdc None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:28:54.222227 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcba42-1bbb-4261-bdc8-9c6a30cccfdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:28:54.259346 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-6efcba42-1bbb-4261-bdc8-9c6a30cccfdc None None] MFA Rules not processed for user `311397bfe2c04569852fca0cfcdbad66`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 14:28:54.260517 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-6efcba42-1bbb-4261-bdc8-9c6a30cccfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:28:54.323534 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1476/2954] 10.222.0.26 () {58 vars in 1058 bytes} [Tue Sep 13 14:28:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 14:28:54.331475 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc158f-ab20-4464-91f4-72be3efc7c48 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:28:54.344560 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc158f-ab20-4464-91f4-72be3efc7c48 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:28:54.349390 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4611a9-d5d8-4e8d-985e-f36fea087b19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311397bfe2c04569852fca0cfcdbad66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:28:54.349968 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4611a9-d5d8-4e8d-985e-f36fea087b19 service placement] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:28:54.350240 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4611a9-d5d8-4e8d-985e-f36fea087b19 service placement] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:28:54.350511 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4611a9-d5d8-4e8d-985e-f36fea087b19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:28:54.352177 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-dd4611a9-d5d8-4e8d-985e-f36fea087b19 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:28:54.363854 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4611a9-d5d8-4e8d-985e-f36fea087b19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:28:54.365453 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4611a9-d5d8-4e8d-985e-f36fea087b19 service placement] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:28:54.375762 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1479/2955] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:28:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:28:56.322996 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efcba42-1bbb-4261-bdc8-9c6a30cccfdc None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:28:56.338777 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efcba42-1bbb-4261-bdc8-9c6a30cccfdc None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:28:56.346304 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3571d70-9453-4fe1-add9-c137a84526c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:28:56.347021 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3571d70-9453-4fe1-add9-c137a84526c0 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:28:56.347531 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3571d70-9453-4fe1-add9-c137a84526c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:28:56.347861 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3571d70-9453-4fe1-add9-c137a84526c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:28:56.349854 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e3571d70-9453-4fe1-add9-c137a84526c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:28:56.367384 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3571d70-9453-4fe1-add9-c137a84526c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:28:56.369606 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3571d70-9453-4fe1-add9-c137a84526c0 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:28:56.381522 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1477/2956] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:28:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:29:04.370989 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=12 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:29:06.376387 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=47 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:30:35.974574 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4611a9-d5d8-4e8d-985e-f36fea087b19 service placement] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:30:35.976321 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-dd4611a9-d5d8-4e8d-985e-f36fea087b19 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:30:36.135108 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4611a9-d5d8-4e8d-985e-f36fea087b19 service placement] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:30:36.147121 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a48b8-2e84-4a15-85a3-6ca0d5efc199 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:30:36.147737 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a48b8-2e84-4a15-85a3-6ca0d5efc199 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:30:36.148012 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a48b8-2e84-4a15-85a3-6ca0d5efc199 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:30:36.148281 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a48b8-2e84-4a15-85a3-6ca0d5efc199 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:30:36.150094 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7d9a48b8-2e84-4a15-85a3-6ca0d5efc199 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:30:36.163343 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a48b8-2e84-4a15-85a3-6ca0d5efc199 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:30:36.164931 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a48b8-2e84-4a15-85a3-6ca0d5efc199 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:30:36.184004 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1480/2957] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:30:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 14:30:38.221123 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3571d70-9453-4fe1-add9-c137a84526c0 service nova] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:30:38.222625 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e3571d70-9453-4fe1-add9-c137a84526c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:30:38.315456 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3571d70-9453-4fe1-add9-c137a84526c0 service nova] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:30:38.320950 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020a234-12b9-4c3c-aff0-2f8632e74f3c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311397bfe2c04569852fca0cfcdbad66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:30:38.321589 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020a234-12b9-4c3c-aff0-2f8632e74f3c service placement] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:30:38.321863 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020a234-12b9-4c3c-aff0-2f8632e74f3c service placement] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:30:38.322130 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020a234-12b9-4c3c-aff0-2f8632e74f3c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:30:38.323891 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-9020a234-12b9-4c3c-aff0-2f8632e74f3c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:30:38.336580 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020a234-12b9-4c3c-aff0-2f8632e74f3c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:30:38.338190 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020a234-12b9-4c3c-aff0-2f8632e74f3c service placement] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:30:38.350100 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1478/2958] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:30:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:30:38.602245 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a48b8-2e84-4a15-85a3-6ca0d5efc199 service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:30:38.613699 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a48b8-2e84-4a15-85a3-6ca0d5efc199 service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:30:38.619297 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10679ed8-ffc5-40bb-8c0e-2a3a50ceb59c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3533d0a24e4e7bbf5c7137d3511b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:30:38.620034 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10679ed8-ffc5-40bb-8c0e-2a3a50ceb59c service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:30:38.624652 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10679ed8-ffc5-40bb-8c0e-2a3a50ceb59c service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:30:38.624652 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10679ed8-ffc5-40bb-8c0e-2a3a50ceb59c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:30:38.624652 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-10679ed8-ffc5-40bb-8c0e-2a3a50ceb59c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:30:38.636971 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10679ed8-ffc5-40bb-8c0e-2a3a50ceb59c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:30:38.638615 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10679ed8-ffc5-40bb-8c0e-2a3a50ceb59c service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:30:38.650516 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1481/2959] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:30:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:30:39.921602 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020a234-12b9-4c3c-aff0-2f8632e74f3c service placement] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:30:39.931248 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020a234-12b9-4c3c-aff0-2f8632e74f3c service placement] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:30:39.934791 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2caf1-e69c-4156-b06c-25092daee718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb992cf1a7a445119262b567ce345181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:30:39.935370 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2caf1-e69c-4156-b06c-25092daee718 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:30:39.935642 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2caf1-e69c-4156-b06c-25092daee718 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:30:39.935902 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2caf1-e69c-4156-b06c-25092daee718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:30:39.996224 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2caf1-e69c-4156-b06c-25092daee718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:30:39.997725 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2caf1-e69c-4156-b06c-25092daee718 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:30:40.007856 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1479/2960] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:30:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:30:43.045376 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10679ed8-ffc5-40bb-8c0e-2a3a50ceb59c service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:30:43.057043 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10679ed8-ffc5-40bb-8c0e-2a3a50ceb59c service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:30:43.062257 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11506be4-a6f6-4a34-af50-215efd781fba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311397bfe2c04569852fca0cfcdbad66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:30:43.062851 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11506be4-a6f6-4a34-af50-215efd781fba service placement] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:30:43.063132 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11506be4-a6f6-4a34-af50-215efd781fba service placement] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:30:43.063404 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11506be4-a6f6-4a34-af50-215efd781fba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:30:43.065169 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-11506be4-a6f6-4a34-af50-215efd781fba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:30:43.077140 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11506be4-a6f6-4a34-af50-215efd781fba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:30:43.078644 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11506be4-a6f6-4a34-af50-215efd781fba service placement] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:30:43.094152 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1482/2961] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:30:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:30:46.150347 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2caf1-e69c-4156-b06c-25092daee718 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:30:46.169553 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2caf1-e69c-4156-b06c-25092daee718 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:30:46.174790 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74563b6d-45b2-4843-870e-b14f3cb3dafe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311397bfe2c04569852fca0cfcdbad66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:30:46.175407 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74563b6d-45b2-4843-870e-b14f3cb3dafe service placement] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:30:46.175691 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74563b6d-45b2-4843-870e-b14f3cb3dafe service placement] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:30:46.175959 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74563b6d-45b2-4843-870e-b14f3cb3dafe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:30:46.178633 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-74563b6d-45b2-4843-870e-b14f3cb3dafe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:30:46.192394 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74563b6d-45b2-4843-870e-b14f3cb3dafe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:30:46.194665 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74563b6d-45b2-4843-870e-b14f3cb3dafe service placement] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:30:46.210845 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1480/2962] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:30:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:30:46.217902 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11506be4-a6f6-4a34-af50-215efd781fba service placement] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:30:46.230258 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11506be4-a6f6-4a34-af50-215efd781fba service placement] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:30:46.236032 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187789f4-92c3-4d58-b0fc-864f15b8f58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:30:46.236661 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187789f4-92c3-4d58-b0fc-864f15b8f58f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:30:46.237455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187789f4-92c3-4d58-b0fc-864f15b8f58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:30:46.237455 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187789f4-92c3-4d58-b0fc-864f15b8f58f admin admin] PATH_INFO: `/v3/users/c52f5a2d80824692add1e030a0282756` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:30:46.238478 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187789f4-92c3-4d58-b0fc-864f15b8f58f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c52f5a2d80824692add1e030a0282756)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:30:46.240424 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187789f4-92c3-4d58-b0fc-864f15b8f58f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:30:46.292038 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-187789f4-92c3-4d58-b0fc-864f15b8f58f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c52f5a2d80824692add1e030a0282756'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:30:46.301408 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-187789f4-92c3-4d58-b0fc-864f15b8f58f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c52f5a2d80824692add1e030a0282756'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:30:46.316031 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-187789f4-92c3-4d58-b0fc-864f15b8f58f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c52f5a2d80824692add1e030a0282756'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:30:46.316768 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-187789f4-92c3-4d58-b0fc-864f15b8f58f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c52f5a2d80824692add1e030a0282756'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:30:46.325633 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-187789f4-92c3-4d58-b0fc-864f15b8f58f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c52f5a2d80824692add1e030a0282756'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:30:46.332735 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1483/2963] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:30:46 2022] DELETE /identity/v3/users/c52f5a2d80824692add1e030a0282756 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:30:46.505600 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74563b6d-45b2-4843-870e-b14f3cb3dafe service placement] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:30:46.525980 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74563b6d-45b2-4843-870e-b14f3cb3dafe service placement] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:30:46.587348 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d05172-3827-4e30-be33-80d09e5e9972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:30:46.587970 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d05172-3827-4e30-be33-80d09e5e9972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:30:46.588247 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d05172-3827-4e30-be33-80d09e5e9972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:30:46.588517 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d05172-3827-4e30-be33-80d09e5e9972 admin admin] PATH_INFO: `/v3/projects/0bcf1d78e18a4abe97f13737af51a4a1` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:30:46.589656 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d05172-3827-4e30-be33-80d09e5e9972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bcf1d78e18a4abe97f13737af51a4a1)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:30:46.591549 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d05172-3827-4e30-be33-80d09e5e9972 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:30:46.593078 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:30:46.639776 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-05d05172-3827-4e30-be33-80d09e5e9972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bcf1d78e18a4abe97f13737af51a4a1', 'request_id': 'req-05d05172-3827-4e30-be33-80d09e5e9972'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:30:46.646956 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-05d05172-3827-4e30-be33-80d09e5e9972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bcf1d78e18a4abe97f13737af51a4a1', 'request_id': 'req-05d05172-3827-4e30-be33-80d09e5e9972'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:30:46.652778 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-05d05172-3827-4e30-be33-80d09e5e9972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bcf1d78e18a4abe97f13737af51a4a1', 'request_id': 'req-05d05172-3827-4e30-be33-80d09e5e9972'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:30:46.664232 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-05d05172-3827-4e30-be33-80d09e5e9972 admin admin] The token cache is being invalidate because project 0bcf1d78e18a4abe97f13737af51a4a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:30:46.664520 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-05d05172-3827-4e30-be33-80d09e5e9972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:30:46.665179 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-05d05172-3827-4e30-be33-80d09e5e9972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:30:46.666671 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1481/2964] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:30:46 2022] DELETE /identity/v3/projects/0bcf1d78e18a4abe97f13737af51a4a1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:30:46.671235 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187789f4-92c3-4d58-b0fc-864f15b8f58f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:30:46.672648 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-187789f4-92c3-4d58-b0fc-864f15b8f58f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:30:46.685514 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187789f4-92c3-4d58-b0fc-864f15b8f58f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:30:46.720129 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:30:46.744890 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050fc15-f860-46b2-aecf-3cb1914ffff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:30:46.745553 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050fc15-f860-46b2-aecf-3cb1914ffff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:30:46.745830 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050fc15-f860-46b2-aecf-3cb1914ffff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:30:46.746098 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050fc15-f860-46b2-aecf-3cb1914ffff7 admin admin] PATH_INFO: `/v3/users/f359e3caf86a4f4db67270329be0ea97` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:30:46.747302 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050fc15-f860-46b2-aecf-3cb1914ffff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f359e3caf86a4f4db67270329be0ea97)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:30:46.749765 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050fc15-f860-46b2-aecf-3cb1914ffff7 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:30:46.795649 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e050fc15-f860-46b2-aecf-3cb1914ffff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f359e3caf86a4f4db67270329be0ea97'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:30:46.802208 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e050fc15-f860-46b2-aecf-3cb1914ffff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f359e3caf86a4f4db67270329be0ea97'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:30:46.814780 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e050fc15-f860-46b2-aecf-3cb1914ffff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f359e3caf86a4f4db67270329be0ea97'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:30:46.815421 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e050fc15-f860-46b2-aecf-3cb1914ffff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f359e3caf86a4f4db67270329be0ea97'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:30:46.822372 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e050fc15-f860-46b2-aecf-3cb1914ffff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f359e3caf86a4f4db67270329be0ea97'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:30:46.828833 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1484/2965] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Sep 13 14:30:46 2022] DELETE /identity/v3/users/f359e3caf86a4f4db67270329be0ea97 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:30:47.001510 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d05172-3827-4e30-be33-80d09e5e9972 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:30:47.002934 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-05d05172-3827-4e30-be33-80d09e5e9972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:30:47.016563 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d05172-3827-4e30-be33-80d09e5e9972 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:30:47.074440 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82781088-cdb8-4c5b-8fc6-c73ea4828d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97bb92037c8b4cdabc69372647290362', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2ed08b3b52d45f68ee1e0b8c4e4ceb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:30:47.075056 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82781088-cdb8-4c5b-8fc6-c73ea4828d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:30:47.075328 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82781088-cdb8-4c5b-8fc6-c73ea4828d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:30:47.075591 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82781088-cdb8-4c5b-8fc6-c73ea4828d38 admin admin] PATH_INFO: `/v3/projects/becd46bf23714399be34ceec782e5680` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:30:47.076711 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82781088-cdb8-4c5b-8fc6-c73ea4828d38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=becd46bf23714399be34ceec782e5680)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:30:47.078629 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82781088-cdb8-4c5b-8fc6-c73ea4828d38 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:30:47.126430 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-82781088-cdb8-4c5b-8fc6-c73ea4828d38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'becd46bf23714399be34ceec782e5680', 'request_id': 'req-82781088-cdb8-4c5b-8fc6-c73ea4828d38'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:30:47.134010 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-82781088-cdb8-4c5b-8fc6-c73ea4828d38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'becd46bf23714399be34ceec782e5680', 'request_id': 'req-82781088-cdb8-4c5b-8fc6-c73ea4828d38'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:30:47.140418 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-82781088-cdb8-4c5b-8fc6-c73ea4828d38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'becd46bf23714399be34ceec782e5680', 'request_id': 'req-82781088-cdb8-4c5b-8fc6-c73ea4828d38'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:30:47.153923 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-82781088-cdb8-4c5b-8fc6-c73ea4828d38 admin admin] The token cache is being invalidate because project becd46bf23714399be34ceec782e5680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 14:30:47.154575 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-82781088-cdb8-4c5b-8fc6-c73ea4828d38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:30:47.155848 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-82781088-cdb8-4c5b-8fc6-c73ea4828d38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 14:30:47.157575 dv-cinder-857434-1-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1482/2966] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Sep 13 14:30:47 2022] DELETE /identity/v3/projects/becd46bf23714399be34ceec782e5680 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 14:30:56.824729 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=36,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:30:57.148966 dv-cinder-857434-1-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=75,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:35:45.183149 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050fc15-f860-46b2-aecf-3cb1914ffff7 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 14:35:45.184562 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e050fc15-f860-46b2-aecf-3cb1914ffff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:35:45.254291 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050fc15-f860-46b2-aecf-3cb1914ffff7 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 14:35:45.312993 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14db0ad-fe54-41e8-ba0c-3e53f962aae9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311397bfe2c04569852fca0cfcdbad66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17ba27c26bf34daa91cf8f7cc25bf086', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 14:35:45.313629 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14db0ad-fe54-41e8-ba0c-3e53f962aae9 service placement] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 14:35:45.313908 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14db0ad-fe54-41e8-ba0c-3e53f962aae9 service placement] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 14:35:45.314182 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14db0ad-fe54-41e8-ba0c-3e53f962aae9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 14:35:45.315924 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b14db0ad-fe54-41e8-ba0c-3e53f962aae9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 14:35:45.327313 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14db0ad-fe54-41e8-ba0c-3e53f962aae9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 14:35:45.328901 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14db0ad-fe54-41e8-ba0c-3e53f962aae9 service placement] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 14:35:45.339268 dv-cinder-857434-1-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1485/2967] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Sep 13 14:35:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 14:35:55.334977 dv-cinder-857434-1-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=58 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}